00010000:00010000:0.0:1746065070.621759:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065070.621768:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 258 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.621798:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065070.621819:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 258 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.621827:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 258 pid: 7205 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746065070.621836:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262476288:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065070.621900:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065070.627059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.627601:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262476288:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065070.627621:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065070.627908:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260908800 00000100:00100000:0.0:1746065070.627912:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260908800 00010000:00010000:0.0:1746065070.627929:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 260 pid: 7205 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746065070.627951:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3203 00000100:00100000:0.0:1746065070.627956:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+260:2005:x1830881260908800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065070.627963:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065070.627972:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 260 pid: 7205 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.627981:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 260 pid: 7205 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.627999:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145abec lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2cf expref: 260 pid: 7205 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.628009:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bd:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:0.0:1746065070.628037:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065070.628045:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065070.628050:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065070.628073:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065070.628096:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+259:2005:x1830881260908800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.628102:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3203 00000001:00080000:0.0:1746065070.631687:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974327 is committed 00000004:00080000:0.0:1746065070.631700:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1372 committed 00000004:00080000:0.0:1746065070.631714:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1382 committed 00000004:00080000:0.0:1746065070.631726:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1381 committed 00000004:00080000:0.0:1746065070.631728:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1371 committed 00000100:00100000:0.0:1746065070.633685:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262477184:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.633706:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065070.633718:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065070.633721:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262477312:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.633731:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065070.633827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.633915:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909056 00000100:00100000:0.0:1746065070.633917:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909056 00000100:00100000:0.0:1746065070.633940:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10796 00000100:00100000:0.0:1746065070.633944:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+236:27611:x1830881260909056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065070.633953:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065070.633961:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc145ac16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a2dd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.634009:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.634016:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634023:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634031:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.634036:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634041:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634097:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac2b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.634107:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634112:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065070.634119:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2bd:0x0]: returning size 2 00010000:00010000:0.0:1746065070.634167:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634172:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634176:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634180:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634183:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065070.634185:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634189:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634195:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854700) 00010000:00010000:0.0:1746065070.634197:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065070.634199:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634203:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145ac1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634213:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634218:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634222:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634225:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065070.634228:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634232:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634236:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:0.0:1746065070.634238:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065070.634240:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634244:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145ac24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.634269:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc145ac16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2dd expref: 239 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.634280:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac2b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2dd expref: 238 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.634285:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bd:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:0.0:1746065070.634286:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065070.634288:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73c00, rc 0) 00000100:00100000:0.0:1746065070.634308:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+238:27611:x1830881260909056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 364us (481us total) trans 4294974328 rc 0/0 00000100:00100000:0.0:1746065070.634313:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10796 00000004:00080000:0.0:1746065070.635146:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c458700/2, rc 0, transno 21474839335 00000100:00100000:0.0:1746065070.635150:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262476800:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065070.635166:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cff480/2, rc 0, transno 17179872067 00000100:00100000:0.0:1746065070.635169:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262477312:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065070.635175:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cfdf80/2, rc 0, transno 17179872066 00000100:00100000:0.0:1746065070.635178:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262477184:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.637289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.638744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.638771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:0.0:1746065070.639973:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c525500/2, rc 0, transno 17179872068 00000100:00100000:0.0:1746065070.639980:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262477056:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065070.640046:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45bb80/2, rc 0, transno 21474839336 00000100:00100000:0.0:1746065070.640050:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262476416:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065070.640076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.640090:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260909696 00000100:00100000:0.0:1746065070.640093:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260909696 00000100:00100000:0.0:1746065070.640112:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3705 00000100:00100000:0.0:1746065070.640117:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+238:27611:x1830881260909696:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065070.640218:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+239:27611:x1830881260909696:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 100us (140us total) trans 4294974329 rc 0/0 00000100:00100000:0.0:1746065070.640226:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3705 00000100:00100000:0.0:1746065070.642752:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.642876:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.644741:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.646038:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.646056:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260910336 00000100:00100000:0.0:1746065070.646060:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260910336 00002000:00010000:0.0:1746065070.646074:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/731 (0->18446744073709551615) 00002000:00100000:0.0:1746065070.646078:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7b80 with x1830881260910336 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065070.646084:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7b80. 00000100:00100000:0.0:1746065070.646097:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1130 00000100:00100000:0.0:1746065070.646102:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881260910336:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065070.646189:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065070.646191:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb mtime from disk: 0 -> 1746065070 00002000:00010000:0.0:1746065070.646193:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065070.646194:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb ctime from disk: 0 -> 1746065070 00002000:00010000:0.0:1746065070.646196:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2db:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065070.646213:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881260910336:12345-192.168.202.27@tcp:10:bash.0 Request processed in 111us (176us total) trans 17179872069 rc 0/0 00000100:00100000:0.0:1746065070.646219:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1130 00002000:00010000:0.0:1746065070.646222:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/731 (0->18446744073709551615) 00002000:00100000:0.0:1746065070.646224:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7b80 with x1830881260910336 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065070.646227:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7b80. 00000100:00100000:0.0:1746065070.648894:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.655303:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.657901:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911104 00000100:00100000:0.0:1746065070.657905:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911104 00000100:00100000:0.0:1746065070.657925:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10798 00000100:00100000:0.0:1746065070.657931:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+242:27613:x1830881260911104:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065070.657954:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065070.657968:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73400/0xad6b7ddc145abfa lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2bd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2d6 expref: 242 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.658710:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac2b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2dd expref: 241 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.658723:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145abc2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2c1 expref: 240 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.658730:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bd:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:0.0:1746065070.658733:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065070.658746:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06c00/0xad6b7ddc145ac63 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.658752:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06c00/0xad6b7ddc145ac63 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.658758:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06c00/0xad6b7ddc145ac63 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.658766:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06000/0xad6b7ddc145ac6a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.658770:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06000/0xad6b7ddc145ac6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.658801:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06000/0xad6b7ddc145ac6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.658852:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06a00/0xad6b7ddc145ac71 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.658859:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131053a00/0xad6b7ddc145ac55 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2bd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2f2 expref: 239 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.658864:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06a00/0xad6b7ddc145ac71 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.658885:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880131053a00/0xad6b7ddc145ac55 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2bd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2f2 expref: 239 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.658894:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880131053a00/0xad6b7ddc145ac55 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2bd:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2f2 expref: 239 pid: 7205 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746065070.658903:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262477696:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065070.658953:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065070.661386:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.668348:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260911360 00000100:00100000:0.0:1746065070.668356:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260911360 00000100:00100000:0.0:1746065070.668401:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10799 00000100:00100000:0.0:1746065070.668407:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+240:27612:x1830881260911360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065070.668435:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065070.668452:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145ac78 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a2f9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.668512:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac7f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.668527:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac7f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.668535:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac7f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065070.668573:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2bd:0x0]: returning size 5 00000004:00200000:0.0:1746065070.668578:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065070.668590:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac7f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.668621:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145ac78 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2f9 expref: 242 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.668661:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73c00/0xad6b7ddc145ac7f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2bd:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2f9 expref: 241 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.668667:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bd:0x0].0x0 (ffff88012f854000) 00010000:00010000:0.0:1746065070.668669:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065070.668672:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73c00, rc 0) 00000100:00100000:0.0:1746065070.668711:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+241:27612:x1830881260911360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 305us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.668717:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10799 00000100:00100000:0.0:1746065070.675173:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.676724:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.682018:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.683267:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.689100:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.693862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.708161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.711585:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.711617:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.711702:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.715865:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.718018:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.722383:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.723435:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260914688 00000100:00100000:0.0:1746065070.723439:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260914688 00000100:00100000:0.0:1746065070.723461:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10809 00000100:00100000:0.0:1746065070.723466:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:26180:x1830881260914688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065070.723474:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065070.723481:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145ad7b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a34d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.723495:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145ad82 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.723500:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145ad82 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.723506:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145ad82 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.723559:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145ad7b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a34d expref: 255 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.724426:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145ad82 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2bf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a34d expref: 253 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.724438:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bf:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:0.0:1746065070.724439:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065070.724441:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:0.0:1746065070.724465:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:26180:x1830881260914688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 999us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.724470:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10809 00000100:00100000:0.0:1746065070.728065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.731553:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.734002:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.739448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.739503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.740404:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3712 00000100:00100000:0.0:1746065070.740411:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+258:27615:x1830881260915712:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065070.742768:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.747441:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262478208:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.747488:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065070.747514:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065070.747518:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262478336:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.747534:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065070.747555:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262478208 00000100:00100000:0.0:1746065070.747560:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262478208 00000100:00100000:0.0:1746065070.747586:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262478336 00000100:00100000:0.0:1746065070.747588:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262478336 00000100:00100000:0.0:1746065070.747598:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7480 00000100:00100000:0.0:1746065070.747603:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+126:3761:x1830881262478208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065070.747622:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:732 count 1 00010000:00010000:0.0:1746065070.747652:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.747666:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d07000/0xad6b7ddc145ab8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2ac expref: 55 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065070.747672:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.747674:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.747676:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.747696:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d07000/0xad6b7ddc145ab8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2ac expref: 55 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065070.747706:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d07000/0xad6b7ddc145ab8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a2ac expref: 55 pid: 9548 timeout: 766 lvb_type: 1 00000100:00100000:0.0:1746065070.747714:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262478592:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065070.747765:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000004:00080000:0.0:1746065070.749895:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223b80/2, rc 0, transno 17179872070 00000100:00100000:0.0:1746065070.749900:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262478336:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.753228:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.756658:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262479232:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065070.756670:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131053000/0xad6b7ddc145addd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065070.757153:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065070.757601:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131053000/0xad6b7ddc145addd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.757607:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131053000/0xad6b7ddc145addd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.757614:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131053000/0xad6b7ddc145addd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.757619:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131053000/0xad6b7ddc145addd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.757630:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065070.757819:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+129:3759:x1830881262478080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9257us (9515us total) trans 17179872072 rc 0/0 00000100:00100000:0.0:1746065070.757825:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7483 00000100:00100000:0.0:1746065070.758884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.758905:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.758927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.761883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.761912:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260916992 00000100:00100000:0.0:1746065070.761917:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260916992 00000100:00100000:0.0:1746065070.761941:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7488 00000100:00100000:0.0:1746065070.761957:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+55:26180:x1830881260916992:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065070.761970:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065070.761985:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a370 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065070.762006:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065070.762018:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.762019:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.762025:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a370 expref: 56 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.762036:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a370 expref: 56 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.762043:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:0.0:1746065070.762065:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+56:26180:x1830881260916992:12345-192.168.202.27@tcp:101:bash.0 Request processed in 120us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.762070:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7488 00000100:00100000:0.0:1746065070.762115:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.762135:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260917120 00000100:00100000:0.0:1746065070.762138:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260917120 00000100:00100000:0.0:1746065070.762161:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3714 00000100:00100000:0.0:1746065070.762165:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+239:27615:x1830881260917120:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065070.762248:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+239:27615:x1830881260917120:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.762253:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3714 00000004:00080000:0.0:1746065070.763970:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223480/2, rc 0, transno 17179872073 00000100:00100000:0.0:1746065070.763974:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262478208:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065070.763982:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065070.763986:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.763991:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065070.763993:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.763998:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.764006:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.764011:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc145add6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.764020:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065070.764021:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065070.764022:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065070.764364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.769614:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.769664:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.776256:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.780048:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260918016 00000100:00100000:0.0:1746065070.780054:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260918016 00000100:00100000:0.0:1746065070.780095:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3715 00000100:00100000:0.0:1746065070.780101:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+241:26180:x1830881260918016:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065070.780289:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+242:26180:x1830881260918016:12345-192.168.202.27@tcp:35:bash.0 Request processed in 187us (309us total) trans 4294974349 rc 0/0 00000100:00100000:0.0:1746065070.780295:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3715 00000100:00100000:0.0:1746065070.786131:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.793410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.807032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.807075:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065070.807664:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065070.815972:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260919168 00000100:00100000:0.0:1746065070.815977:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260919168 00010000:00010000:0.0:1746065070.816004:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc145ae2a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2bf:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a385 expref: 243 pid: 7204 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746065070.816022:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3213 00000100:00100000:0.0:1746065070.816027:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+243:2007:x1830881260919168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065070.816034:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065070.816038:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc145ae2a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a385 expref: 243 pid: 7204 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.816048:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc145ae2a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x2bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a385 expref: 243 pid: 7204 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.816063:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc145ae2a lrc: 0/0,0 mode: --/CW res: [0x240000403:0x2bf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a385 expref: 243 pid: 7204 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.816076:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bf:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:0.0:1746065070.816079:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145ae3f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.816086:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145ae3f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.816091:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145ae3f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.816105:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065070.816132:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+242:2007:x1830881260919168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.816136:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3213 00000100:00100000:0.0:1746065070.819916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.823196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.825288:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.832035:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.834500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.834567:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.837669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.838735:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920320 00000100:00100000:0.0:1746065070.838743:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920320 00010000:00010000:0.0:1746065070.838788:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a370 expref: 59 pid: 1880 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746065070.838813:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3214 00000100:00100000:0.0:1746065070.838819:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2006:x1830881260920320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065070.838830:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065070.838844:0:7191:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1746065070.838846:0:7191:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1746065070.838851:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a370 expref: 59 pid: 1880 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.838868:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a370 expref: 59 pid: 1880 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.838885:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc145adf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a370 expref: 59 pid: 1880 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746065070.838909:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.838912:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.838915:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d06000/0xad6b7ddc145ae85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.838922:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06000/0xad6b7ddc145ae85 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.838944:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065070.838978:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2006:x1830881260920320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 158us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.838983:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3214 00000100:00100000:0.0:1746065070.847865:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260920704 00000100:00100000:0.0:1746065070.847869:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260920704 00000100:00100000:0.0:1746065070.847894:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10824 00000100:00100000:0.0:1746065070.847899:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+248:27618:x1830881260920704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065070.847909:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065070.847919:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73800/0xad6b7ddc145aeb6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a3af expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.847953:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.847961:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.847968:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.847975:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.847981:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.847986:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848008:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848013:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848017:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848023:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848027:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065070.848030:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848036:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848042:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bcc500) 00010000:00010000:0.0:1746065070.848045:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065070.848047:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848052:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145aebd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848060:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848064:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848068:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848072:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065070.848074:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848078:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848083:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3200) 00010000:00010000:0.0:1746065070.848084:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065070.848086:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848090:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145aec4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.848107:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73800/0xad6b7ddc145aeb6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3af expref: 249 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.848118:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73800/0xad6b7ddc145aeb6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3af expref: 249 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.848124:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:0.0:1746065070.848160:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+248:27618:x1830881260920704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 261us (387us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065070.848165:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10824 00000100:00100000:0.0:1746065070.850554:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.852866:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262480000:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065070.853860:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065070.853900:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262480000 00000100:00100000:0.0:1746065070.853903:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262480000 00000100:00100000:0.0:1746065070.853927:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7494 00000100:00100000:0.0:1746065070.853931:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+84:3761:x1830881262480000:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065070.853975:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065070.853978:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb mtime from disk: 1746065070 -> 1746065070 00002000:00010000:0.0:1746065070.853980:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065070.853981:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb ctime from disk: 1746065070 -> 1746065070 00002000:00010000:0.0:1746065070.853983:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2dc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065070.854003:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+85:3761:x1830881262480000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 72us (143us total) trans 21474839344 rc 0/0 00000100:00100000:0.0:1746065070.854008:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7494 00000004:00080000:0.0:1746065070.854027:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925ce300/2, rc 0, transno 21474839344 00000100:00100000:0.0:1746065070.854030:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262480000:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065070.857237:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.860520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.863862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.866681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.868665:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.870904:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.873458:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.873765:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.881301:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.881624:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.884501:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.886140:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.895990:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260923648 00000100:00100000:0.0:1746065070.895997:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260923648 00010000:00010000:0.0:1746065070.896025:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145af18 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3d2 expref: 60 pid: 9548 timeout: 766 lvb_type: 1 00000100:00100000:0.0:1746065070.896054:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3216 00000100:00100000:0.0:1746065070.896060:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+60:2006:x1830881260923648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065070.896070:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065070.896086:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145af18 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3d2 expref: 60 pid: 9548 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746065070.896095:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145af18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3d2 expref: 60 pid: 9548 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746065070.896114:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.896115:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065070.896120:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baf600/0xad6b7ddc145af5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3e7 expref: 60 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.896127:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf600/0xad6b7ddc145af5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3e7 expref: 60 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.896150:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091baf600/0xad6b7ddc145af5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3e7 expref: 60 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065070.896158:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881262480640:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065070.896222:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065070.901665:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924032 00000100:00100000:0.0:1746065070.901669:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924032 00000100:00100000:0.0:1746065070.901701:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10834 00000100:00100000:0.0:1746065070.901706:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+250:26180:x1830881260924032:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065070.901715:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065070.901718:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065070.901737:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61c00/0xad6b7ddc145af65 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2c0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3ee expref: 250 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.901763:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c0:0x0].0x0 (ffff88009554f400) 00010000:00010000:0.0:1746065070.901766:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065070.901792:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72c00/0xad6b7ddc145af6c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a3f5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.901825:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73e00/0xad6b7ddc145af73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2c0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065070.901834:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73e00/0xad6b7ddc145af73 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2c0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.901843:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73e00/0xad6b7ddc145af73 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2c0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:0.0:1746065070.902006:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2041, 88 off170296 00000004:00080000:0.0:1746065070.902011:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 666920236939ns, next at 666982364919ns, rc = 0 00000040:00080000:0.0:1746065070.902033:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2047, 88 off170856 00000004:00080000:0.0:1746065070.902036:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 666920262048ns, next at 666982343626ns, rc = 0 00000040:00080000:0.0:1746065070.902067:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2048, 88 off170944 00000004:00080000:0.0:1746065070.902069:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 666920295802ns, next at 666982343626ns, rc = 0 00000040:00080000:0.0:1746065070.902082:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2042, 88 off170384 00000004:00080000:0.0:1746065070.902084:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 666920310784ns, next at 666982364919ns, rc = 0 00000100:00100000:0.0:1746065070.904752:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.909651:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262481024:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065070.909690:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065070.920587:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262481408 00000100:00100000:0.0:1746065070.920594:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262481408 00000100:00100000:0.0:1746065070.920621:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262481536 00000100:00100000:0.0:1746065070.920622:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262481536 00000100:00100000:0.0:1746065070.920643:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7504 00000100:00100000:0.0:1746065070.920648:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+134:3759:x1830881262481408:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065070.920751:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065070.920754:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb mtime from disk: 1746065070 -> 1746065070 00002000:00010000:0.0:1746065070.920756:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb atime from disk: 1746065070 -> 1746065070 00002000:00010000:0.0:1746065070.920757:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb ctime from disk: 1746065071 -> 1746065071 00002000:00010000:0.0:1746065070.920759:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2dd:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065070.920839:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+135:3759:x1830881262481408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 190us (2290us total) trans 17179872081 rc 0/0 00000100:00100000:0.0:1746065070.920845:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7504 00000100:00100000:0.0:1746065070.920857:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7505 00000100:00100000:0.0:1746065070.920862:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+134:3761:x1830881262481536:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065070.920910:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2de:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065070.920913:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2de:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065070.920914:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2de:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065070.920916:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2de:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065070.920917:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2de:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065070.923106:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+135:3761:x1830881262481536:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2242us (4425us total) trans 17179872082 rc 0/0 00000100:00100000:0.0:1746065070.923113:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7505 00010000:00010000:0.0:1746065070.923136:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.923142:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.923148:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.923152:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065070.923155:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.923160:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.923173:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bf:0x0].0x0 (ffff8800929a3600) 00010000:00010000:0.0:1746065070.923175:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065070.923179:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.923184:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af7a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2bf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065070.923216:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260924672 00000100:00100000:0.0:1746065070.923220:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260924672 00000100:00100000:0.0:1746065070.939246:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.939291:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065070.940082:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065070.940088:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af96 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.940094:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baec00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065070.940098:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af96 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.940105:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af96 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.940115:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2bf:0x0].0x0 (ffff880090532100) 00010000:00010000:0.0:1746065070.940118:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065070.940121:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af96 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.940125:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145af96 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.940137:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065070.940139:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065070.940140:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065070.940919:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260925440 00000100:00100000:0.0:1746065070.940923:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260925440 00002000:00010000:0.0:1746065070.940941:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/735 (0->18446744073709551615) 00002000:00100000:0.0:1746065070.940944:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881260925440 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065070.940949:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5500. 00000100:00100000:0.0:1746065070.940960:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1134 00000100:00100000:0.0:1746065070.940965:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+60:2004:x1830881260925440:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065070.941037:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065070.941039:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb mtime from disk: 0 -> 1746065071 00002000:00010000:0.0:1746065070.941041:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065070.941043:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb ctime from disk: 0 -> 1746065071 00002000:00010000:0.0:1746065070.941044:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2df:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065070.941064:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+61:2004:x1830881260925440:12345-192.168.202.27@tcp:10:bash.0 Request processed in 99us (723us total) trans 17179872083 rc 0/0 00000100:00100000:0.0:1746065070.941069:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1134 00002000:00010000:0.0:1746065070.941071:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/735 (0->18446744073709551615) 00002000:00100000:0.0:1746065070.941073:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881260925440 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065070.941076:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5500. 00000100:00100000:0.0:1746065070.944538:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.952998:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.955511:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.956065:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.958044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00200000:0.0:1746065070.962909:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2c0:0x0]: returning size 5 00000004:00200000:0.0:1746065070.962914:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065070.962928:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06200/0xad6b7ddc145afea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065070.962951:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc145afe3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2c0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a41f expref: 243 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.962968:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06200/0xad6b7ddc145afea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a41f expref: 242 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065070.962976:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c0:0x0].0x0 (ffff8800aa04c500) 00010000:00010000:0.0:1746065070.962978:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065070.962980:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06200, rc 0) 00000100:00100000:0.0:1746065070.963021:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+242:27619:x1830881260926592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 337us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065070.963026:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10839 00000100:00100000:0.0:1746065070.966864:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065070.967467:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065070.967473:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145aff1 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.967479:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065070.967482:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145aff1 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.967487:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145aff1 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.967496:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c0:0x0].0x0 (ffff8800aa04c500) 00010000:00010000:0.0:1746065070.967498:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065070.967501:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145aff1 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.967504:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145aff1 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065070.967513:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065070.967515:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065070.967516:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065070.983628:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.986573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.991351:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065070.996127:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.011194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.011411:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.012341:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10847 00000100:00100000:0.0:1746065071.012349:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+248:27623:x1830881260928384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.012356:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.012363:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf000/0xad6b7ddc145b08b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a457 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.012409:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.012416:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012425:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065071.012434:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2c2:0x0]: returning size 0 00010000:00010000:0.0:1746065071.012492:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012497:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012502:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012510:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.012513:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012518:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012528:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c2:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065071.012530:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065071.012533:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012537:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc145b092 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.012576:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf000/0xad6b7ddc145b08b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2c2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a457 expref: 250 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.012581:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf000/0xad6b7ddc145b08b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2c2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a457 expref: 250 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.012588:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf000, rc 0) 00000100:00100000:0.0:1746065071.012608:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+249:27623:x1830881260928384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 262us (1198us total) trans 4294974371 rc 301/301 00000100:00100000:0.0:1746065071.012614:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10847 00000100:00100000:0.0:1746065071.016661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.026977:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.031079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.031107:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929024 00000100:00100000:0.0:1746065071.031114:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929024 00000100:00100000:0.0:1746065071.031158:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3724 00000100:00100000:0.0:1746065071.031164:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+248:27621:x1830881260929024:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065071.031328:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+249:27621:x1830881260929024:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 163us (555us total) trans 4294974374 rc 0/0 00000100:00100000:0.0:1746065071.031333:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3724 00000100:00100000:0.0:1746065071.031378:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.037316:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260929280 00000100:00100000:0.0:1746065071.037323:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260929280 00000100:00100000:0.0:1746065071.042255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.047169:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.048679:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.050668:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.050716:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.052496:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.055449:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.057751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.057771:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931584 00000100:00100000:0.0:1746065071.058249:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931584 00010000:00010000:0.0:1746065071.058272:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b11e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a48f expref: 260 pid: 7204 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.058498:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3220 00000100:00100000:0.0:1746065071.058505:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+260:2005:x1830881260931584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065071.058515:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065071.058519:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b11e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a48f expref: 260 pid: 7204 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746065071.058533:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b11e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a48f expref: 260 pid: 7204 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746065071.058551:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b11e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2c2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a48f expref: 260 pid: 7204 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746065071.058577:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c2:0x0].0x0 (ffff8800929a3b00) 00010000:00010000:0.0:1746065071.058581:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc145b12c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2c2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.058588:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc145b12c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2c2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.058594:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc145b12c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2c2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.058607:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065071.058648:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+259:2005:x1830881260931584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 143us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.058653:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3220 00000100:00100000:0.0:1746065071.061679:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260931840 00000100:00100000:0.0:1746065071.061686:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260931840 00000100:00100000:0.0:1746065071.063996:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262482944 00000100:00100000:0.0:1746065071.064000:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262482944 00000100:00100000:0.0:1746065071.064019:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262482816 00000100:00100000:0.0:1746065071.064021:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262482816 00000100:00100000:0.0:1746065071.064029:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262482432 00000100:00100000:0.0:1746065071.064031:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262482432 00000100:00100000:0.0:1746065071.064040:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262483072 00000100:00100000:0.0:1746065071.064042:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262483072 00000100:00100000:0.0:1746065071.064053:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7513 00000100:00100000:0.0:1746065071.064057:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+139:3760:x1830881262482944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.064156:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+141:3760:x1830881262482944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 98us (213us total) trans 17179872084 rc 0/0 00000100:00100000:0.0:1746065071.064162:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7513 00000100:00100000:0.0:1746065071.064171:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7515 00000100:00100000:0.0:1746065071.064175:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+140:3761:x1830881262482432:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065071.064183:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:734 count 1 00010000:00010000:0.0:1746065071.064191:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064202:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 61 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065071.064208:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.064210:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.064212:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064225:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 61 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065071.064232:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 61 pid: 10219 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746065071.064240:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262483200:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.064262:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.064274:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7516 00000100:00100000:0.0:1746065071.064279:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+141:3761:x1830881262483072:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065071.064321:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065071.064324:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.064326:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.064328:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.064330:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065071.064349:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+141:3761:x1830881262483072:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (313us total) trans 17179872086 rc 0/0 00000100:00100000:0.0:1746065071.064354:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7516 00010000:00010000:0.0:1746065071.064367:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.064372:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc145b15d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064379:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.064382:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc145b15d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064388:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc145b15d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064399:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc145b15d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064405:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc145b15d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.064416:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.064418:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.064419:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065071.067644:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262483200:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.067661:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065071.067728:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098583480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262483328:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.067740:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067752:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.067757:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc145b179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067763:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.067767:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc145b179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067789:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc145b179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067800:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc145b179 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067806:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc145b179 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067823:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.067824:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.067826:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065071.067876:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.067891:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260932096 00000100:00100000:0.0:1746065071.067894:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260932096 00010000:00010000:0.0:1746065071.067909:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 62 pid: 10219 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746065071.067924:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3221 00000100:00100000:0.0:1746065071.067928:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+62:2004:x1830881260932096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065071.067935:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065071.067938:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 62 pid: 10219 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746065071.067946:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 62 pid: 10219 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746065071.067957:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145ad3c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a338 expref: 63 pid: 10219 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746065071.067966:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.067967:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.067969:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067979:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.067990:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065071.068010:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+62:2004:x1830881260932096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.068016:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3221 00010000:00010000:0.0:1746065071.068033:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068039:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068045:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068050:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068057:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.068165:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+141:3761:x1830881262482432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3988us (4149us total) trans 17179872087 rc 0/0 00000100:00100000:0.0:1746065071.068171:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7515 00010000:00010000:0.0:1746065071.068185:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.068189:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068199:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.068202:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068207:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068216:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068220:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145b164 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068229:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.068231:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.068232:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.068237:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068242:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068248:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068254:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068266:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.068334:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+141:3761:x1830881262482688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4023us (4271us total) trans 17179872088 rc 0/0 00000100:00100000:0.0:1746065071.068339:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7517 00010000:00010000:0.0:1746065071.068354:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.068358:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068363:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.068366:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068371:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068380:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068385:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06800/0xad6b7ddc145b16b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.068395:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.068396:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.068397:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.069540:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.069545:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800996be400/0xad6b7ddc145b156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.069556:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.069558:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996be400/0xad6b7ddc145b156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.069565:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996be400/0xad6b7ddc145b156 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.069575:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800996be400/0xad6b7ddc145b156 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.069581:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be400/0xad6b7ddc145b156 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.069591:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.069593:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.069595:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065071.070821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065071.073367:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.073372:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc145b172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.073379:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d03c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.073381:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc145b172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.073387:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc145b172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.073397:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc145b172 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.073402:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc145b172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.073412:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.073413:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.073414:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.076252:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131053000/0xad6b7ddc145af81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a3fc expref: 44 pid: 3068 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.076262:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262484352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.076273:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097b61600/0xad6b7ddc145b187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.076280:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097b61600/0xad6b7ddc145b187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.076286:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61600/0xad6b7ddc145b187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.076293:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b61600/0xad6b7ddc145b187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.076304:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61600/0xad6b7ddc145b187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.076323:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.076412:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+95:3760:x1830881262483712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7696us (7792us total) trans 21474839356 rc 0/0 00000100:00100000:0.0:1746065071.076418:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7522 00000100:00100000:0.0:1746065071.077136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.079273:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.088677:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.093815:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260934272 00000100:00100000:0.0:1746065071.093823:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260934272 00000100:00100000:0.0:1746065071.095892:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3730 00000100:00100000:0.0:1746065071.095901:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+242:27624:x1830881260934272:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065071.096804:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x2c2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065071.096865:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2057, 64 off171616 00000040:00080000:0.0:1746065071.096894:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2051, 64 off171056 00000040:00080000:0.0:1746065071.096903:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2052, 64 off171120 00000040:00080000:0.0:1746065071.096910:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2058, 64 off171680 00010000:00010000:0.0:1746065071.096979:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145b1d4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:0.0:1746065071.096987:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145b1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065071.096993:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145b1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065071.096999:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145b1d4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065071.097003:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145b1d4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065071.097017:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145b1d4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065071.097039:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.097165:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+244:27624:x1830881260934272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1265us (3492us total) trans 4294974387 rc 0/0 00000100:00100000:0.0:1746065071.097171:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3730 00000100:00100000:0.0:1746065071.100661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.106742:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.109356:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.111388:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.114907:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.119343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.128195:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.132698:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.134223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.134762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.146970:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.150497:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.155015:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260937984 00000100:00100000:0.0:1746065071.155018:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260937984 00000100:00100000:0.0:1746065071.155040:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 506 00000100:00100000:0.0:1746065071.155044:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+258:2007:x1830881260937984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065071.155051:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065071.155060:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc145b2bb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2c4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a506 expref: 258 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.155109:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c4:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065071.155112:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065071.155129:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+257:2007:x1830881260937984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.155134:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 506 00000100:00100000:0.0:1746065071.157134:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.157745:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.164169:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.167444:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.171881:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939136 00000100:00100000:0.0:1746065071.171890:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939136 00010000:00010000:0.0:1746065071.172096:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.172105:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.172111:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.172116:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b61600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.172119:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.172125:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.172136:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554f300) 00010000:00010000:0.0:1746065071.172138:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.172142:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.172146:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b1c6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173025:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173031:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173035:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173039:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.173041:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173046:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173054:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554f300) 00010000:00010000:0.0:1746065071.173055:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.173057:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173062:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc145b24b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.173080:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065071.173084:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065071.173092:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065071.173096:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.173097:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065071.173101:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065071.173107:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c4:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065071.173108:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.173110:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065071.173113:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145b2ec lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065071.175494:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7534 00000100:00100000:0.0:1746065071.175500:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+144:3760:x1830881262485376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065071.175511:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:737 count 1 00010000:00010000:0.0:1746065071.175519:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.175529:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6800/0xad6b7ddc145b180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4a4 expref: 61 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.175533:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.175534:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.175536:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.175550:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6800/0xad6b7ddc145b180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4a4 expref: 61 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.175557:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6800/0xad6b7ddc145b180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4a4 expref: 61 pid: 9548 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.175564:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262486144:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.175585:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.175595:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7535 00000100:00100000:0.0:1746065071.175599:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+144:3760:x1830881262485760:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065071.175660:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065071.175662:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.175664:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.175665:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.175667:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065071.175689:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+145:3760:x1830881262485760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 89us (803us total) trans 17179872092 rc 0/0 00000100:00100000:0.0:1746065071.175693:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7535 00000004:00080000:0.0:1746065071.175711:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dce00/2, rc 0, transno 17179872092 00000100:00100000:0.0:1746065071.175714:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262485760:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.177608:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.177692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065071.177919:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc145b308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.177930:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc145b308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.177936:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc145b308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.177943:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc145b308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.179577:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.179822:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+99:3760:x1830881262484736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7218us (7311us total) trans 21474839359 rc 0/0 00000100:00100000:0.0:1746065071.179829:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7528 00000004:00080000:0.0:1746065071.179864:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed08700/2, rc 0, transno 21474839359 00000100:00100000:0.0:1746065071.179868:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262484736:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.180277:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262486144:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.180287:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065071.180305:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262485888:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.180313:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8a00/0xad6b7ddc145b32b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065071.180559:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.180583:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.180604:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.180625:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.180645:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260939904 00000100:00100000:0.0:1746065071.180648:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260939904 00000100:00100000:0.0:1746065071.180664:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7536 00000100:00100000:0.0:1746065071.180669:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+44:26180:x1830881260939904:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065071.180679:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.180688:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f66200/0xad6b7ddc145b34e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a530 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065071.180703:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065071.180713:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.180714:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.180720:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66200/0xad6b7ddc145b34e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a530 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180730:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f66200/0xad6b7ddc145b34e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a530 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180737:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66200, rc 0) 00000100:00100000:0.0:1746065071.180756:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881260939904:12345-192.168.202.27@tcp:101:bash.0 Request processed in 87us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.180761:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7536 00000100:00100000:0.0:1746065071.180792:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3230 00000100:00100000:0.0:1746065071.180797:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+62:2007:x1830881260939776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065071.180802:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065071.180807:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6800/0xad6b7ddc145b180 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4a4 expref: 61 pid: 9548 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746065071.180814:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6800/0xad6b7ddc145b180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4a4 expref: 61 pid: 9548 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746065071.180825:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6800/0xad6b7ddc145b180 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4a4 expref: 61 pid: 9548 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746065071.180832:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.180833:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.180836:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180842:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180852:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065071.180863:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+60:2007:x1830881260939776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.180868:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3230 00010000:00010000:0.0:1746065071.180880:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180887:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180894:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180906:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc145b339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.180916:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.181018:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+145:3760:x1830881262485376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5518us (6293us total) trans 17179872093 rc 0/0 00000100:00100000:0.0:1746065071.181023:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7534 00000004:00080000:0.0:1746065071.181042:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dca80/2, rc 0, transno 17179872093 00000100:00100000:0.0:1746065071.181045:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262485376:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065071.181056:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8a00/0xad6b7ddc145b32b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.181061:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8a00/0xad6b7ddc145b32b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.181067:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8a00/0xad6b7ddc145b32b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.181072:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8a00/0xad6b7ddc145b32b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.181081:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065071.181151:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+99:3762:x1830881262484864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6872us (7475us total) trans 21474839360 rc 0/0 00000100:00100000:0.0:1746065071.181156:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7531 00010000:00010000:0.0:1746065071.181235:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065071.181255:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.181265:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260940032 00000100:00100000:0.0:1746065071.181268:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260940032 00000100:00100000:0.0:1746065071.181281:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7537 00000100:00100000:0.0:1746065071.181285:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881260940032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.181291:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.181296:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131053000/0xad6b7ddc145b355 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a537 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065071.181321:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262486272:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065071.181350:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.182648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.185549:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.185588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.186096:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.189679:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.192719:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.201673:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.201735:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.208130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.212447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.216673:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260941952 00000100:00100000:0.0:1746065071.216682:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260941952 00000100:00100000:0.0:1746065071.217301:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10878 00000100:00100000:0.0:1746065071.217311:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+243:27628:x1830881260941952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.217331:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.217347:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b3a9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a553 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.217403:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145b3b0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065071.217413:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145b3b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.217422:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145b3b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065071.217460:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2c4:0x0]: returning size 5 00000004:00200000:0.0:1746065071.217464:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065071.217476:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145b3b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.217496:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145b3a9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a553 expref: 245 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.217511:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145b3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c4:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a553 expref: 244 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.217695:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c4:0x0].0x0 (ffff880095561b00) 00010000:00010000:0.0:1746065071.217698:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065071.217700:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:0.0:1746065071.217992:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+244:27628:x1830881260941952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 682us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.217998:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10878 00000100:00100000:0.0:1746065071.220124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.222363:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.224622:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.228321:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.232457:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.257056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.259088:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.265819:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.265902:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.268668:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065071.270908:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974406 is committed 00000004:00080000:0.0:1746065071.270915:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1387 committed 00000004:00080000:0.0:1746065071.270929:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1397 committed 00000004:00080000:0.0:1746065071.270941:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1396 committed 00000004:00080000:0.0:1746065071.270943:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1386 committed 00000100:00100000:0.0:1746065071.271113:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262486656:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.271154:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065071.271888:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3100/2, rc 0, transno 21474839363 00000100:00100000:0.0:1746065071.271892:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262486656:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.271919:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7543 00000100:00100000:0.0:1746065071.271925:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+146:3759:x1830881262487040:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065071.271975:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065071.271977:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.271979:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.271980:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.271982:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065071.272005:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+148:3759:x1830881262487040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 80us (139us total) trans 17179872097 rc 0/0 00000100:00100000:0.0:1746065071.272010:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7543 00000100:00100000:0.0:1746065071.272604:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.273599:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.276383:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.278261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.278311:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.279435:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.280881:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.282619:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.284166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.290420:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.299301:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.301140:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.302599:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.307544:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.314853:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.320183:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.320259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065071.324641:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974416 is committed 00000004:00080000:0.0:1746065071.324653:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1401 committed 00000004:00080000:0.0:1746065071.324666:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1391 committed 00000004:00080000:0.0:1746065071.324931:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1389 committed 00000004:00080000:0.0:1746065071.324933:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1398 committed 00000004:00080000:0.0:1746065071.324938:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1390 committed 00000004:00080000:0.0:1746065071.324939:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1400 committed 00000004:00080000:0.0:1746065071.324940:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1399 committed 00000004:00080000:0.0:1746065071.324942:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1388 committed 00000100:00100000:0.0:1746065071.325546:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262487424:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.325597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.325627:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065071.325643:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262487808:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.325663:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.325685:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262487424 00000100:00100000:0.0:1746065071.325689:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262487424 00000100:00100000:0.0:1746065071.325714:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262487808 00000100:00100000:0.0:1746065071.325716:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262487808 00000100:00100000:0.0:1746065071.325729:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7548 00000100:00100000:0.0:1746065071.325734:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+147:3760:x1830881262487424:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.325867:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+148:3760:x1830881262487424:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (270us total) trans 17179872098 rc 0/0 00000100:00100000:0.0:1746065071.325873:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7548 00000100:00100000:0.0:1746065071.325886:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7549 00000100:00100000:0.0:1746065071.325890:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+101:3760:x1830881262487808:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065071.325948:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065071.325950:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.325952:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.325954:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.325955:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x2e3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065071.325974:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+102:3760:x1830881262487808:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (310us total) trans 21474839366 rc 0/0 00000100:00100000:0.0:1746065071.325978:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7549 00000004:00080000:0.0:1746065071.326008:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098671500/2, rc 0, transno 21474839366 00000100:00100000:0.0:1746065071.326012:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262487808:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065071.326019:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098662d80/2, rc 0, transno 17179872098 00000100:00100000:0.0:1746065071.326022:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262487424:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.327561:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065071.327572:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262488320:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.327604:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262488192 00000100:00100000:0.0:1746065071.327608:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262488192 00000100:00100000:0.0:1746065071.327625:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7554 00000100:00100000:0.0:1746065071.327642:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+149:3762:x1830881262488192:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065071.327695:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065071.327697:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.327699:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.327700:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.327702:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2e4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065071.327725:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+150:3762:x1830881262488192:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (129us total) trans 17179872100 rc 0/0 00000100:00100000:0.0:1746065071.327731:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7554 00000100:00100000:0.0:1746065071.327745:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065071.327901:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098663b80/2, rc 0, transno 17179872101 00000100:00100000:0.0:1746065071.327905:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262488320:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.332016:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.332842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.338473:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.340658:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.341961:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.351933:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.358160:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.371015:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.379573:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.402165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.408669:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.410654:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.412190:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.420126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.423840:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.425798:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10905 00000100:00100000:0.0:1746065071.425806:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+249:27636:x1830881260950400:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.425814:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.425821:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61200/0xad6b7ddc145b5c4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2c8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a609 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.425856:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.425863:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425872:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065071.425882:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2c8:0x0]: returning size 0 00010000:00010000:0.0:1746065071.425938:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425944:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425949:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425954:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.425957:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425963:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425972:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c8:0x0].0x0 (ffff8800929d0300) 00010000:00010000:0.0:1746065071.425975:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065071.425978:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.425983:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d200/0xad6b7ddc145b5cb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.426020:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61200/0xad6b7ddc145b5c4 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2c8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a609 expref: 251 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.426027:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61200/0xad6b7ddc145b5c4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2c8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a609 expref: 251 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.426034:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61200, rc 0) 00000100:00100000:0.0:1746065071.426057:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+250:27636:x1830881260950400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 252us (1047us total) trans 4294974423 rc 301/301 00000100:00100000:0.0:1746065071.426062:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10905 00000100:00100000:0.0:1746065071.429590:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.439479:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260950784 00000100:00100000:0.0:1746065071.439487:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260950784 00000100:00100000:0.0:1746065071.439532:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3744 00000100:00100000:0.0:1746065071.439538:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+248:27633:x1830881260950784:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065071.439761:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+249:27633:x1830881260950784:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 222us (408us total) trans 4294974425 rc 0/0 00000100:00100000:0.0:1746065071.439767:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3744 00000100:00100000:0.0:1746065071.443997:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.444045:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.450491:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.450563:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.453240:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.453274:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.453646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.461995:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.462033:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.484819:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260952704 00000100:00100000:0.0:1746065071.484826:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260952704 00000100:00100000:0.0:1746065071.484877:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10911 00000100:00100000:0.0:1746065071.484884:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:26180:x1830881260952704:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065071.484902:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.484917:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145b650 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2c8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a633 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.484965:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145b650 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2c8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a633 expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.484977:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145b650 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2c8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a633 expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.484990:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c8:0x0].0x0 (ffff880097b72800) 00010000:00010000:0.0:1746065071.484993:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065071.484996:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baec00, rc 0) 00000100:00100000:0.0:1746065071.485033:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+259:26180:x1830881260952704:12345-192.168.202.27@tcp:101:bash.0 Request processed in 150us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.485039:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10911 00000100:00100000:0.0:1746065071.488608:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.492654:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260953472 00000100:00100000:0.0:1746065071.492660:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260953472 00000100:00100000:0.0:1746065071.492910:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10913 00000100:00100000:0.0:1746065071.492917:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+261:27636:x1830881260953472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.492935:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.492951:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145b665 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a641 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.493009:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065071.493018:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493027:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493034:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065071.493040:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493045:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493111:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065071.493117:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493122:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065071.493130:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2c8:0x0]: returning size 2 00010000:00010000:0.0:1746065071.493179:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493184:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493189:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493194:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.493197:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493202:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493211:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2c8:0x0].0x0 (ffff880097b72800) 00010000:00010000:0.0:1746065071.493214:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065071.493217:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493221:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc145b67a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2c8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493245:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493250:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493253:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493261:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493265:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.493267:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493271:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493277:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c500) 00010000:00010000:0.0:1746065071.493279:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.493280:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493284:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145b66c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493291:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493295:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493299:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493303:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.493305:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493309:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493330:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929fdb00) 00010000:00010000:0.0:1746065071.493332:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.493335:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493338:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b673 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065071.493383:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145b665 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a641 expref: 263 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.493390:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc145b665 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a641 expref: 263 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.493400:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:0.0:1746065071.493469:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+262:27636:x1830881260953472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 552us (1179us total) trans 4294974434 rc 301/301 00000100:00100000:0.0:1746065071.493475:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10913 00000100:00100000:0.0:1746065071.495783:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262489216:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.495804:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.495816:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065071.495820:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262489088:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.495837:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.495852:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262489216 00000100:00100000:0.0:1746065071.495855:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262489216 00000100:00100000:0.0:1746065071.495868:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262489088 00000100:00100000:0.0:1746065071.495869:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262489088 00000100:00100000:0.0:1746065071.495880:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7560 00000100:00100000:0.0:1746065071.495884:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262489216:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065071.495893:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:740 count 1 00010000:00010000:0.0:1746065071.495901:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b68f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.495909:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b298 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4f8 expref: 63 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065071.495914:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.495915:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.495917:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b68f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.495928:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b298 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4f8 expref: 63 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065071.495934:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9e00/0xad6b7ddc145b298 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a4f8 expref: 63 pid: 12260 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746065071.495940:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a7a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262489344:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.495958:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.495971:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7561 00000100:00100000:0.0:1746065071.495975:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+105:3760:x1830881262489088:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065071.495982:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:740 count 1 00010000:00010000:0.0:1746065071.495992:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b696 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.496003:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc145b4e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a5ca expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.496008:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.496009:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.496011:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b696 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.496021:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc145b4e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a5ca expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.496027:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc145b4e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a5ca expref: 50 pid: 10219 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.496034:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a7a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262489472:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.496046:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.496567:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7565 00000100:00100000:0.0:1746065071.496571:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+110:3759:x1830881262489856:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.497505:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+110:3759:x1830881262489856:12345-0@lo:2:osp-syn-0-1.0 Request processed in 934us (1295us total) trans 21474839372 rc 0/0 00000100:00100000:0.0:1746065071.497509:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7565 00000100:00100000:0.0:1746065071.506374:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.506421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.509067:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a7a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262489472:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.509085:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b696 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065071.516043:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+111:3760:x1830881262489088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20062us (20199us total) trans 21474839374 rc 0/0 00000100:00100000:0.0:1746065071.516053:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7561 00010000:00010000:0.0:1746065071.521470:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095778600/0xad6b7ddc145b611 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a617 expref: 50 pid: 10219 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746065071.521483:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262490880:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.521502:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc145b6c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a648 expref: 49 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.521511:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbe00, rc 0) 00000100:00100000:0.0:1746065071.521530:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+49:26180:x1830881260953984:12345-192.168.202.27@tcp:101:bash.0 Request processed in 14540us (15109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.521536:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7571 00000100:00100000:0.0:1746065071.530251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.537960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.550096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.566520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.572993:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.578668:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.584909:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.588029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.591240:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.599107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.600561:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260957440 00000100:00100000:0.0:1746065071.600565:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260957440 00000100:00100000:0.0:1746065071.600597:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10922 00000100:00100000:0.0:1746065071.600603:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+246:27641:x1830881260957440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.600612:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.600620:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145b784 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a687 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.600671:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.600679:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600685:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600693:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.600698:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600702:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600727:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600732:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600737:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600745:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600750:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.600754:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600759:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600767:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:0.0:1746065071.600769:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.600794:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600800:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145b78b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600817:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600822:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600826:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600830:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.600832:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600836:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600845:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72d00) 00010000:00010000:0.0:1746065071.600847:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.600849:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600854:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b792 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.600870:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145b784 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a687 expref: 247 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.600876:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145b784 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a687 expref: 247 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.600882:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ba00, rc 0) 00000100:00100000:0.0:1746065071.600910:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+246:27641:x1830881260957440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 307us (599us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065071.600915:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10922 00000100:00100000:0.0:1746065071.605061:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.610217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.613085:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.615874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.620152:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.627874:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.627922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.631619:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.633917:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.634956:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.637579:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.640256:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.644096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.644768:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065071.649343:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974450 is committed 00000004:00080000:0.0:1746065071.649350:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1405 committed 00000004:00080000:0.0:1746065071.649733:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1395 committed 00000004:00080000:0.0:1746065071.649977:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1394 committed 00000004:00080000:0.0:1746065071.649979:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1404 committed 00000100:00100000:0.0:1746065071.663830:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262491392 00000100:00100000:0.0:1746065071.663840:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262491392 00000100:00100000:0.0:1746065071.663884:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7574 00000100:00100000:0.0:1746065071.663891:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+157:3760:x1830881262491392:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065071.663915:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:743 count 1 00010000:00010000:0.0:1746065071.663936:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145b864 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.663952:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b6c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a64f expref: 63 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.663959:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.663961:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.663963:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145b864 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.663991:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b6c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a64f expref: 63 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.664002:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145b6c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a64f expref: 63 pid: 11461 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.664013:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c53f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262491776:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.665290:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.665340:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.665357:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260960896 00000100:00100000:0.0:1746065071.665361:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260960896 00000100:00100000:0.0:1746065071.665383:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3755 00000100:00100000:0.0:1746065071.665388:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+241:27641:x1830881260960896:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065071.665495:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+242:27641:x1830881260960896:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 107us (156us total) trans 4294974451 rc 0/0 00000100:00100000:0.0:1746065071.665501:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3755 00000004:00080000:0.0:1746065071.666407:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9880/2, rc 0, transno 17179872111 00000100:00100000:0.0:1746065071.666412:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262491904:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.666418:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065071.666423:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262492032:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.666442:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065071.667542:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957db100/2, rc 0, transno 17179872112 00000100:00100000:0.0:1746065071.667547:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262492032:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.668108:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.668134:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.669903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.669922:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961280 00000100:00100000:0.0:1746065071.669926:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961280 00000100:00100000:0.0:1746065071.669946:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3756 00000100:00100000:0.0:1746065071.669952:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+242:27641:x1830881260961280:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065071.670031:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+242:27641:x1830881260961280:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.670036:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3756 00010000:00010000:0.0:1746065071.671267:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065071.671298:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da300/2, rc 0, transno 17179872113 00000100:00100000:0.0:1746065071.671304:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262491392:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065071.671355:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145b83a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6bf expref: 242 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.671364:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ca:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065071.671367:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065071.671377:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abada00/0xad6b7ddc145b833 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6bf expref: 242 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065071.671391:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145b83a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6bf expref: 241 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.671410:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ca:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065071.671412:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065071.671414:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:0.0:1746065071.671453:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+241:26180:x1830881260960000:12345-192.168.202.27@tcp:101:bash.0 Request processed in 33623us (33879us total) trans 4294974450 rc 0/0 00000100:00100000:0.0:1746065071.671460:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10930 00000100:00100000:0.0:1746065071.675811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.675839:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260961536 00000100:00100000:0.0:1746065071.675844:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260961536 00000100:00100000:0.0:1746065071.675877:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10932 00000100:00100000:0.0:1746065071.675884:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+241:27642:x1830881260961536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.675899:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.675913:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b879 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a6cd expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.675973:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.675982:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.675990:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.675997:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.676002:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676008:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676075:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b88e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065071.676080:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b88e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676085:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b88e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065071.676092:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2ca:0x0]: returning size 2 00010000:00010000:0.0:1746065071.676141:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676147:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676151:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676156:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676160:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.676163:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676167:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676175:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c500) 00010000:00010000:0.0:1746065071.676177:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.676180:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676183:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc145b880 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676192:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676197:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676201:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676204:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.676206:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676210:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676214:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cd00) 00010000:00010000:0.0:1746065071.676216:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.676217:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676221:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc145b887 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065071.676244:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b879 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6cd expref: 244 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.676254:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145b88e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6cd expref: 243 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.676258:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ca:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065071.676260:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065071.676261:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5aa00, rc 0) 00000100:00100000:0.0:1746065071.676294:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+243:27642:x1830881260961536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 411us (524us total) trans 4294974452 rc 0/0 00000100:00100000:0.0:1746065071.676299:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10932 00000100:00100000:0.0:1746065071.676830:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.683995:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.684701:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a7a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262492544:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.684726:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.685724:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262492800:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.685743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.685761:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262492800 00000100:00100000:0.0:1746065071.685764:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262492800 00000100:00100000:0.0:1746065071.685791:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7582 00000100:00100000:0.0:1746065071.685795:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+114:3759:x1830881262492800:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.685850:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+115:3759:x1830881262492800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 54us (106us total) trans 21474839381 rc 0/0 00000100:00100000:0.0:1746065071.685855:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7582 00000004:00080000:0.0:1746065071.685871:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d15500/2, rc 0, transno 21474839381 00000100:00100000:0.0:1746065071.685875:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262492800:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.690871:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.691059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.695402:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.698524:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.698542:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260962688 00000100:00100000:0.0:1746065071.698546:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260962688 00000100:00100000:0.0:1746065071.699073:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3758 00000100:00100000:0.0:1746065071.699080:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+244:26180:x1830881260962688:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065071.699870:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+245:26180:x1830881260962688:12345-192.168.202.27@tcp:35:bash.0 Request processed in 789us (1348us total) trans 4294974454 rc 0/0 00000100:00100000:0.0:1746065071.699877:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3758 00000100:00100000:0.0:1746065071.699969:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.702961:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.709228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.709285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.709681:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10935 00000100:00100000:0.0:1746065071.709689:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+247:27642:x1830881260963328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.710292:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.710299:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145b8e2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a6f0 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.710343:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065071.710355:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.710365:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000100:00100000:0.0:1746065071.716737:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065071.720029:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.720035:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065071.720053:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2ca:0x0]: returning size 5 00000004:00200000:0.0:1746065071.720055:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065071.720062:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.720081:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145b8e2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6f0 expref: 249 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.720104:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5be00/0xad6b7ddc145b8e9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6f0 expref: 248 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.720114:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ca:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065071.720116:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065071.720118:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5be00, rc 0) 00000100:00100000:0.0:1746065071.721205:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+247:27642:x1830881260963328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11515us (11918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.721216:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10935 00000100:00100000:0.0:1746065071.726360:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.726397:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.726433:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.730844:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.736279:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.744307:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.745608:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.757875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.757914:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.765976:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065071.765982:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262493824:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.766003:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.766021:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262493824 00000100:00100000:0.0:1746065071.766023:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262493824 00000100:00100000:0.0:1746065071.766042:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7587 00000100:00100000:0.0:1746065071.766045:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+161:3760:x1830881262493824:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.766107:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+162:3760:x1830881262493824:12345-0@lo:2:osp-syn-1-1.0 Request processed in 61us (104us total) trans 17179872116 rc 0/0 00000100:00100000:0.0:1746065071.766112:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7587 00000004:00080000:0.0:1746065071.766128:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d0380/2, rc 0, transno 17179872116 00000100:00100000:0.0:1746065071.766131:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262493824:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.769928:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.773842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.774862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.778730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.778771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.783078:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.783492:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.791118:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.794668:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.794710:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.798952:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.800503:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.805234:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.807416:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.808388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065071.811620:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974467 is committed 00000004:00080000:0.0:1746065071.811636:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1399 committed 00000004:00080000:0.0:1746065071.811647:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1409 committed 00000004:00080000:0.0:1746065071.811652:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1408 committed 00000004:00080000:0.0:1746065071.811653:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1398 committed 00000100:00100000:0.0:1746065071.812452:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262494592 00000100:00100000:0.0:1746065071.812458:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262494592 00000100:00100000:0.0:1746065071.812482:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262494848 00000100:00100000:0.0:1746065071.812483:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262494848 00000100:00100000:0.0:1746065071.812492:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262494464 00000100:00100000:0.0:1746065071.812493:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262494464 00000100:00100000:0.0:1746065071.812507:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262494720 00000100:00100000:0.0:1746065071.812510:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262494720 00000100:00100000:0.0:1746065071.812520:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7594 00000100:00100000:0.0:1746065071.812525:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+164:3761:x1830881262494592:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.812640:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+165:3761:x1830881262494592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (530us total) trans 17179872119 rc 0/0 00000100:00100000:0.0:1746065071.812646:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7594 00000100:00100000:0.0:1746065071.814636:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7596 00000100:00100000:0.0:1746065071.814715:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+164:3759:x1830881262494464:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.814788:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+165:3759:x1830881262494464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 76us (2465us total) trans 17179872120 rc 0/0 00000100:00100000:0.0:1746065071.814793:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7596 00000100:00100000:0.0:1746065071.816343:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.819304:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065071.824705:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974468 is committed 00000004:00080000:0.0:1746065071.824714:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1411 committed 00000004:00080000:0.0:1746065071.825610:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1401 committed 00000004:00080000:0.0:1746065071.825638:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1400 committed 00000004:00080000:0.0:1746065071.825641:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1410 committed 00000100:00100000:0.0:1746065071.827376:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260969472 00000100:00100000:0.0:1746065071.827380:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260969472 00000100:00100000:0.0:1746065071.827407:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7603 00000100:00100000:0.0:1746065071.827412:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+67:26180:x1830881260969472:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065071.827420:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.827432:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145ba39 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a76e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065071.827443:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065071.827456:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.827458:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.827463:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145ba39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a76e expref: 68 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.827473:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145ba39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a76e expref: 68 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.827480:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ba00, rc 0) 00000100:00100000:0.0:1746065071.827501:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+68:26180:x1830881260969472:12345-192.168.202.27@tcp:101:bash.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065071.827506:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7603 00000100:00100000:0.0:1746065071.829469:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.829509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.829548:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.829931:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1146 00000100:00100000:0.0:1746065071.829937:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+68:2004:x1830881260969856:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065071.829998:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065071.830000:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb mtime from disk: 0 -> 1746065072 00002000:00010000:0.0:1746065071.830002:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065071.830003:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb ctime from disk: 0 -> 1746065072 00002000:00010000:0.0:1746065071.830005:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2eb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065071.830431:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+69:2004:x1830881260969856:12345-192.168.202.27@tcp:10:bash.0 Request processed in 494us (882us total) trans 17179872123 rc 0/0 00000100:00100000:0.0:1746065071.830436:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1146 00002000:00010000:0.0:1746065071.830439:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/747 (0->18446744073709551615) 00002000:00100000:0.0:1746065071.830440:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881260969856 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065071.830444:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0e00. 00000100:00100000:0.0:1746065071.841058:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.843928:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065071.844600:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.844605:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145ba47 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065071.844610:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.844613:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145ba47 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065071.844618:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145ba47 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065071.844636:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ca:0x0].0x0 (ffff88012f893100) 00010000:00010000:0.0:1746065071.844638:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065071.844641:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145ba47 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065071.844645:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145ba47 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065071.844665:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.844666:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.844667:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065071.855301:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.864693:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.867837:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.878248:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260971264 00000100:00100000:0.0:1746065071.878256:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260971264 00000100:00100000:0.0:1746065071.878290:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10959 00000100:00100000:0.0:1746065071.878296:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+243:27647:x1830881260971264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065071.878312:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.878327:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc145bab0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a791 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.878374:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065071.878383:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878391:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878399:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065071.878403:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878407:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878434:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878438:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878442:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878446:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878451:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.878454:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878459:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878466:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c100) 00010000:00010000:0.0:1746065071.878469:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.878471:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878475:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145bab7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878486:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878491:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878495:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878498:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.878500:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878505:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878509:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4838b00) 00010000:00010000:0.0:1746065071.878511:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065071.878513:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878521:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145babe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.878541:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc145bab0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a791 expref: 244 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.878548:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc145bab0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a791 expref: 244 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.878556:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:0.0:1746065071.878604:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+243:27647:x1830881260971264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 308us (622us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065071.878609:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10959 00000100:00100000:0.0:1746065071.882960:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.901129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.906598:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.914766:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.918845:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.921560:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065071.922965:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.922972:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065071.922991:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2cd:0x0]: returning size 0 00000004:00080000:0.0:1746065071.923129:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ed:0x0], index 1: 0 00000004:00080000:0.0:1746065071.923134:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ec:0x0], index 0: 0 00000004:00080000:0.0:1746065071.923138:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ed:0x0], index 0: 0 00000004:00080000:0.0:1746065071.923142:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ee:0x0], index 1: 0 00010000:00010000:0.0:1746065071.923223:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923229:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923234:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923239:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065071.923242:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923247:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923598:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2cd:0x0].0x0 (ffff88012ef2a800) 00010000:00010000:0.0:1746065071.923601:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065071.923604:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923608:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145bb3c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065071.923657:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145bb35 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2cd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a7bb expref: 248 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.923664:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145bb35 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2cd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a7bb expref: 248 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.923676:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9600, rc 0) 00000100:00100000:0.0:1746065071.923715:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+247:27647:x1830881260972416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8434us (8956us total) trans 4294974474 rc 301/301 00000100:00100000:0.0:1746065071.923721:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10965 00000100:00100000:0.0:1746065071.925029:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260973056 00000100:00100000:0.0:1746065071.925035:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260973056 00000100:00100000:0.0:1746065071.925069:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3764 00000100:00100000:0.0:1746065071.925075:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+247:27647:x1830881260973056:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065071.925228:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f2ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+248:27647:x1830881260973056:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 152us (274us total) trans 4294974475 rc 0/0 00000100:00100000:0.0:1746065071.925233:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3764 00000100:00100000:0.0:1746065071.926919:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.926964:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.942504:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.944347:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.950358:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.955490:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.957603:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.959610:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.963276:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262495616:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.963298:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145bbd6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000100:00100000:0.0:1746065071.964840:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065071.970021:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974483 is committed 00000004:00080000:0.0:1746065071.970027:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1413 committed 00000004:00080000:0.0:1746065071.970033:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1403 committed 00000004:00080000:0.0:1746065071.970038:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1402 committed 00000004:00080000:0.0:1746065071.970041:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1412 committed 00000100:00100000:0.0:1746065071.970450:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262495872:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.972521:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065071.972544:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262495872 00000100:00100000:0.0:1746065071.972547:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262495872 00000100:00100000:0.0:1746065071.972562:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262495744 00000100:00100000:0.0:1746065071.972564:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262495744 00000100:00100000:0.0:1746065071.972573:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262496256 00000100:00100000:0.0:1746065071.972575:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262496256 00000100:00100000:0.0:1746065071.972585:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7609 00000100:00100000:0.0:1746065071.972589:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+126:3760:x1830881262495744:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065071.972595:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:744 count 1 00010000:00010000:0.0:1746065071.972603:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972612:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7000/0xad6b7ddc145b8aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6db expref: 51 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972617:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.972618:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.972620:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972644:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7000/0xad6b7ddc145b8aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6db expref: 51 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972650:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7000/0xad6b7ddc145b8aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a6db expref: 51 pid: 11461 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.972657:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262496640:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.972676:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065071.972688:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7610 00000100:00100000:0.0:1746065071.972693:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+127:3760:x1830881262496256:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.972744:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+128:3760:x1830881262496256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 52us (184us total) trans 21474839393 rc 0/0 00000100:00100000:0.0:1746065071.972749:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7610 00010000:00010000:0.0:1746065071.972761:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065071.972765:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc145bc00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972770:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.972786:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc145bc00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972792:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc145bc00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972802:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc145bc00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972808:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc145bc00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972820:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065071.972823:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc145bc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972832:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6dc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065071.972834:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc145bc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972839:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc145bc0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972846:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc145bc0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972852:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc145bc0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.972860:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.972861:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065071.972863:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065071.972872:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262496896 00000100:00100000:0.0:1746065071.972874:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262496896 00000100:00100000:0.0:1746065071.972886:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262497408 00000100:00100000:0.0:1746065071.972888:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262497408 00000100:00100000:0.0:1746065071.972897:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262497024 00000100:00100000:0.0:1746065071.972898:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262497024 00000100:00100000:0.0:1746065071.972908:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7612 00000100:00100000:0.0:1746065071.972911:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+169:3759:x1830881262497408:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065071.972968:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+170:3759:x1830881262497408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 56us (101us total) trans 17179872124 rc 0/0 00000100:00100000:0.0:1746065071.972973:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7612 00000100:00100000:0.0:1746065071.972982:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7613 00000100:00100000:0.0:1746065071.972986:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+169:3759:x1830881262497024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065071.972994:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:747 count 1 00010000:00010000:0.0:1746065071.973002:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc145bc23 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.973011:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145ba39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a76e expref: 69 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.973016:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.973017:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065071.973019:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc145bc23 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.973033:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145ba39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a76e expref: 69 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.973040:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145ba39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a76e expref: 69 pid: 10219 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746065071.973049:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262497536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.973070:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000004:00080000:0.0:1746065071.974505:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12300/2, rc 0, transno 21474839392 00000100:00100000:0.0:1746065071.974510:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262495872:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.977513:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262496640:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065071.977526:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065071.977943:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065071.978596:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.978602:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.978608:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.978614:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61200/0xad6b7ddc145bc15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.978623:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065071.978737:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+127:3760:x1830881262495744:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6147us (6202us total) trans 21474839394 rc 0/0 00000100:00100000:0.0:1746065071.978743:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7609 00000100:00100000:0.0:1746065071.978754:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260976512 00000100:00100000:0.0:1746065071.978757:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260976512 00000100:00100000:0.0:1746065071.978770:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7617 00000100:00100000:0.0:1746065071.978794:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+68:26180:x1830881260976512:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065071.978803:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065071.978812:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc145bc38 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a801 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.978827:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc145bb6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a7d0 expref: 69 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065071.978832:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.978834:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065071.978836:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc145bc38 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a801 expref: 69 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065071.978853:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc145bb6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a7d0 expref: 69 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065071.978861:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc145bb6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a7d0 expref: 69 pid: 9550 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746065071.978870:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262497792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065071.978907:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000004:00080000:0.0:1746065071.978938:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10380/2, rc 0, transno 21474839394 00000100:00100000:0.0:1746065071.978943:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262495744:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065071.980739:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.981080:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.983088:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.985743:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.985813:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.989944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065071.993849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.004674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.015233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.026944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.030262:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.047147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.057551:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065072.062237:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc145bd26 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a847 expref: 251 pid: 9571 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746065072.062253:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262498048:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065072.062267:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062273:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062277:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065072.062295:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2cf:0x0]: returning size 0 00000004:00080000:0.0:1746065072.062465:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ee:0x0], index 0: 0 00000004:00080000:0.0:1746065072.062472:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2ef:0x0], index 1: 0 00000004:00080000:0.0:1746065072.062475:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2f0:0x0], index 1: 0 00000004:00080000:0.0:1746065072.062478:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x2ef:0x0], index 0: 0 00010000:00010000:0.0:1746065072.062550:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062556:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062561:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062565:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.062568:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062574:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062742:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2cf:0x0].0x0 (ffff88008c512500) 00010000:00010000:0.0:1746065072.062745:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065072.062748:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062752:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856600/0xad6b7ddc145bd3b lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065072.062955:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145bd34 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a84e expref: 251 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.062962:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145bd34 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a84e expref: 251 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.062974:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857800, rc 0) 00000100:00100000:0.0:1746065072.080478:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.083693:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260981632 00000100:00100000:0.0:1746065072.083702:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260981632 00000100:00100000:0.0:1746065072.083762:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10989 00000100:00100000:0.0:1746065072.083770:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+255:26180:x1830881260981632:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065072.083807:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.083825:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc145bd96 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a871 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.083854:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc145bd9d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065072.083866:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc145bd9d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.083875:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc145bd9d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.083960:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc145bd96 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a871 expref: 257 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.083977:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc145bd9d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2cf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a871 expref: 256 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.083983:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2cf:0x0].0x0 (ffff880098c34100) 00010000:00010000:0.0:1746065072.083985:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065072.083988:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5000, rc 0) 00000100:00100000:0.0:1746065072.084023:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+256:26180:x1830881260981632:12345-192.168.202.27@tcp:101:bash.0 Request processed in 255us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.084029:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10989 00000100:00100000:0.0:1746065072.086593:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.086633:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 10990 00000100:00100000:0.0:1746065072.086640:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a7a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+257:27654:x1830881260982144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.086659:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.086671:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc145bda4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a878 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.086727:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa50800/0xad6b7ddc145bdab lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.086735:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa50800/0xad6b7ddc145bdab lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.086742:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa50800/0xad6b7ddc145bdab lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065072.086751:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2cf:0x0]: returning size 0 00010000:00010000:0.0:1746065072.086826:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc145bda4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a878 expref: 260 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.086837:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa50800/0xad6b7ddc145bdab lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2cf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a878 expref: 259 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.086842:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2cf:0x0].0x0 (ffff880098c34100) 00010000:00010000:0.0:1746065072.086844:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065072.086845:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa50800, rc 0) 00000100:00100000:0.0:1746065072.086877:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a7a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27654:x1830881260982144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 237us (731us total) trans 4294974498 rc 0/0 00000100:00100000:0.0:1746065072.086882:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 10990 00000100:00100000:0.0:1746065072.087897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.088565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.090943:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.091102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.093987:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065072.094953:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145bddc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.094958:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145bddc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2cf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000040:00080000:0.0:1746065072.095315:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2086, 88 off173816 00000004:00080000:0.0:1746065072.095322:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 668113548360ns, next at 669018385391ns, rc = 0 00000040:00080000:0.0:1746065072.095419:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2091, 88 off174296 00000004:00080000:0.0:1746065072.095424:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 668113650551ns, next at 669018366449ns, rc = 0 00000040:00080000:0.0:1746065072.095544:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2092, 88 off174384 00000004:00080000:0.0:1746065072.095548:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 668113774368ns, next at 669018366449ns, rc = 0 00000040:00080000:0.0:1746065072.095557:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2087, 88 off173904 00000004:00080000:0.0:1746065072.095559:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 668113785931ns, next at 669018385391ns, rc = 0 00010000:00010000:0.0:1746065072.097334:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097343:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097349:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097389:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.097392:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097398:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097410:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:0.0:1746065072.097413:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.097415:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097420:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc145bc70 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.097436:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097444:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097449:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097452:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800907d4400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.097454:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097459:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097465:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:0.0:1746065072.097467:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.097468:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097472:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc145bd1f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.097969:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.097974:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.097978:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.097981:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.097983:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.097988:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.097994:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2cf:0x0].0x0 (ffff880098c34100) 00010000:00010000:0.0:1746065072.097996:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.097997:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.098001:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31200/0xad6b7ddc145bdb9 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065072.098020:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a7a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262498304:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.098068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.098755:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262498816:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.098784:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.098797:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065072.098801:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262498688:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.098815:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.098836:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262498304 00000100:00100000:0.0:1746065072.098840:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262498304 00000100:00100000:0.0:1746065072.098877:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262498816 00000100:00100000:0.0:1746065072.098879:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262498816 00000100:00100000:0.0:1746065072.098889:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262498688 00000100:00100000:0.0:1746065072.098890:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262498688 00000100:00100000:0.0:1746065072.098902:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7620 00000100:00100000:0.0:1746065072.098907:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+128:3760:x1830881262498304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065072.098926:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:748 count 1 00010000:00010000:0.0:1746065072.099733:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.099749:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc145bc3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a808 expref: 52 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.099754:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065072.099755:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065072.099757:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.099798:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc145bc3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a808 expref: 52 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.099806:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc145bc3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a808 expref: 52 pid: 11461 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746065072.099815:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262499200:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065072.099844:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065072.102076:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.103660:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262499200:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065072.103671:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065072.103687:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260984320 00000100:00100000:0.0:1746065072.103690:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260984320 00000100:00100000:0.0:1746065072.103714:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3777 00000100:00100000:0.0:1746065072.103720:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+242:27654:x1830881260984320:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065072.103824:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+242:27654:x1830881260984320:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 104us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.103830:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3777 00010000:00010000:0.0:1746065072.103889:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.103896:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.103903:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.103911:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc145be06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.103923:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065072.104104:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+131:3760:x1830881262498304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5196us (6036us total) trans 21474839400 rc 0/0 00000100:00100000:0.0:1746065072.104110:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7620 00000004:00080000:0.0:1746065072.104140:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e7800/2, rc 0, transno 17179872134 00000100:00100000:0.0:1746065072.104145:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262498432:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.106526:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.109638:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.111347:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.111702:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.113788:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.114429:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.114442:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260985344 00000100:00100000:0.0:1746065072.114445:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260985344 00000100:00100000:0.0:1746065072.114472:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3778 00000100:00100000:0.0:1746065072.114478:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+243:26180:x1830881260985344:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065072.114664:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+245:26180:x1830881260985344:12345-192.168.202.27@tcp:35:bash.0 Request processed in 185us (235us total) trans 4294974504 rc 0/0 00000100:00100000:0.0:1746065072.114669:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3778 00000100:00100000:0.0:1746065072.118219:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.121882:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.125473:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.137871:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.141211:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.143861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.149046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.153553:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.157462:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.160544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.165035:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.168963:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.176544:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.183399:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260988800 00000100:00100000:0.0:1746065072.183402:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260988800 00000100:00100000:0.0:1746065072.183423:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11008 00000100:00100000:0.0:1746065072.183427:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+252:26180:x1830881260988800:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065072.183438:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.183448:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3dc00/0xad6b7ddc145bf64 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a904 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.183471:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc145bf6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065072.183480:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc145bf6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.183488:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc145bf6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.185291:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3dc00/0xad6b7ddc145bf64 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a904 expref: 254 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.185318:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc145bf6b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a904 expref: 253 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.185325:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff8800b4999600) 00010000:00010000:0.0:1746065072.185327:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065072.185329:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c800, rc 0) 00000100:00100000:0.0:1746065072.185374:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+253:26180:x1830881260988800:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1945us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.185381:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11008 00000100:00100000:0.0:1746065072.193914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.197222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.198935:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.201889:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.201963:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.204025:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.207122:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065072.210092:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210099:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210104:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210108:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.210111:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210116:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210124:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3200) 00010000:00010000:0.0:1746065072.210126:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.210128:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210132:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc145be5a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210146:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210151:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210156:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210159:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.210162:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210166:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210172:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3200) 00010000:00010000:0.0:1746065072.210174:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.210175:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210179:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc145bf09 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210190:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210194:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210203:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210206:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.210209:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210213:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210218:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff8800b4999600) 00010000:00010000:0.0:1746065072.210220:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.210221:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.210228:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145bf8e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00000100:00100000:0.0:1746065072.210244:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262500992:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.210267:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.210297:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7639 00000100:00100000:0.0:1746065072.210303:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+180:3761:x1830881262500992:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065072.210313:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:752 count 1 00002000:00010000:0.0:1746065072.210327:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065072.210331:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210337:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065072.210338:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065072.210340:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210348:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210353:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210357:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210367:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065072.210473:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+182:3761:x1830881262500992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 170us (204us total) trans 17179872138 rc 0/0 00000100:00100000:0.0:1746065072.210478:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7639 00010000:00010000:0.0:1746065072.210490:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065072.210494:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210499:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065072.210501:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210505:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210513:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210518:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc145bfe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.210528:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065072.210529:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065072.210530:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065072.210542:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37d180/2, rc 0, transno 17179872138 00000100:00100000:0.0:1746065072.210545:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262500992:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.211536:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.213436:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.213481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.215831:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.219190:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.223822:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.225389:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.225463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.232743:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.234640:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.237218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065072.237696:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.237701:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:0.0:1746065072.237905:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x2d1:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1746065072.237962:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.237968:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.237973:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.237977:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.237979:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.237985:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.237992:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff8800b4999600) 00010000:00010000:0.0:1746065072.237994:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065072.237997:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.238000:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c036 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239208:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239215:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239220:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239226:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239229:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.239232:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239237:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239245:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:0.0:1746065072.239247:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.239250:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239254:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c028 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065072.239266:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098580000 reply state ffff88012ec8a000 transno 4294974524 ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c02f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239277:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c02f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.239282:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2aa00) 00010000:00010000:0.0:1746065072.239283:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065072.239286:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065072.239344:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+246:27661:x1830881260992768:12345-192.168.202.27@tcp:36:rm.0 Request processed in 4462us (4704us total) trans 4294974524 rc 0/0 00000100:00100000:0.0:1746065072.239351:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11016 00000100:00100000:0.0:1746065072.241760:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.244165:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.247585:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.248949:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.249708:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.252021:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.255476:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+75:2005:x1830881260993792:12345-192.168.202.27@tcp:4:bash.0 Request processed in 3097us (3448us total) trans 17179872142 rc 0/0 00000100:00100000:0.0:1746065072.255485:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 191 00002000:00100000:0.0:1746065072.255495:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x2f1:0x0] (0->4) req@ffff880098581500 x1830881260993792/t17179872142(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:743/0 lens 496/448 e 0 to 0 dl 1746065083 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065072.255503:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098581500 with x1830881260993792 ext(0->4) 00010000:00010000:0.0:1746065072.255740:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f46800/0xad6b7ddc145bfe9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a927 expref: 75 pid: 3068 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746065072.255754:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f46800/0xad6b7ddc145bfe9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a927 expref: 75 pid: 3068 timeout: 768 lvb_type: 0 00002000:00010000:0.0:1746065072.255764:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098581500 00000100:00100000:0.0:1746065072.257988:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.259256:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.263885:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11023 00000100:00100000:0.0:1746065072.263893:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+251:27660:x1830881260994432:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065072.263931:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065072.263952:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc145c04b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a943 expref: 251 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.263986:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:0.0:1746065072.263990:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065072.264014:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.264024:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.264030:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:0.0:1746065072.264190:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2097, 88 off174776 00000004:00080000:0.0:1746065072.264195:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 668282420847ns, next at 669018366449ns, rc = 0 00000040:00080000:0.0:1746065072.264244:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2092, 88 off174296 00000004:00080000:0.0:1746065072.264248:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 668282474338ns, next at 669018385391ns, rc = 0 00000040:00080000:0.0:1746065072.264267:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2093, 88 off174384 00000004:00080000:0.0:1746065072.264270:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 668282496699ns, next at 669018385391ns, rc = 0 00000040:00080000:0.0:1746065072.264278:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2098, 88 off174864 00000004:00080000:0.0:1746065072.264282:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 668282508049ns, next at 669018366449ns, rc = 0 00000001:00080000:0.0:1746065072.267498:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974527 is committed 00000004:00080000:0.0:1746065072.267511:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1420 committed 00000004:00080000:0.0:1746065072.267526:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1410 committed 00000004:00080000:0.0:1746065072.267531:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1409 committed 00000004:00080000:0.0:1746065072.267534:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1419 committed 00000100:00100000:0.0:1746065072.268517:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262501760:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.268554:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.268570:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065072.268574:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262502144:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.268588:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065072.268607:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.268614:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.268618:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.268654:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.268657:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.268662:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.268670:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:0.0:1746065072.268672:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065072.268674:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.268682:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145c0bb lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00080000:0.0:1746065072.269342:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc9f80/2, rc 0, transno 17179872144 00000100:00100000:0.0:1746065072.269347:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262502144:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065072.269354:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957db480/2, rc 0, transno 21474839408 00000100:00100000:0.0:1746065072.269357:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262501760:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.271111:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.274291:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.274369:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.275005:0:10212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262502400:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1746065072.275032:0:10212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.275061:0:10212:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065072.277183:0:10212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262502400:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1746065072.277193:0:10212:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x2f3:0x0]-[0x280000400:0x321:0x0] 00000100:00100000:0.0:1746065072.277541:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.277577:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.282171:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.282205:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.286512:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.288963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.290009:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.293081:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.294703:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260997120 00000100:00100000:0.0:1746065072.294708:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260997120 00000100:00100000:0.0:1746065072.294770:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11031 00000100:00100000:0.0:1746065072.294796:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+250:27660:x1830881260997120:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065072.294816:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065072.294829:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c101 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2d1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a982 expref: 250 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.294840:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:0.0:1746065072.294842:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065072.294857:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.294863:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.294868:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065072.294905:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c528a80 reply state ffff88009a588000 transno 4294974534 ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.294912:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.294917:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:0.0:1746065072.294918:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065072.294920:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065072.294955:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+251:27660:x1830881260997120:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 159us (313us total) trans 4294974534 rc 0/0 00000100:00100000:0.0:1746065072.294960:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11031 00000100:00100000:0.0:1746065072.297387:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.297863:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.301659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.301738:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065072.309143:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974535 is committed 00000004:00080000:0.0:1746065072.309148:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1412 committed 00000004:00080000:0.0:1746065072.309151:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1422 committed 00000004:00080000:0.0:1746065072.309152:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1421 committed 00000004:00080000:0.0:1746065072.309153:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1411 committed 00010000:00010000:0.0:1746065072.309177:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309183:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309188:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309194:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.309197:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309203:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309212:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d2:0x0].0x0 (ffff880097e34400) 00010000:00010000:0.0:1746065072.309214:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.309217:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309221:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145c147 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.309236:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.309244:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.309248:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.309251:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.309252:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.309256:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.309261:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d1:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:0.0:1746065072.309262:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.309264:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.309268:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2e00/0xad6b7ddc145c14e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065072.309372:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262502656:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.309415:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.309453:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262502784:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.309469:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.310616:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262502656 00000100:00100000:0.0:1746065072.310630:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262502656 00000100:00100000:0.0:1746065072.310654:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262502784 00000100:00100000:0.0:1746065072.310656:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262502784 00000100:00100000:0.0:1746065072.310666:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7653 00000100:00100000:0.0:1746065072.310671:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+185:3760:x1830881262502656:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.310804:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+186:3760:x1830881262502656:12345-0@lo:2:osp-syn-1-1.0 Request processed in 132us (1388us total) trans 17179872146 rc 0/0 00000100:00100000:0.0:1746065072.310809:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7653 00000100:00100000:0.0:1746065072.310820:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7654 00000100:00100000:0.0:1746065072.310824:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+185:3761:x1830881262502784:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.310876:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+186:3761:x1830881262502784:12345-0@lo:2:osp-syn-1-1.0 Request processed in 51us (1406us total) trans 17179872147 rc 0/0 00000100:00100000:0.0:1746065072.310881:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7654 00000004:00080000:0.0:1746065072.310907:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098348000/2, rc 0, transno 17179872147 00000100:00100000:0.0:1746065072.310914:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262502784:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.320178:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262503552 00000100:00100000:0.0:1746065072.320182:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262503552 00000100:00100000:0.0:1746065072.320204:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7661 00000100:00100000:0.0:1746065072.320209:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+187:3759:x1830881262503552:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065072.320275:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065072.320277:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065072.320279:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065072.320280:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065072.320282:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2f2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065072.320318:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+188:3759:x1830881262503552:12345-0@lo:2:osp-syn-1-1.0 Request processed in 109us (224us total) trans 17179872149 rc 0/0 00000100:00100000:0.0:1746065072.320323:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7661 00000100:00100000:0.0:1746065072.320886:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.321390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.331650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.339857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.348171:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.348936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.356812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.361119:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261000064 00000100:00100000:0.0:1746065072.361127:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261000064 00000100:00100000:0.0:1746065072.361179:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11038 00000100:00100000:0.0:1746065072.361186:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+245:27663:x1830881261000064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.361204:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.361219:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c1d3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a9cf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.361275:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167a00/0xad6b7ddc145c1da lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.361285:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167a00/0xad6b7ddc145c1da lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d2:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.361293:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167a00/0xad6b7ddc145c1da lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d2:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065072.361327:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2d2:0x0]: returning size 5 00000004:00200000:0.0:1746065072.361330:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065072.361342:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880136167a00/0xad6b7ddc145c1da lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d2:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.361361:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c1d3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a9cf expref: 247 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.362346:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167a00/0xad6b7ddc145c1da lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d2:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a9cf expref: 246 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.362358:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d2:0x0].0x0 (ffff88009af4d700) 00010000:00010000:0.0:1746065072.362360:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065072.362363:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167a00, rc 0) 00000100:00100000:0.0:1746065072.364742:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+246:27663:x1830881261000064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3549us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.364751:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11038 00000100:00100000:0.0:1746065072.373539:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.375895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.381577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.389591:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.389652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.390362:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11042 00000100:00100000:0.0:1746065072.390369:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+249:27665:x1830881261000832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.390376:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.390383:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc145c227 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92a9eb expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.390403:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c22e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065072.390408:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c22e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.390414:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c22e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065072.390448:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1746065072.390452:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1746065072.390474:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc145c227 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a9eb expref: 251 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.390488:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c22e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a9eb expref: 250 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.390495:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880099d36000) 00010000:00010000:0.0:1746065072.390497:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1746065072.390500:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167c00, rc 0) 00000100:00100000:0.0:1746065072.390542:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+250:27665:x1830881261000832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 174us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.390547:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11042 00000100:00100000:0.0:1746065072.402899:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.407048:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.407800:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.411435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.412209:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.415207:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.418036:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.418572:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.426291:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.430336:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.430375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.430418:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.432141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.433086:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.437312:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.437696:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.441676:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.444317:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.450747:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261004928 00000100:00100000:0.0:1746065072.450754:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261004928 00000100:00100000:0.0:1746065072.450806:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11053 00000100:00100000:0.0:1746065072.450813:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091327450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:27667:x1830881261004928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.450827:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.450844:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc145c307 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aa38 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.450913:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.450968:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.450977:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.450986:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.450991:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.450995:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.451056:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.451062:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.451070:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065072.451077:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2d4:0x0]: returning size 2 00010000:00010000:0.0:1746065072.454285:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454297:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454303:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454307:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.454311:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454317:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454331:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d4:0x0].0x0 (ffff880099d36000) 00010000:00010000:0.0:1746065072.454333:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065072.454336:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454341:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c31c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454371:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454376:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454383:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454387:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454391:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.454393:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454398:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454403:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009af4dc00) 00010000:00010000:0.0:1746065072.454405:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.454407:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454411:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c30e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454418:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454422:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454426:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454430:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.454432:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454439:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454444:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:0.0:1746065072.454446:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.454448:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454451:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c315 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.454491:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc145c307 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa38 expref: 266 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.454497:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc145c307 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa38 expref: 266 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.454509:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166c00, rc 0) 00000100:00100000:0.0:1746065072.454565:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091327450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+265:27667:x1830881261004928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3752us (3954us total) trans 4294974554 rc 301/301 00000100:00100000:0.0:1746065072.454572:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11053 00000100:00100000:0.0:1746065072.460527:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005056 00000100:00100000:0.0:1746065072.460535:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005056 00000100:00100000:0.0:1746065072.460575:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11054 00000100:00100000:0.0:1746065072.460581:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+265:27667:x1830881261005056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.460596:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.460610:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c32a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aa3f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.460694:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c331 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.460763:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc145c300 lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x2d4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.460768:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c331 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.460796:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc145c300 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.460804:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c331 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:0.0:1746065072.461391:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974553 is committed 00000004:00080000:0.0:1746065072.461397:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1426 committed 00000004:00080000:0.0:1746065072.461413:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1416 committed 00000004:00080000:0.0:1746065072.462592:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1415 committed 00000004:00080000:0.0:1746065072.462596:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1425 committed 00000100:00100000:0.0:1746065072.470301:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262505728:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065072.470310:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d07a00/0xad6b7ddc145c346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.471116:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d07a00/0xad6b7ddc145c346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.471122:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07a00/0xad6b7ddc145c346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.471132:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d07a00/0xad6b7ddc145c346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.471137:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07a00/0xad6b7ddc145c346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.471153:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065072.471360:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+148:3762:x1830881262504320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7211us (7655us total) trans 21474839419 rc 0/0 00000100:00100000:0.0:1746065072.471365:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7667 00000100:00100000:0.0:1746065072.472210:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005440 00000100:00100000:0.0:1746065072.472214:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005440 00010000:00010000:0.0:1746065072.472229:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc145bf56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a8f6 expref: 55 pid: 1880 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746065072.474762:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261005568 00000100:00100000:0.0:1746065072.474768:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261005568 00010000:00010000:0.0:1746065072.474801:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc145c10f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a989 expref: 78 pid: 1880 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746065072.474822:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3281 00000100:00100000:0.0:1746065072.474828:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+78:2006:x1830881261005568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065072.474835:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065072.474839:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc145c10f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a989 expref: 78 pid: 1880 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746065072.474850:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc145c10f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a989 expref: 78 pid: 1880 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746065072.474862:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc145c10f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92a989 expref: 78 pid: 1880 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746065072.474869:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065072.474871:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065072.474873:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145c35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.474878:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9600/0xad6b7ddc145c35b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.474891:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065072.475510:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+77:2006:x1830881261005568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 681us (3260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.475517:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3281 00000004:00080000:0.0:1746065072.479153:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37fb80/2, rc 0, transno 17179872156 00000100:00100000:0.0:1746065072.479158:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262505088:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.480078:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.482403:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.482418:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261006464 00000100:00100000:0.0:1746065072.482421:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261006464 00010000:00010000:0.0:1746065072.482436:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145c290 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa15 expref: 76 pid: 3067 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746065072.482455:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3284 00000100:00100000:0.0:1746065072.482459:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+76:2005:x1830881261006464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065072.482467:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065072.482470:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145c290 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa15 expref: 76 pid: 3067 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746065072.482478:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145c290 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa15 expref: 76 pid: 3067 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746065072.482490:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145c290 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa15 expref: 76 pid: 3067 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746065072.482497:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065072.482499:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065072.482503:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0e0600/0xad6b7ddc145c370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa46 expref: 75 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.482509:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0e0600/0xad6b7ddc145c370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa46 expref: 75 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.482529:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0e0600/0xad6b7ddc145c370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa46 expref: 75 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065072.482538:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881262506496:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065072.482579:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065072.486595:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.486834:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.491280:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.491315:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.500166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.513018:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.517208:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.521571:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.524581:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.528535:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.528570:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.541998:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008512 00000100:00100000:0.0:1746065072.542007:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008512 00000100:00100000:0.0:1746065072.542061:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11062 00000100:00100000:0.0:1746065072.542069:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+247:27670:x1830881261008512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.542085:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.542088:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065072.542111:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc145c403 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa77 expref: 247 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.542136:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34400) 00010000:00010000:0.0:1746065072.542144:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065072.542154:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145c41f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aa85 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.542228:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.542236:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542243:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542250:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c42d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.542255:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c42d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542259:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c42d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542750:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.542757:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542763:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065072.542771:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2d6:0x0]: returning size 0 00010000:00010000:0.0:1746065072.542822:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542827:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542831:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542836:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542840:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.542844:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542849:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542856:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009af4d900) 00010000:00010000:0.0:1746065072.542858:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.542860:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542865:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc145c426 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065072.542872:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098358a80 reply state ffff880091a8c000 transno 4294974558 ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c42d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542879:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc145c42d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.542883:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800aa04cf00) 00010000:00010000:0.0:1746065072.542885:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065072.542887:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065072.542907:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145c41f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa85 expref: 249 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.542920:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa85 expref: 248 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.542925:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff88009af4d500) 00010000:00010000:0.0:1746065072.542927:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065072.542928:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ba00, rc 0) 00000100:00100000:0.0:1746065072.542991:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+249:27670:x1830881261008512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 922us (1073us total) trans 4294974558 rc 0/0 00000100:00100000:0.0:1746065072.542997:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11062 00000100:00100000:0.0:1746065072.551051:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261008768 00000100:00100000:0.0:1746065072.551063:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261008768 00000100:00100000:0.0:1746065072.551111:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11063 00000100:00100000:0.0:1746065072.551117:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+249:27670:x1830881261008768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.551138:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.551155:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167000/0xad6b7ddc145c442 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aa8c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.551236:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c449 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.551252:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa85 expref: 250 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.551258:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc145c449 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.551286:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa85 expref: 250 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.551297:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145c434 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aa85 expref: 250 pid: 7205 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746065072.551307:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262506880:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065072.551394:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065072.556704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.568151:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.573013:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.573068:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.580836:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.586641:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.589705:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.590585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.591956:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.599922:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.604008:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.604349:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.609584:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.613356:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012224 00000100:00100000:0.0:1746065072.613368:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012224 00000100:00100000:0.0:1746065072.613422:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11072 00000100:00100000:0.0:1746065072.613430:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27671:x1830881261012224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.613451:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.613471:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72c00/0xad6b7ddc145c4ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aacb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.613548:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.613560:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613571:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613579:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.613589:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613595:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613686:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.613694:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613699:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065072.613706:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2d6:0x0]: returning size 2 00010000:00010000:0.0:1746065072.613811:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613818:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613824:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613829:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.613832:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613838:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613848:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff8800a9973700) 00010000:00010000:0.0:1746065072.613851:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065072.613855:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.613860:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538000/0xad6b7ddc145c4ff lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615057:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615065:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615070:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615074:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615078:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.615081:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615085:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615092:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999900) 00010000:00010000:0.0:1746065072.615094:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.615096:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615100:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145c4f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615108:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615113:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615117:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615121:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.615122:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615126:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615130:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800aa04cf00) 00010000:00010000:0.0:1746065072.615131:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.615133:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.615136:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72400/0xad6b7ddc145c4f8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.619250:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72c00/0xad6b7ddc145c4ea lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aacb expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.619264:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72c00/0xad6b7ddc145c4ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aacb expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.619282:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:0.0:1746065072.619346:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:27671:x1830881261012224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5915us (7652us total) trans 4294974570 rc 301/301 00000100:00100000:0.0:1746065072.619356:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11072 00000100:00100000:0.0:1746065072.621467:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262507520:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.621496:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.621799:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507520 00000100:00100000:0.0:1746065072.621803:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507520 00000100:00100000:0.0:1746065072.621834:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507904 00000100:00100000:0.0:1746065072.621835:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507904 00000100:00100000:0.0:1746065072.621848:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7682 00000100:00100000:0.0:1746065072.621853:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+150:3760:x1830881262507520:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.622340:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262507520:12345-0@lo:2:osp-syn-0-1.0 Request processed in 486us (844us total) trans 21474839423 rc 0/0 00000100:00100000:0.0:1746065072.622346:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7682 00000004:00080000:0.0:1746065072.622369:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a93b80/2, rc 0, transno 21474839423 00000100:00100000:0.0:1746065072.622373:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262507520:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.622377:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262508160:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.622392:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065072.625100:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.625121:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261012480 00000100:00100000:0.0:1746065072.625127:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261012480 00000100:00100000:0.0:1746065072.625176:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3804 00000100:00100000:0.0:1746065072.625182:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+244:27671:x1830881261012480:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065072.625433:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+245:27671:x1830881261012480:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 251us (335us total) trans 4294974571 rc 0/0 00000100:00100000:0.0:1746065072.625439:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3804 00000100:00100000:0.0:1746065072.625653:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.626099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.629233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:0.0:1746065072.631449:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a93100/2, rc 0, transno 21474839425 00000100:00100000:0.0:1746065072.631456:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262507136:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.633980:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.634023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.641327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.645527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.645578:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.655995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.660010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.668351:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.675439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.676204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.676221:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261014784 00000100:00100000:0.0:1746065072.676225:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261014784 00000100:00100000:0.0:1746065072.676528:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11075 00000100:00100000:0.0:1746065072.676536:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+251:27674:x1830881261014784:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065072.676560:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065072.676578:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc145c4e3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aac4 expref: 251 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.676695:0:7205:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145c54c lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aae0 expref: 250 pid: 7204 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746065072.676710:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07800/0xad6b7ddc145c4ab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2d6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aaaf expref: 250 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.676721:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff8800a9973700) 00010000:00010000:0.0:1746065072.676726:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145c561 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.676733:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145c561 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.676740:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145c561 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.676754:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065072.676768:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145c568 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.676793:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145c568 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.676799:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145c568 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.676810:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc145c56f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.676815:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc145c56f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.676820:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc145c56f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.676889:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539000/0xad6b7ddc145c576 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.676895:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145c561 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.676899:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539000/0xad6b7ddc145c576 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2d6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.676907:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145c561 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.676914:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539000/0xad6b7ddc145c576 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2d6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065072.696972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.709221:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015296 00000100:00100000:0.0:1746065072.709230:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015296 00000100:00100000:0.0:1746065072.709289:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11077 00000100:00100000:0.0:1746065072.709296:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+250:27673:x1830881261015296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.709310:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.709325:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2000/0xad6b7ddc145c592 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aaf5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.709406:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc145c599 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065072.709417:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc145c599 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065072.709425:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc145c599 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065072.709435:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2d6:0x0]: returning size 5 00010000:00010000:0.0:1746065072.709506:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2000/0xad6b7ddc145c592 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aaf5 expref: 253 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.709520:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc145c599 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aaf5 expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.709528:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff88009af4d500) 00010000:00010000:0.0:1746065072.709531:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065072.709533:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:0.0:1746065072.709578:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+252:27673:x1830881261015296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 284us (541us total) trans 4294974577 rc 0/0 00000100:00100000:0.0:1746065072.709584:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11077 00000100:00100000:0.0:1746065072.719553:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261015552 00000100:00100000:0.0:1746065072.719557:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261015552 00000100:00100000:0.0:1746065072.719583:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11078 00000100:00100000:0.0:1746065072.719588:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+252:27675:x1830881261015552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.719601:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.719617:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00a00/0xad6b7ddc145c5a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aafc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.719678:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.719689:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719698:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719707:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.719713:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719717:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719749:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719755:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719759:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719764:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719768:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae23c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.719792:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719798:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719806:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065072.719808:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.719811:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719816:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc145c5ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719825:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719830:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719833:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719837:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.719839:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719843:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719848:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4999900) 00010000:00010000:0.0:1746065072.719849:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.719851:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719855:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145c5b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.719877:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00a00/0xad6b7ddc145c5a7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aafc expref: 253 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.720263:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00a00/0xad6b7ddc145c5a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aafc expref: 253 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.720275:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00a00, rc 0) 00000100:00100000:0.0:1746065072.720298:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+252:27675:x1830881261015552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 709us (988us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065072.720303:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11078 00000100:00100000:0.0:1746065072.727407:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262508928:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065072.727428:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc145c5bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065072.736741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.740817:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.743516:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.749771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.755210:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261016448 00000100:00100000:0.0:1746065072.755219:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261016448 00000100:00100000:0.0:1746065072.755262:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261016576 00000100:00100000:0.0:1746065072.755264:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261016576 00000100:00100000:0.0:1746065072.755278:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11082 00000100:00100000:0.0:1746065072.755283:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+244:27675:x1830881261016448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.755300:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.755315:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc145c5ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ab11 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.755367:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.755379:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755389:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755398:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065072.755403:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755407:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755439:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755447:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755452:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755457:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755462:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.755465:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755470:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755480:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec72800) 00010000:00010000:0.0:1746065072.755482:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.755485:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755489:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c5f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755501:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755505:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755509:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755512:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065072.755514:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755518:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755523:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4a14700) 00010000:00010000:0.0:1746065072.755525:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065072.755527:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755531:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145c5fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065072.755556:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc145c5ed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab11 expref: 245 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.755562:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc145c5ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab11 expref: 245 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.755567:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bec00, rc 0) 00000100:00100000:0.0:1746065072.755607:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+244:27675:x1830881261016448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 324us (5841us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065072.755613:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11082 00000100:00100000:0.0:1746065072.755640:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11083 00000100:00100000:0.0:1746065072.755645:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+243:27673:x1830881261016576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.755653:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.755659:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145c602 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ab18 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.755688:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145c602 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab18 expref: 244 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.755697:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145c602 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab18 expref: 244 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.755709:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff88009af4d500) 00010000:00010000:0.0:1746065072.755711:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065072.755713:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf800, rc 0) 00000100:00100000:0.0:1746065072.755728:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+244:27673:x1830881261016576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 83us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.755732:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11083 00000100:00100000:0.0:1746065072.762083:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.766855:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.771431:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.774242:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.780927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.793953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.795987:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.802052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.802125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.809684:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.809729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.819059:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262509824:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065072.819084:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065072.820120:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881261019008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10102us (10440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.820132:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3293 00000100:00100000:0.0:1746065072.829063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.829107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.848276:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020160 00000100:00100000:0.0:1746065072.848280:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020160 00000100:00100000:0.0:1746065072.848304:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11092 00000100:00100000:0.0:1746065072.848309:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+257:26180:x1830881261020160:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065072.848321:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.848322:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065072.848332:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9a00/0xad6b7ddc145c69c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2d8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab50 expref: 257 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.848343:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d8:0x0].0x0 (ffff8800b48d2700) 00010000:00010000:0.0:1746065072.848346:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065072.848354:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145c6aa lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ab57 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.848387:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc145c6b1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065072.848395:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc145c6b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065072.848401:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc145c6b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2d8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000040:00080000:0.0:1746065072.848542:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2117, 88 off176392 00000004:00080000:0.0:1746065072.848545:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 668866771963ns, next at 669018366449ns, rc = 0 00000040:00080000:0.0:1746065072.848560:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2112, 88 off175912 00000004:00080000:0.0:1746065072.848563:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 668866789035ns, next at 669018385391ns, rc = 0 00000040:00080000:0.0:1746065072.848570:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2113, 88 off176000 00000004:00080000:0.0:1746065072.848572:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 668866798659ns, next at 669018385391ns, rc = 0 00000040:00080000:0.0:1746065072.848580:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2118, 88 off176480 00000004:00080000:0.0:1746065072.848582:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 668866808902ns, next at 669018366449ns, rc = 0 00000100:00100000:0.0:1746065072.857814:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262510976:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065072.859957:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065072.861785:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c529500/2, rc 0, transno 21474839434 00000100:00100000:0.0:1746065072.861790:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262510848:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065072.862551:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020416 00000100:00100000:0.0:1746065072.862555:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020416 00000100:00100000:0.0:1746065072.862636:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11093 00000100:00100000:0.0:1746065072.862642:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+243:27673:x1830881261020416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065072.862656:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065072.862672:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9de00/0xad6b7ddc145c6b8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ab5e expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.862712:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9de00/0xad6b7ddc145c6b8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab5e expref: 244 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.862722:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9de00/0xad6b7ddc145c6b8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ab5e expref: 244 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065072.862736:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff880095561b00) 00010000:00010000:0.0:1746065072.862739:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065072.862746:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9de00, rc 0) 00000100:00100000:0.0:1746065072.863652:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+244:27673:x1830881261020416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1008us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065072.863659:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11093 00000100:00100000:0.0:1746065072.868483:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261020800 00000100:00100000:0.0:1746065072.868487:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261020800 00000100:00100000:0.0:1746065072.868512:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3811 00000100:00100000:0.0:1746065072.868517:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+244:27673:x1830881261020800:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065072.868698:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x2d6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065072.868746:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2114, 64 off176064 00000040:00080000:0.0:1746065072.868764:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2119, 64 off176544 00000040:00080000:0.0:1746065072.868948:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2120, 64 off176608 00010000:00010000:0.0:1746065072.869468:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065072.869474:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145c6c6 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065072.869479:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6e400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065072.869482:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145c6c6 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065072.869487:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145c6c6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065072.869497:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2d6:0x0].0x0 (ffff880095561b00) 00010000:00010000:0.0:1746065072.869499:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065072.869502:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145c6c6 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065072.869507:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145c6c6 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065072.869518:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065072.869519:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065072.869522:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065072.870175:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.886143:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.900272:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.908431:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.909558:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.917717:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.944876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.949029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.953881:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.968647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.968838:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.982728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.992059:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065072.999453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.008287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.014471:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.020748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.025128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.026090:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.031455:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.031502:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.038488:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.038524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.042067:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.044737:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261026432 00000100:00100000:0.0:1746065073.044741:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261026432 00000100:00100000:0.0:1746065073.044767:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3817 00000100:00100000:0.0:1746065073.044782:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27680:x1830881261026432:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065073.044904:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27680:x1830881261026432:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 130us (850us total) trans 4294974604 rc 0/0 00000100:00100000:0.0:1746065073.044909:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3817 00000100:00100000:0.0:1746065073.055029:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262512256:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.055052:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.055065:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262512768:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.055077:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.055087:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065073.055090:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262512640:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.055102:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065073.056792:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065073.056797:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc145c863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.056802:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065073.056805:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc145c863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.056811:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc145c863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.056819:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc145c863 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.056824:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc145c863 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.056842:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.056843:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.056844:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065073.056862:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570d880/2, rc 0, transno 17179872171 00000100:00100000:0.0:1746065073.056866:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262512640:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065073.056872:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570d500/2, rc 0, transno 17179872170 00000100:00100000:0.0:1746065073.056874:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262512768:0@lo:2:osp-syn-1-1.0 00000001:00080000:0.0:1746065073.063570:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872171 is committed 00000001:00080000:0.0:1746065073.063578:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872169 is committed 00000100:00100000:0.0:1746065073.070383:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262513024:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065073.070395:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f44e00/0xad6b7ddc145c85c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065073.071211:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.073532:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.073564:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065073.076244:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f44e00/0xad6b7ddc145c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.076250:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44e00/0xad6b7ddc145c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.076255:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f44e00/0xad6b7ddc145c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.076265:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44e00/0xad6b7ddc145c85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.076575:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065073.076697:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3760:x1830881262512256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21308us (21643us total) trans 17179872174 rc 0/0 00000100:00100000:0.0:1746065073.076702:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7714 00000100:00100000:0.0:1746065073.076725:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179872171 gen 2 00000004:00080000:0.0:1746065073.076729:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09c000, transno 17179871922 00000004:00080000:0.0:1746065073.076733:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858ce00, transno 17179871924 00000004:00080000:0.0:1746065073.076735:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858ed80, transno 17179871925 00000004:00080000:0.0:1746065073.076737:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858df80, transno 17179871926 00000004:00080000:0.0:1746065073.076739:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a648700, transno 17179871927 00000004:00080000:0.0:1746065073.076741:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bc700, transno 17179871929 00000004:00080000:0.0:1746065073.076742:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bf800, transno 17179871930 00000004:00080000:0.0:1746065073.076744:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bea00, transno 17179871931 00000004:00080000:0.0:1746065073.076746:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bd180, transno 17179871932 00000004:00080000:0.0:1746065073.076748:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85f100, transno 17179871933 00000004:00080000:0.0:1746065073.076750:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bca80, transno 17179871934 00000004:00080000:0.0:1746065073.076751:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cf800, transno 17179871937 00000004:00080000:0.0:1746065073.076753:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e11180, transno 17179871938 00000004:00080000:0.0:1746065073.076755:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077d880, transno 17179871940 00000004:00080000:0.0:1746065073.076756:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077e680, transno 17179871941 00000004:00080000:0.0:1746065073.076758:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c53c380, transno 17179871942 00000004:00080000:0.0:1746065073.076760:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c53c700, transno 17179871943 00000004:00080000:0.0:1746065073.076761:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0000, transno 17179871945 00000004:00080000:0.0:1746065073.076763:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0700, transno 17179871946 00000004:00080000:0.0:1746065073.076765:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1f80, transno 17179871947 00000004:00080000:0.0:1746065073.076766:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2d80, transno 17179871948 00000004:00080000:0.0:1746065073.076768:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0700, transno 17179871949 00000004:00080000:0.0:1746065073.076770:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3480, transno 17179871950 00000004:00080000:0.0:1746065073.077226:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5180, transno 17179871951 00000004:00080000:0.0:1746065073.077228:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e11500, transno 17179871952 00000004:00080000:0.0:1746065073.077230:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665500, transno 17179871954 00000004:00080000:0.0:1746065073.077232:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077f800, transno 17179871955 00000004:00080000:0.0:1746065073.077234:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c380, transno 17179871956 00000004:00080000:0.0:1746065073.077236:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665f80, transno 17179871957 00000004:00080000:0.0:1746065073.077237:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665c00, transno 17179871958 00000004:00080000:0.0:1746065073.077239:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d16300, transno 17179871959 00000004:00080000:0.0:1746065073.077241:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a5c00, transno 17179871961 00000004:00080000:0.0:1746065073.077242:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a6d80, transno 17179871962 00000004:00080000:0.0:1746065073.077244:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12a00, transno 17179871963 00000004:00080000:0.0:1746065073.077245:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a5180, transno 17179871964 00000004:00080000:0.0:1746065073.077247:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e13100, transno 17179871965 00000004:00080000:0.0:1746065073.077249:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10e00, transno 17179871967 00000004:00080000:0.0:1746065073.077250:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45a680, transno 17179871968 00000004:00080000:0.0:1746065073.077252:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459f80, transno 17179871969 00000004:00080000:0.0:1746065073.077254:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458380, transno 17179871970 00000004:00080000:0.0:1746065073.077256:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c8e00, transno 17179871971 00000004:00080000:0.0:1746065073.077257:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef26d80, transno 17179871972 00000004:00080000:0.0:1746065073.077259:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458000, transno 17179871973 00000004:00080000:0.0:1746065073.077261:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd1500, transno 17179871975 00000004:00080000:0.0:1746065073.077263:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd3480, transno 17179871976 00000004:00080000:0.0:1746065073.077265:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd1c00, transno 17179871977 00000004:00080000:0.0:1746065073.077266:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd2d80, transno 17179871978 00000004:00080000:0.0:1746065073.077268:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6d80, transno 17179871981 00000004:00080000:0.0:1746065073.077270:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6680, transno 17179871982 00000004:00080000:0.0:1746065073.077272:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85d500, transno 17179871984 00000004:00080000:0.0:1746065073.077274:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ca80, transno 17179871985 00000004:00080000:0.0:1746065073.077276:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85f800, transno 17179871986 00000004:00080000:0.0:1746065073.077277:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85dc00, transno 17179871987 00000004:00080000:0.0:1746065073.077279:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ea00, transno 17179871988 00000004:00080000:0.0:1746065073.077281:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85c380, transno 17179871989 00000004:00080000:0.0:1746065073.077282:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137346a00, transno 17179871991 00000004:00080000:0.0:1746065073.077284:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137347100, transno 17179871992 00000004:00080000:0.0:1746065073.077286:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137344700, transno 17179871993 00000004:00080000:0.0:1746065073.077287:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345180, transno 17179871994 00000004:00080000:0.0:1746065073.077289:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd180, transno 17179871996 00000004:00080000:0.0:1746065073.077291:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df800, transno 17179871997 00000004:00080000:0.0:1746065073.077293:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de680, transno 17179871998 00000004:00080000:0.0:1746065073.077294:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f43480, transno 17179871999 00000004:00080000:0.0:1746065073.077296:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cea00, transno 17179872001 00000004:00080000:0.0:1746065073.077298:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3dc00, transno 17179872002 00000004:00080000:0.0:1746065073.077299:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cd180, transno 17179872003 00000004:00080000:0.0:1746065073.077301:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed2300, transno 17179872004 00000004:00080000:0.0:1746065073.077303:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077ca80, transno 17179872005 00000004:00080000:0.0:1746065073.077304:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077dc00, transno 17179872006 00000004:00080000:0.0:1746065073.077306:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2d80, transno 17179872009 00000004:00080000:0.0:1746065073.077308:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cf800, transno 17179872010 00000004:00080000:0.0:1746065073.077309:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cc380, transno 17179872011 00000004:00080000:0.0:1746065073.077311:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858dc00, transno 17179872012 00000004:00080000:0.0:1746065073.077313:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c700, transno 17179872014 00000004:00080000:0.0:1746065073.077314:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577fb80, transno 17179872015 00000004:00080000:0.0:1746065073.077316:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed6a00, transno 17179872017 00000004:00080000:0.0:1746065073.077317:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed7480, transno 17179872018 00000004:00080000:0.0:1746065073.077319:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfed80, transno 17179872019 00000004:00080000:0.0:1746065073.077321:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858f480, transno 17179872020 00000004:00080000:0.0:1746065073.077323:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfd880, transno 17179872021 00000004:00080000:0.0:1746065073.077325:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cff800, transno 17179872022 00000004:00080000:0.0:1746065073.077327:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfea00, transno 17179872023 00000004:00080000:0.0:1746065073.077328:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfca80, transno 17179872024 00000004:00080000:0.0:1746065073.077330:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8380, transno 17179872026 00000004:00080000:0.0:1746065073.077332:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8000, transno 17179872027 00000004:00080000:0.0:1746065073.077334:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb800, transno 17179872028 00000004:00080000:0.0:1746065073.077335:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098673800, transno 17179872029 00000004:00080000:0.0:1746065073.077337:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f100, transno 17179872031 00000004:00080000:0.0:1746065073.077339:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37df80, transno 17179872032 00000004:00080000:0.0:1746065073.077348:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbad80, transno 17179872034 00000004:00080000:0.0:1746065073.077350:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb9880, transno 17179872035 00000004:00080000:0.0:1746065073.077352:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f8380, transno 17179872037 00000004:00080000:0.0:1746065073.077353:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f8e00, transno 17179872038 00000004:00080000:0.0:1746065073.077355:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013189a300, transno 17179872039 00000004:00080000:0.0:1746065073.077357:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131898000, transno 17179872040 00000004:00080000:0.0:1746065073.077358:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bdc00, transno 17179872041 00000004:00080000:0.0:1746065073.077360:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bca80, transno 17179872042 00000004:00080000:0.0:1746065073.077362:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2be680, transno 17179872043 00000004:00080000:0.0:1746065073.077363:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bd180, transno 17179872044 00000004:00080000:0.0:1746065073.077365:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf0000, transno 17179872046 00000004:00080000:0.0:1746065073.077367:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2300, transno 17179872047 00000004:00080000:0.0:1746065073.077369:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cbb80, transno 17179872048 00000004:00080000:0.0:1746065073.077370:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c9180, transno 17179872049 00000004:00080000:0.0:1746065073.077372:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abba680, transno 17179872050 00000004:00080000:0.0:1746065073.077374:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbb800, transno 17179872051 00000004:00080000:0.0:1746065073.077375:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f42680, transno 17179872053 00000004:00080000:0.0:1746065073.077377:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f40380, transno 17179872054 00000004:00080000:0.0:1746065073.077379:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cc000, transno 17179872055 00000004:00080000:0.0:1746065073.077380:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cfb80, transno 17179872056 00000004:00080000:0.0:1746065073.077383:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f41c00, transno 17179872057 00000004:00080000:0.0:1746065073.077384:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f40e00, transno 17179872058 00000004:00080000:0.0:1746065073.077386:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c000, transno 17179872060 00000004:00080000:0.0:1746065073.077388:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570f100, transno 17179872061 00000004:00080000:0.0:1746065073.077390:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ed80, transno 17179872062 00000004:00080000:0.0:1746065073.077391:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ca80, transno 17179872063 00000004:00080000:0.0:1746065073.077393:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfc000, transno 17179872065 00000004:00080000:0.0:1746065073.077395:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfdf80, transno 17179872066 00000004:00080000:0.0:1746065073.077396:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cff480, transno 17179872067 00000004:00080000:0.0:1746065073.077398:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c525500, transno 17179872068 00000004:00080000:0.0:1746065073.077400:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223b80, transno 17179872070 00000004:00080000:0.0:1746065073.077402:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222300, transno 17179872071 00000004:00080000:0.0:1746065073.077403:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220e00, transno 17179872072 00000004:00080000:0.0:1746065073.077405:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223480, transno 17179872073 00000004:00080000:0.0:1746065073.077406:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a6a00, transno 17179872076 00000004:00080000:0.0:1746065073.077408:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6d80, transno 17179872077 00000004:00080000:0.0:1746065073.077410:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3480, transno 17179872079 00000004:00080000:0.0:1746065073.077411:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc2300, transno 17179872080 00000004:00080000:0.0:1746065073.077413:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1180, transno 17179872081 00000004:00080000:0.0:1746065073.077415:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd880, transno 17179872082 00000004:00080000:0.0:1746065073.077416:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cfb80, transno 17179872084 00000004:00080000:0.0:1746065073.077418:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955ce300, transno 17179872085 00000004:00080000:0.0:1746065073.077420:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077e300, transno 17179872086 00000004:00080000:0.0:1746065073.077421:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cc000, transno 17179872087 00000004:00080000:0.0:1746065073.077423:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cca80, transno 17179872088 00000004:00080000:0.0:1746065073.077424:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2680, transno 17179872089 00000004:00080000:0.0:1746065073.077426:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982ded80, transno 17179872091 00000004:00080000:0.0:1746065073.077428:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dce00, transno 17179872092 00000004:00080000:0.0:1746065073.077429:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dca80, transno 17179872093 00000004:00080000:0.0:1746065073.077431:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982df800, transno 17179872094 00000004:00080000:0.0:1746065073.077434:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661500, transno 17179872096 00000004:00080000:0.0:1746065073.077436:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098663800, transno 17179872097 00000004:00080000:0.0:1746065073.077438:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098662d80, transno 17179872098 00000004:00080000:0.0:1746065073.077439:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661f80, transno 17179872099 00000004:00080000:0.0:1746065073.077441:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098662a00, transno 17179872100 00000004:00080000:0.0:1746065073.077443:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098663b80, transno 17179872101 00000004:00080000:0.0:1746065073.077444:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3800, transno 17179872103 00000004:00080000:0.0:1746065073.077446:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3100, transno 17179872104 00000004:00080000:0.0:1746065073.077447:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cdc00, transno 17179872105 00000004:00080000:0.0:1746065073.077449:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a64bb80, transno 17179872106 00000004:00080000:0.0:1746065073.077450:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2a00, transno 17179872107 00000004:00080000:0.0:1746065073.077452:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a649c00, transno 17179872108 00000004:00080000:0.0:1746065073.077454:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da680, transno 17179872110 00000004:00080000:0.0:1746065073.077455:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9880, transno 17179872111 00000004:00080000:0.0:1746065073.077457:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957db100, transno 17179872112 00000004:00080000:0.0:1746065073.077459:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da300, transno 17179872113 00000004:00080000:0.0:1746065073.077460:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d0380, transno 17179872116 00000004:00080000:0.0:1746065073.077462:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d2d80, transno 17179872117 00000004:00080000:0.0:1746065073.077464:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cdc00, transno 17179872119 00000004:00080000:0.0:1746065073.077465:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957dbb80, transno 17179872120 00000004:00080000:0.0:1746065073.077467:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed7b80, transno 17179872121 00000004:00080000:0.0:1746065073.077468:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ccaa00, transno 17179872122 00000004:00080000:0.0:1746065073.077470:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc0000, transno 17179872124 00000004:00080000:0.0:1746065073.077472:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f480, transno 17179872125 00000004:00080000:0.0:1746065073.077473:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3b80, transno 17179872126 00000004:00080000:0.0:1746065073.077475:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ed80, transno 17179872127 00000004:00080000:0.0:1746065073.077476:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ca80, transno 17179872128 00000004:00080000:0.0:1746065073.077478:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f800, transno 17179872129 00000004:00080000:0.0:1746065073.077479:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ce00, transno 17179872131 00000004:00080000:0.0:1746065073.077481:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d180, transno 17179872132 00000004:00080000:0.0:1746065073.077483:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6680, transno 17179872133 00000004:00080000:0.0:1746065073.077485:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e7800, transno 17179872134 00000004:00080000:0.0:1746065073.077494:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2b8000, transno 17179872137 00000004:00080000:0.0:1746065073.077496:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37d180, transno 17179872138 00000004:00080000:0.0:1746065073.077498:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2ba300, transno 17179872139 00000004:00080000:0.0:1746065073.077500:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c526680, transno 17179872140 00000004:00080000:0.0:1746065073.077501:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c53f100, transno 17179872143 00000004:00080000:0.0:1746065073.077503:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc9f80, transno 17179872144 00000004:00080000:0.0:1746065073.077505:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cebb80, transno 17179872146 00000004:00080000:0.0:1746065073.077507:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098348000, transno 17179872147 00000004:00080000:0.0:1746065073.077508:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098348a80, transno 17179872148 00000004:00080000:0.0:1746065073.077510:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098348e00, transno 17179872149 00000004:00080000:0.0:1746065073.077511:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009576c380, transno 17179872151 00000004:00080000:0.0:1746065073.077513:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009576ed80, transno 17179872152 00000004:00080000:0.0:1746065073.077515:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cd500, transno 17179872153 00000004:00080000:0.0:1746065073.077517:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37c000, transno 17179872154 00000004:00080000:0.0:1746065073.077518:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009576dc00, transno 17179872155 00000004:00080000:0.0:1746065073.077520:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37fb80, transno 17179872156 00000004:00080000:0.0:1746065073.077522:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acef100, transno 17179872158 00000004:00080000:0.0:1746065073.077523:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acedf80, transno 17179872159 00000004:00080000:0.0:1746065073.077525:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bd500, transno 17179872160 00000004:00080000:0.0:1746065073.077527:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acedc00, transno 17179872161 00000004:00080000:0.0:1746065073.077528:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098582680, transno 17179872163 00000004:00080000:0.0:1746065073.077530:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098580000, transno 17179872164 00000004:00080000:0.0:1746065073.077531:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221c00, transno 17179872165 00000004:00080000:0.0:1746065073.077533:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221880, transno 17179872166 00000004:00080000:0.0:1746065073.077535:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8700, transno 17179872167 00000004:00080000:0.0:1746065073.077536:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098348380, transno 17179872168 00000004:00080000:0.0:1746065073.077538:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d500, transno 17179872170 00000004:00080000:0.0:1746065073.077540:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d880, transno 17179872171 00000100:00100000:0.0:1746065073.077545:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009570f800 x1830881262512384/t17179872172(17179872172) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1746065089 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 00000004:00080000:0.0:1746065073.077553:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a5880/2, rc 0, transno 17179872174 00000100:00100000:0.0:1746065073.077556:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262512256:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065073.082062:0:11455:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 199 done 00000100:00100000:0.0:1746065073.082182:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.085674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.091958:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.094527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.098953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.102224:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.102259:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.106674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.112489:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261028992 00000100:00100000:0.0:1746065073.112497:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261028992 00000100:00100000:0.0:1746065073.112547:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11112 00000100:00100000:0.0:1746065073.112554:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+248:27683:x1830881261028992:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065073.112596:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065073.112629:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc145c847 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2da:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92abdc expref: 248 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.112659:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145c89b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2da:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92abe3 expref: 247 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.112668:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092a1e200/0xad6b7ddc145c808 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2da:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92abc7 expref: 246 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.112680:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2da:0x0].0x0 (ffff880097b72300) 00010000:00010000:0.0:1746065073.112687:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.112707:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065073.112715:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.112722:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.112730:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa7da00/0xad6b7ddc145c8c5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065073.112734:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa7da00/0xad6b7ddc145c8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.112737:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa7da00/0xad6b7ddc145c8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.112826:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065073.112831:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.112836:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:0.0:1746065073.113002:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2120, 64 off176496 00000004:00080000:0.0:1746065073.113008:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 669131233899ns, next at 670131232568ns, rc = 0 00000040:00080000:0.0:1746065073.113023:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2125, 64 off176976 00000004:00080000:0.0:1746065073.113026:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 669131252704ns, next at 670131252193ns, rc = 0 00000040:00080000:0.0:1746065073.113032:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2126, 64 off177040 00000040:00080000:0.0:1746065073.113039:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2121, 64 off176560 00010000:00010000:0.0:1746065073.113071:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc145c8d3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065073.113077:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc145c8d3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113083:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc145c8d3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113087:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc145c8d3 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113092:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc145c8d3 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113096:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc145c8d3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113106:0:7204:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065073.113119:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113123:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113127:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113131:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5ce800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.113134:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113142:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113148:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2da:0x0].0x0 (ffff880095561a00) 00010000:00010000:0.0:1746065073.113150:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065073.113152:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113156:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc145c8cc lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2da:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113233:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113238:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113242:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113246:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113250:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.113252:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113255:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113261:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561400) 00010000:00010000:0.0:1746065073.113263:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065073.113265:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113269:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145c8be lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065073.113277:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098349c00 reply state ffff88009a58e000 transno 4294974609 ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa7da00/0xad6b7ddc145c8c5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113284:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa7da00/0xad6b7ddc145c8c5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.113289:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561500) 00010000:00010000:0.0:1746065073.113290:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065073.113292:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065073.113343:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+247:27683:x1830881261028992:12345-192.168.202.27@tcp:36:rm.0 Request processed in 789us (1007us total) trans 4294974609 rc 0/0 00000100:00100000:0.0:1746065073.113348:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11112 00000100:00100000:0.0:1746065073.128052:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.132011:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.136659:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.139633:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.140015:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.155843:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.163661:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.171015:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.179191:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.180029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.180312:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3303 00000100:00100000:0.0:1746065073.180321:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+255:2005:x1830881261031040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065073.180328:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065073.180333:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc145c966 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x2db:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac29 expref: 255 pid: 7231 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746065073.180486:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc145c966 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2db:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac29 expref: 255 pid: 7231 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746065073.180504:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2db:0x0].0x0 (ffff880097e34000) 00010000:00010000:0.0:1746065073.180508:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880131046e00/0xad6b7ddc145c990 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2db:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.180515:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065073.181083:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+255:2005:x1830881261031040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 763us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.181090:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3303 00000100:00100000:0.0:1746065073.184268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.186310:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.186371:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.192490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.195285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.201934:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.202011:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.208954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.208994:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.213854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.215417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.218454:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7728 00000100:00100000:0.0:1746065073.218462:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+165:3759:x1830881262514304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.218573:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+167:3759:x1830881262514304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 112us (233us total) trans 21474839443 rc 0/0 00000100:00100000:0.0:1746065073.218579:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7728 00000100:00100000:0.0:1746065073.218643:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262514816:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.218664:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.218696:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262514816 00000100:00100000:0.0:1746065073.218699:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262514816 00000100:00100000:0.0:1746065073.218715:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262514688 00000100:00100000:0.0:1746065073.218717:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262514688 00000100:00100000:0.0:1746065073.218727:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7729 00000100:00100000:0.0:1746065073.218731:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3760:x1830881262514816:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065073.218806:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065073.218809:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2fd:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.218811:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.218813:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2fd:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.218814:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2fd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065073.218831:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3760:x1830881262514816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 99us (167us total) trans 17179872177 rc 0/0 00000100:00100000:0.0:1746065073.218836:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7729 00000100:00100000:0.0:1746065073.218844:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262514048 00000100:00100000:0.0:1746065073.218846:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262514048 00000100:00100000:0.0:1746065073.218858:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262514560 00000100:00100000:0.0:1746065073.218859:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262514560 00000100:00100000:0.0:1746065073.218865:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262514432 00000100:00100000:0.0:1746065073.218867:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262514432 00000100:00100000:0.0:1746065073.218873:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7731 00000100:00100000:0.0:1746065073.218877:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+167:3762:x1830881262514048:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065073.218885:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:762 count 1 00010000:00010000:0.0:1746065073.218894:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc145ca1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.218906:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc145c8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92abea expref: 61 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.218912:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.218913:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.218915:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc145ca1c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.218931:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc145c8a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92abea expref: 61 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.218941:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc145c8a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92abea expref: 61 pid: 3067 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.218949:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262515072:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.218988:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.218997:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7734 00000100:00100000:0.0:1746065073.219001:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3762:x1830881262514944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.219044:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3762:x1830881262514944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 42us (166us total) trans 17179872179 rc 0/0 00000100:00100000:0.0:1746065073.219051:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7734 00000004:00080000:0.0:1746065073.219069:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dd180/2, rc 0, transno 17179872177 00000100:00100000:0.0:1746065073.219072:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262514816:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.227724:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.227825:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.229214:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065073.230242:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065073.230247:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800999c0a00/0xad6b7ddc145ca23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.230254:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065073.230257:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800999c0a00/0xad6b7ddc145ca23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.230264:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800999c0a00/0xad6b7ddc145ca23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.230279:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800999c0a00/0xad6b7ddc145ca23 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.230284:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0a00/0xad6b7ddc145ca23 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.230315:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.230316:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.230318:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065073.231940:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.232566:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.235112:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.237088:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.237130:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.241850:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.256574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.259514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.262514:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.271683:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.278298:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.282434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.290088:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.294653:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261037696 00000100:00100000:0.0:1746065073.294661:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261037696 00000100:00100000:0.0:1746065073.294709:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11138 00000100:00100000:0.0:1746065073.294716:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+253:27690:x1830881261037696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.294733:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.294746:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cb1f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92acb5 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.295085:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cb26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065073.295097:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc145cb11 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92acae expref: 254 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.295103:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cb26 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.295126:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc145cb11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92acae expref: 254 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.295136:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc145cb11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92acae expref: 254 pid: 7205 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.295147:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262515712:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.295241:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.296324:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.300354:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.304937:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.307910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.307944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.309693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.310282:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.311801:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.313748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.314923:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.315262:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261039616 00000100:00100000:0.0:1746065073.315266:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261039616 00000100:00100000:0.0:1746065073.315310:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 515 00000100:00100000:0.0:1746065073.315316:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+261:2006:x1830881261039616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065073.315323:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065073.315334:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc145cb73 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92acd1 expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.315345:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2dd:0x0].0x0 (ffff88008ec47900) 00010000:00010000:0.0:1746065073.315347:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065073.315365:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+260:2006:x1830881261039616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.315371:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 515 00000100:00100000:0.0:1746065073.316404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.316434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.320677:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.321580:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.321596:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040512 00000100:00100000:0.0:1746065073.321600:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040512 00000100:00100000:0.0:1746065073.321628:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11146 00000100:00100000:0.0:1746065073.321633:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:26180:x1830881261040512:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.321641:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.321643:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065073.321654:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145cb96 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2dd:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92acdf expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.321665:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2dd:0x0].0x0 (ffff88008ec47900) 00010000:00010000:0.0:1746065073.321668:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.321673:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cbb9 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aced expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.321693:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cbc0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065073.321700:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61400/0xad6b7ddc145cbb2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ace6 expref: 265 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.321706:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cbc0 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.321724:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61400/0xad6b7ddc145cbb2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ace6 expref: 265 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.321734:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61400/0xad6b7ddc145cbb2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2dd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ace6 expref: 265 pid: 9571 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.321747:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262515840:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.321813:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.324052:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.324069:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261040768 00000100:00100000:0.0:1746065073.324073:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261040768 00000100:00100000:0.0:1746065073.324109:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3832 00000100:00100000:0.0:1746065073.324114:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27692:x1830881261040768:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065073.324232:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27692:x1830881261040768:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 117us (185us total) trans 4294974638 rc 0/0 00000100:00100000:0.0:1746065073.324237:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3832 00000100:00100000:0.0:1746065073.324267:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.330573:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262516224:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.330624:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.330646:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065073.330650:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262516096:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.330662:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.330681:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262516224 00000100:00100000:0.0:1746065073.330685:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262516224 00000100:00100000:0.0:1746065073.330707:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262516096 00000100:00100000:0.0:1746065073.330709:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262516096 00000100:00100000:0.0:1746065073.330718:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7738 00000100:00100000:0.0:1746065073.330723:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3760:x1830881262516224:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.330830:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262516224:12345-0@lo:2:osp-syn-1-1.0 Request processed in 107us (206us total) trans 17179872182 rc 0/0 00000100:00100000:0.0:1746065073.330836:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7738 00000100:00100000:0.0:1746065073.330845:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7739 00000100:00100000:0.0:1746065073.330848:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3760:x1830881262516096:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065073.330858:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:766 count 1 00002000:00010000:0.0:1746065073.330871:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065073.330875:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc145cbea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.330884:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.330885:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.330888:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc145cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.330897:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc145cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.330902:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc145cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.330907:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc145cbea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.330917:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065073.331026:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262516096:12345-0@lo:6:osp-syn-1-1.0 Request processed in 176us (362us total) trans 17179872183 rc 0/0 00000100:00100000:0.0:1746065073.331030:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7739 00000004:00080000:0.0:1746065073.331058:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37ce00/2, rc 0, transno 17179872183 00000100:00100000:0.0:1746065073.331062:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262516096:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065073.331068:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37c700/2, rc 0, transno 17179872182 00000100:00100000:0.0:1746065073.331071:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262516224:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.331927:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7744 00000100:00100000:0.0:1746065073.331932:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+171:3761:x1830881262516480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065073.331941:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:764 count 1 00010000:00010000:0.0:1746065073.331949:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc145cbff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.331959:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc145ca54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac76 expref: 63 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.331964:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.331965:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.331967:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc145cbff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.331980:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc145ca54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac76 expref: 63 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.331988:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc145ca54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac76 expref: 63 pid: 9548 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.331996:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262517120:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.332015:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00010000:00010000:0.0:1746065073.332287:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065073.332292:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc145cbf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.332297:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065073.332300:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc145cbf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.332306:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc145cbf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.332370:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc145cbf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.332376:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc145cbf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.332385:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.332386:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.332387:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065073.335223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.335244:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041664 00000100:00100000:0.0:1746065073.335250:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041664 00010000:00010000:0.0:1746065073.335277:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc145ca4d lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac6f expref: 25 pid: 9548 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.335302:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3310 00000100:00100000:0.0:1746065073.335308:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261041664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065073.335318:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065073.335321:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc145ca4d lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac6f expref: 25 pid: 9548 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746065073.335331:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc145ca4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ac6f expref: 25 pid: 9548 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746065073.335350:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.335352:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.335356:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131054e00/0xad6b7ddc145cbf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.335363:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131054e00/0xad6b7ddc145cbf1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.335378:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065073.335407:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261041664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.335413:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3310 00000100:00100000:0.0:1746065073.335444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.335460:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261041536 00000100:00100000:0.0:1746065073.335462:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261041536 00000100:00100000:0.0:1746065073.335477:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3834 00000100:00100000:0.0:1746065073.335481:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+247:27692:x1830881261041536:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065073.335560:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+247:27692:x1830881261041536:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 78us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.335566:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3834 00000100:00100000:0.0:1746065073.335633:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.335682:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.345880:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.350632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.356812:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.359438:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.359476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.366234:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.370660:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.377733:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.382868:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.384593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.387857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.390192:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.401069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.415946:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.421878:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.421915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.425117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.425186:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.429144:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046144 00000100:00100000:0.0:1746065073.429150:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046144 00000100:00100000:0.0:1746065073.429184:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046400 00000100:00100000:0.0:1746065073.429186:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046400 00000100:00100000:0.0:1746065073.429200:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11159 00000100:00100000:0.0:1746065073.429206:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:27696:x1830881261046144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.429218:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.429231:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145ccfb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ad4f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.429275:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.429285:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429297:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429305:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.429310:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429315:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429347:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429352:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429356:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429361:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429366:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bfe00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.429370:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429375:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429383:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:0.0:1746065073.429385:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065073.429388:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429392:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc145cd02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429403:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429408:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429412:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429415:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.429417:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429420:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429424:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009af4dc00) 00010000:00010000:0.0:1746065073.429426:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065073.429427:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429431:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc145cd09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429448:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145ccfb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad4f expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.429455:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc145ccfb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad4f expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.429462:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:0.0:1746065073.429509:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:27696:x1830881261046144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 303us (550us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065073.429514:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11159 00000100:00100000:0.0:1746065073.429526:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11160 00000100:00100000:0.0:1746065073.429531:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+257:27694:x1830881261046400:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065073.429547:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065073.429556:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60200/0xad6b7ddc145ccb5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad33 expref: 257 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.429564:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2dd:0x0].0x0 (ffff88012ef2ad00) 00010000:00010000:0.0:1746065073.429567:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.429577:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cd10 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.429582:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cd10 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.429588:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc145cd10 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:0.0:1746065073.435516:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974650 is committed 00000004:00080000:0.0:1746065073.435524:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1433 committed 00000004:00080000:0.0:1746065073.435537:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1443 committed 00000004:00080000:0.0:1746065073.435542:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1442 committed 00000004:00080000:0.0:1746065073.435543:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1432 committed 00000100:00100000:0.0:1746065073.435628:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262518272:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.435691:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.435904:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7749 00000100:00100000:0.0:1746065073.435911:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3759:x1830881262518144:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065073.436015:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x2ff:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065073.436018:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x2ff:0x0] updating lvb mtime from disk: 1746065073 -> 1746065073 00002000:00010000:0.0:1746065073.436020:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x2ff:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.436022:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x2ff:0x0] updating lvb ctime from disk: 1746065073 -> 1746065073 00002000:00010000:0.0:1746065073.436024:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x2ff:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065073.436047:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3759:x1830881262518144:12345-0@lo:2:osp-syn-1-1.0 Request processed in 137us (375us total) trans 17179872187 rc 0/0 00000100:00100000:0.0:1746065073.436052:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7749 00000100:00100000:0.0:1746065073.436063:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7752 00000100:00100000:0.0:1746065073.436068:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+174:3762:x1830881262518400:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.436128:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+174:3762:x1830881262518400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 59us (332us total) trans 21474839455 rc 0/0 00000100:00100000:0.0:1746065073.436133:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7752 00000004:00080000:0.0:1746065073.436152:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cd500/2, rc 0, transno 17179872187 00000100:00100000:0.0:1746065073.436155:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262518144:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065073.436167:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cc000/2, rc 0, transno 17179872188 00000100:00100000:0.0:1746065073.436169:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262518272:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.439569:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046656 00000100:00100000:0.0:1746065073.439575:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046656 00000100:00100000:0.0:1746065073.439625:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11161 00000100:00100000:0.0:1746065073.439631:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+245:27696:x1830881261046656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.439646:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.439649:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065073.439665:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc145ccf4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad48 expref: 245 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.439675:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:0.0:1746065073.439683:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.439692:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72c00/0xad6b7ddc145cd17 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ad56 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.439771:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.439796:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.441490:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.441513:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cd25 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.441520:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cd25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.441525:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cd25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442062:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.442070:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442075:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065073.442083:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2df:0x0]: returning size 0 00010000:00010000:0.0:1746065073.442102:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442107:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442112:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442117:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442121:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa8ea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.442124:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442128:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442136:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098ce5a00) 00010000:00010000:0.0:1746065073.442138:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065073.442140:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442144:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc145cd1e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:0.0:1746065073.442151:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f0d1180 reply state ffff880095232000 transno 4294974651 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cd25 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442157:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cd25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.442165:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098ce5600) 00010000:00010000:0.0:1746065073.442167:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065073.442169:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065073.442191:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72c00/0xad6b7ddc145cd17 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad56 expref: 247 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.442203:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad56 expref: 246 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.442208:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2df:0x0].0x0 (ffff880098ce5e00) 00010000:00010000:0.0:1746065073.442210:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065073.442212:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f7000, rc 0) 00000100:00100000:0.0:1746065073.442263:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+247:27696:x1830881261046656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2633us (2932us total) trans 4294974651 rc 0/0 00000100:00100000:0.0:1746065073.442269:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11161 00000100:00100000:0.0:1746065073.445192:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261046784 00000100:00100000:0.0:1746065073.445200:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261046784 00000100:00100000:0.0:1746065073.445395:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11162 00000100:00100000:0.0:1746065073.445403:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+247:27694:x1830881261046784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.445420:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.445435:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7400/0xad6b7ddc145cd3a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ad5d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.445481:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7400/0xad6b7ddc145cd3a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad5d expref: 248 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.445492:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7400/0xad6b7ddc145cd3a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad5d expref: 248 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.445507:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2dd:0x0].0x0 (ffff88012ef2ad00) 00010000:00010000:0.0:1746065073.445509:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065073.445512:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f7400, rc 0) 00000100:00100000:0.0:1746065073.447078:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+248:27694:x1830881261046784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1670us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.447086:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11162 00000100:00100000:0.0:1746065073.447513:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261047040 00000100:00100000:0.0:1746065073.447519:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261047040 00000100:00100000:0.0:1746065073.447557:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11163 00000100:00100000:0.0:1746065073.447564:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+248:27696:x1830881261047040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.447579:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.447592:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc145cd41 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ad64 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.447679:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc145cd48 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.447689:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad56 expref: 249 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.447695:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc145cd48 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.447719:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad56 expref: 249 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.447730:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd2c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad56 expref: 249 pid: 7231 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.447744:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262518528:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.447831:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.450316:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.452226:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.455138:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.457916:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.462440:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.462466:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261048064 00000100:00100000:0.0:1746065073.462473:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261048064 00000100:00100000:0.0:1746065073.462503:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7754 00000100:00100000:0.0:1746065073.462509:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261048064:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065073.463490:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261048064:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 979us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.463497:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7754 00000100:00100000:0.0:1746065073.472471:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.478081:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.478130:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.481506:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.483848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.486768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.486853:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.486876:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261049856 00000100:00100000:0.0:1746065073.486882:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261049856 00000100:00100000:0.0:1746065073.486925:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11170 00000100:00100000:0.0:1746065073.486931:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:26180:x1830881261049856:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.486945:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.486947:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065073.486967:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60e00/0xad6b7ddc145cdaa lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2df:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad87 expref: 258 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.486985:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2df:0x0].0x0 (ffff88009af4d900) 00010000:00010000:0.0:1746065073.486989:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.486997:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc145cdb1 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ad8e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.487035:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc145cdb8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2df:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.487045:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc145cdb8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2df:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.487052:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc145cdb8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2df:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:0.0:1746065073.488431:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2135, 88 off177784 00000004:00080000:0.0:1746065073.488438:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 669506664084ns, next at 670131252193ns, rc = 0 00000040:00080000:0.0:1746065073.488466:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2130, 88 off177304 00000004:00080000:0.0:1746065073.488468:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 669506694936ns, next at 670131232568ns, rc = 0 00000040:00080000:0.0:1746065073.488486:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2131, 88 off177392 00000004:00080000:0.0:1746065073.488489:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 669506715496ns, next at 670131232568ns, rc = 0 00000040:00080000:0.0:1746065073.488496:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2136, 88 off177872 00000004:00080000:0.0:1746065073.488498:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 669506724324ns, next at 670131252193ns, rc = 0 00000001:00080000:0.0:1746065073.491250:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974659 is committed 00000004:00080000:0.0:1746065073.491259:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1445 committed 00000004:00080000:0.0:1746065073.491744:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1435 committed 00000004:00080000:0.0:1746065073.491979:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1434 committed 00000004:00080000:0.0:1746065073.491982:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1444 committed 00010000:00010000:0.0:1746065073.492087:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc145cdb8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2df:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad8e expref: 250 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.492094:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2df:0x0].0x0 (ffff88009af4d900) 00010000:00010000:0.0:1746065073.492096:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065073.492105:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc145cdb1 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2df:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad8e expref: 250 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065073.492117:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc145cdb8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2df:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad8e expref: 249 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065073.492142:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262518912:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.492180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065073.492217:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2df:0x0].0x0 (ffff88009af4d900) 00010000:00010000:0.0:1746065073.492220:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065073.492222:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:0.0:1746065073.492256:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+249:26180:x1830881261049856:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5324us (5402us total) trans 4294974659 rc 0/0 00000100:00100000:0.0:1746065073.492262:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11170 00000100:00100000:0.0:1746065073.493643:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262519040:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.493666:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065073.493695:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef26d80/2, rc 0, transno 17179872189 00000100:00100000:0.0:1746065073.493701:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262518912:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065073.494155:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bd180/2, rc 0, transno 21474839458 00000100:00100000:0.0:1746065073.494160:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262519040:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.495455:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.497833:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.498951:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7766 00000100:00100000:0.0:1746065073.498958:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+177:3762:x1830881262519680:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.499040:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+179:3762:x1830881262519680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 80us (113us total) trans 21474839460 rc 0/0 00000100:00100000:0.0:1746065073.499047:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7766 00000100:00100000:0.0:1746065073.501905:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.501940:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.501971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065073.509320:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065073.509327:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145cddb lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.509332:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065073.509335:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145cddb lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.509340:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145cddb lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.509349:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2dd:0x0].0x0 (ffff88012ef2a700) 00010000:00010000:0.0:1746065073.509351:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065073.509354:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145cddb lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.509359:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145cddb lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.509369:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.509370:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.509372:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065073.511090:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.518895:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.527873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.527914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.533542:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.549065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.554448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.561412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.564651:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.578650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.588630:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.594113:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.608867:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.609283:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.614089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.614817:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.619641:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.619694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.627702:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.627840:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.635107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.635843:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11187 00000100:00100000:0.0:1746065073.635851:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+264:27701:x1830881261055744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.635862:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.635871:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145cf24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ae0c expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.635925:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065073.635931:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.635938:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.635945:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065073.635950:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.635954:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639240:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065073.639256:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639267:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065073.639277:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2e1:0x0]: returning size 0 00010000:00010000:0.0:1746065073.639349:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639356:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639364:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639368:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639372:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.639375:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639380:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639389:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c500) 00010000:00010000:0.0:1746065073.639391:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065073.639394:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639399:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc145cf2b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639422:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639427:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639432:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639436:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.639438:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639445:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639450:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800aa04cf00) 00010000:00010000:0.0:1746065073.639452:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065073.639454:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639458:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf32 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.639497:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145cf24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae0c expref: 266 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.639511:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae0c expref: 265 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.639517:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e1:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:0.0:1746065073.639518:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065073.639520:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683aa00, rc 0) 00000100:00100000:0.0:1746065073.639572:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+265:27701:x1830881261055744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3722us (3931us total) trans 4294974675 rc 0/0 00000100:00100000:0.0:1746065073.639580:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11187 00000100:00100000:0.0:1746065073.644036:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261056000 00000100:00100000:0.0:1746065073.644044:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261056000 00000100:00100000:0.0:1746065073.644097:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11188 00000100:00100000:0.0:1746065073.644104:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+265:26180:x1830881261056000:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.644121:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.644124:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065073.644145:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7600/0xad6b7ddc145cf1d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae05 expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.644173:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e1:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:0.0:1746065073.644178:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.644188:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145cf47 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ae13 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.644228:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf4e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065073.644238:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae0c expref: 265 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.644244:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc145cf4e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.644268:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae0c expref: 265 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.644279:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683aa00/0xad6b7ddc145cf39 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae0c expref: 265 pid: 9571 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.644290:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262519936:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.644379:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.647865:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.649655:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.655573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.660894:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.662955:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262520192:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.664530:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262520448 00000100:00100000:0.0:1746065073.664537:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262520448 00000100:00100000:0.0:1746065073.666258:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262520064 00000100:00100000:0.0:1746065073.666263:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262520064 00000100:00100000:0.0:1746065073.666287:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262520576 00000100:00100000:0.0:1746065073.666289:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262520576 00000100:00100000:0.0:1746065073.666299:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262520320 00000100:00100000:0.0:1746065073.666301:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262520320 00000100:00100000:0.0:1746065073.666308:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262520832 00000100:00100000:0.0:1746065073.666310:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262520832 00000100:00100000:0.0:1746065073.666322:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7768 00000100:00100000:0.0:1746065073.666328:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+26:3761:x1830881262520448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065073.666351:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:770 count 1 00002000:00010000:0.0:1746065073.666377:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065073.666384:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc145cf78 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666395:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.666396:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.666400:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc145cf78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666410:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc145cf78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666415:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc145cf78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666421:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc145cf78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666433:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065073.666577:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+27:3761:x1830881262520448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 249us (3949us total) trans 17179872194 rc 0/0 00000100:00100000:0.0:1746065073.666583:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7768 00000100:00100000:0.0:1746065073.666595:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7769 00000100:00100000:0.0:1746065073.666599:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+26:3761:x1830881262520064:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065073.666606:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:767 count 1 00010000:00010000:0.0:1746065073.666624:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666635:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145cc30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad09 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666640:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.666641:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.666643:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666662:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145cc30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad09 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666671:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145cc30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad09 expref: 27 pid: 9549 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.666679:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098662a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262521600:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.666719:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac7e9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.666735:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7770 00000100:00100000:0.0:1746065073.666739:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+26:3761:x1830881262520576:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.666822:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+27:3761:x1830881262520576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 82us (4123us total) trans 17179872195 rc 0/0 00000100:00100000:0.0:1746065073.666827:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7770 00000100:00100000:0.0:1746065073.666836:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7771 00000100:00100000:0.0:1746065073.666840:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+26:3760:x1830881262520320:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065073.666848:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:769 count 1 00010000:00010000:0.0:1746065073.666855:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc145cf86 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666863:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc145cdc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad95 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666867:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.666868:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065073.666870:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc145cf86 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666884:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc145cdc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad95 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666891:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc145cdc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad95 expref: 27 pid: 9549 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.666898:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098663b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262521728:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.666913:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac7e9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.666925:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7772 00000100:00100000:0.0:1746065073.666929:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+178:3760:x1830881262520832:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065073.666939:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:766 count 1 00010000:00010000:0.0:1746065073.666951:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666959:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad72 expref: 69 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065073.666964:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.666965:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.666967:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.666981:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad72 expref: 69 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065073.666989:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7000/0xad6b7ddc145cd64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad72 expref: 69 pid: 9549 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746065073.666996:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262521856:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.667011:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.670111:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7773 00000100:00100000:0.0:1746065073.670119:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+179:3760:x1830881262521344:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065073.670261:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065073.670265:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.670266:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.670268:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.670269:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x302:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065073.670323:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+180:3760:x1830881262521344:12345-0@lo:2:osp-syn-0-1.0 Request processed in 205us (4118us total) trans 21474839462 rc 0/0 00000100:00100000:0.0:1746065073.670329:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7773 00000100:00100000:0.0:1746065073.670391:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.670412:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261057024 00000100:00100000:0.0:1746065073.670414:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261057024 00000100:00100000:0.0:1746065073.670436:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3849 00000100:00100000:0.0:1746065073.670441:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+249:27701:x1830881261057024:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065073.670523:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+249:27701:x1830881261057024:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.670528:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3849 00000100:00100000:0.0:1746065073.674763:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.678536:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262521856:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065073.678548:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065073.678568:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262521600:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065073.678577:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680590:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680598:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680606:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680623:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc145cf8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680633:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065073.680810:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+184:3760:x1830881262520832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13880us (16113us total) trans 21474839466 rc 0/0 00000100:00100000:0.0:1746065073.680816:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7772 00000100:00100000:0.0:1746065073.680828:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7780 00000100:00100000:0.0:1746065073.680833:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+69:26180:x1830881261057536:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.680842:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.680851:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3c00/0xad6b7ddc145cfb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x302:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ae21 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680867:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc145cf01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92adf7 expref: 70 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065073.680873:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.680875:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.680877:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3c00/0xad6b7ddc145cfb0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x302:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae21 expref: 70 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.680895:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc145cf01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92adf7 expref: 70 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065073.680908:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc145cf01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92adf7 expref: 70 pid: 12258 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746065073.680919:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262522112:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.683846:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065073.685237:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065073.685242:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.685249:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065073.685252:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.685259:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.685271:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.685276:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc145cf7f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.685288:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.685289:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.685290:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065073.688219:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3c00/0xad6b7ddc145cdcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ad9c expref: 70 pid: 9549 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.688229:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262521984:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065073.688243:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7600/0xad6b7ddc145cfa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.688250:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7600/0xad6b7ddc145cfa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.688255:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7600/0xad6b7ddc145cfa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.688261:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7600/0xad6b7ddc145cfa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.688266:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f7600/0xad6b7ddc145cfa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.688283:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065073.689263:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+184:3762:x1830881262521088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14265us (14504us total) trans 21474839467 rc 0/0 00000100:00100000:0.0:1746065073.689271:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7779 00000004:00080000:0.0:1746065073.689303:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a7a0380/2, rc 0, transno 21474839467 00000100:00100000:0.0:1746065073.689308:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a7a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262521088:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.694712:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.695306:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058176 00000100:00100000:0.0:1746065073.695309:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058176 00000100:00100000:0.0:1746065073.695333:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7781 00000100:00100000:0.0:1746065073.695338:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+26:26180:x1830881261058176:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.695345:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.695355:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7400/0xad6b7ddc145cfd3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ae2f expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065073.695371:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065073.695382:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.695384:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.695388:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7400/0xad6b7ddc145cfd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae2f expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.695625:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7400/0xad6b7ddc145cfd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae2f expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.695632:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f7400, rc 0) 00000100:00100000:0.0:1746065073.695985:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:26180:x1830881261058176:12345-192.168.202.27@tcp:101:bash.0 Request processed in 646us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.695990:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7781 00000100:00100000:0.0:1746065073.698901:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.700384:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261058432 00000100:00100000:0.0:1746065073.700387:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261058432 00002000:00010000:0.0:1746065073.700399:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/771 (0->18446744073709551615) 00002000:00100000:0.0:1746065073.700401:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed4000 with x1830881261058432 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065073.700407:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed4000. 00000100:00100000:0.0:1746065073.700415:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1170 00000100:00100000:0.0:1746065073.700419:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261058432:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065073.700499:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065073.700501:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb mtime from disk: 0 -> 1746065073 00002000:00010000:0.0:1746065073.700503:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.700504:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb ctime from disk: 0 -> 1746065073 00002000:00010000:0.0:1746065073.700506:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065073.700523:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881261058432:12345-192.168.202.27@tcp:10:bash.0 Request processed in 103us (421us total) trans 17179872200 rc 0/0 00000100:00100000:0.0:1746065073.700527:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1170 00002000:00010000:0.0:1746065073.700529:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/771 (0->18446744073709551615) 00002000:00100000:0.0:1746065073.700531:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed4000 with x1830881261058432 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065073.700534:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed4000. 00000100:00100000:0.0:1746065073.704443:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.710299:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.715423:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.717348:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11192 00000100:00100000:0.0:1746065073.717355:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+256:27703:x1830881261059456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065073.717364:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.717377:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc145cff6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2e1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ae3d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.717432:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cffd lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2e1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065073.717443:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145cfcc lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae28 expref: 256 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.717448:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7200/0xad6b7ddc145cffd lrc: 4/0,1 mode: --/CW res: [0x240000403:0x2e1:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065073.717472:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145cfcc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae28 expref: 256 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.717482:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145cfcc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2e1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae28 expref: 256 pid: 9571 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.717493:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262522368:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.717551:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.720629:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.724157:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.728707:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.736899:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.739165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.739503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.741925:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.745552:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.745582:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.751847:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.751883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.757365:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.757909:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262522752:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.758214:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.758330:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262522752 00000100:00100000:0.0:1746065073.758334:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262522752 00000100:00100000:0.0:1746065073.758353:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262522880 00000100:00100000:0.0:1746065073.758355:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262522880 00000100:00100000:0.0:1746065073.758366:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7783 00000100:00100000:0.0:1746065073.758370:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3762:x1830881262522752:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065073.758467:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065073.758469:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb mtime from disk: 1746065073 -> 1746065073 00002000:00010000:0.0:1746065073.758471:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065073.758472:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb ctime from disk: 1746065073 -> 1746065073 00002000:00010000:0.0:1746065073.758474:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x303:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065073.758497:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3762:x1830881262522752:12345-0@lo:2:osp-syn-1-1.0 Request processed in 126us (283us total) trans 17179872201 rc 0/0 00000100:00100000:0.0:1746065073.758502:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7783 00000100:00100000:0.0:1746065073.758513:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7784 00000100:00100000:0.0:1746065073.758517:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3759:x1830881262522880:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.758572:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3759:x1830881262522880:12345-0@lo:2:osp-syn-1-1.0 Request processed in 55us (278us total) trans 17179872202 rc 0/0 00000100:00100000:0.0:1746065073.758577:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7784 00000004:00080000:0.0:1746065073.758600:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5de300/2, rc 0, transno 17179872201 00000100:00100000:0.0:1746065073.758604:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262522752:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.761804:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262523008:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.762162:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065073.762544:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7786 00000100:00100000:0.0:1746065073.762551:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+185:3760:x1830881262523008:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.762633:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+187:3760:x1830881262523008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 83us (471us total) trans 21474839471 rc 0/0 00000100:00100000:0.0:1746065073.762640:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7786 00000004:00080000:0.0:1746065073.762672:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e51c00/2, rc 0, transno 21474839471 00000100:00100000:0.0:1746065073.762677:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262523008:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.763588:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.774367:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.779228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.785392:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261063040 00000100:00100000:0.0:1746065073.785396:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261063040 00000100:00100000:0.0:1746065073.785420:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3853 00000100:00100000:0.0:1746065073.785426:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+250:27705:x1830881261063040:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065073.785589:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+251:27705:x1830881261063040:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 163us (336us total) trans 4294974691 rc 0/0 00000100:00100000:0.0:1746065073.785594:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3853 00000100:00100000:0.0:1746065073.788427:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.793094:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.794468:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.796677:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.797419:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.799377:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.802537:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.806376:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.807733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.810517:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.811650:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.811669:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065088 00000100:00100000:0.0:1746065073.811672:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065088 00000100:00100000:0.0:1746065073.811701:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3855 00000100:00100000:0.0:1746065073.811707:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27703:x1830881261065088:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065073.811742:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x2e1:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009af08c00/0xad6b7ddc145d035 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2e1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae4b expref: 260 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.811762:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065073.811770:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60800/0xad6b7ddc145d0c1 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae75 expref: 260 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.811800:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.811823:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60800/0xad6b7ddc145d0c1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae75 expref: 260 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.811833:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60800/0xad6b7ddc145d0c1 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae75 expref: 260 pid: 9571 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746065073.811844:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f56300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262523648:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.811898:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065073.813400:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f56300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262523648:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065073.813414:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.815645:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.815654:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000040:00080000:0.0:1746065073.815840:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2144, 88 off178440 00000004:00080000:0.0:1746065073.815846:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 669834071380ns, next at 670131232568ns, rc = 0 00000040:00080000:0.0:1746065073.815865:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2149, 88 off178920 00000004:00080000:0.0:1746065073.815869:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 669834095343ns, next at 670131252193ns, rc = 0 00000040:00080000:0.0:1746065073.815881:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2150, 88 off179008 00000004:00080000:0.0:1746065073.815884:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 669834110747ns, next at 670131252193ns, rc = 0 00000040:00080000:0.0:1746065073.815892:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2145, 88 off178528 00000004:00080000:0.0:1746065073.815895:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 669834121317ns, next at 670131232568ns, rc = 0 00000100:00100000:0.0:1746065073.817296:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065073.817303:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262524160:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.817326:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065073.818096:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f56d80/2, rc 0, transno 17179872203 00000100:00100000:0.0:1746065073.818100:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262524160:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.820199:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261065600 00000100:00100000:0.0:1746065073.820206:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261065600 00000100:00100000:0.0:1746065073.820399:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7796 00000100:00100000:0.0:1746065073.820409:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:26180:x1830881261065600:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.820425:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.820445:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd2000/0xad6b7ddc145d154 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92aeb4 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065073.820468:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065073.820488:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.820490:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.820497:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2000/0xad6b7ddc145d154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aeb4 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.820510:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd2000/0xad6b7ddc145d154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92aeb4 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.820523:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2000, rc 0) 00000100:00100000:0.0:1746065073.820627:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:26180:x1830881261065600:12345-192.168.202.27@tcp:101:bash.0 Request processed in 219us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065073.820632:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7796 00000100:00100000:0.0:1746065073.823045:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065073.823567:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974698 is committed 00000004:00080000:0.0:1746065073.823575:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1445 committed 00000004:00080000:0.0:1746065073.823593:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1455 committed 00000004:00080000:0.0:1746065073.823598:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1454 committed 00000004:00080000:0.0:1746065073.823600:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1444 committed 00000100:00100000:0.0:1746065073.823675:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262524288:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065073.823707:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065073.825926:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed2300/2, rc 0, transno 17179872205 00000100:00100000:0.0:1746065073.825931:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262524288:0@lo:2:osp-syn-1-1.0 00000004:00010000:0.0:1746065073.825967:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095f55c00 reply state ffff880098c1cc00 transno 4294974698 ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.825979:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc145d14d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065073.825986:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e1:0x0].0x0 (ffff88012ef2ab00) 00010000:00010000:0.0:1746065073.825989:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065073.825991:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065073.825995:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e1:0x0].0x0 (ffff88012ef2ab00) 00010000:00010000:0.0:1746065073.825996:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065073.826001:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af08c00/0xad6b7ddc145d035 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2e1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ae4b expref: 247 pid: 9571 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065073.826065:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065073.826072:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+247:27703:x1830881261065088:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 14366us (14423us total) trans 4294974698 rc 0/0 00000100:00100000:0.0:1746065073.826079:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3855 00000100:00100000:0.0:1746065073.828593:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.828647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.838757:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.842116:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.851528:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.869173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.879185:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.891089:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.900227:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.911150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.913852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.918404:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.930910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.930969:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.934711:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065073.935197:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.935204:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065073.935226:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2e5:0x0]: returning size 0 00000004:00080000:0.0:1746065073.936143:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x306:0x0], index 0: 0 00000004:00080000:0.0:1746065073.936152:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x307:0x0], index 1: 0 00000004:00080000:0.0:1746065073.936156:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x308:0x0], index 1: 0 00000004:00080000:0.0:1746065073.936159:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x307:0x0], index 0: 0 00010000:00010000:0.0:1746065073.936253:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936260:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936265:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936269:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065073.936273:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936277:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936285:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e5:0x0].0x0 (ffff880097b72c00) 00010000:00010000:0.0:1746065073.936288:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065073.936291:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936295:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc145d249 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065073.936332:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc145d242 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af01 expref: 254 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.936339:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc145d242 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af01 expref: 254 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.936351:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9000, rc 0) 00000100:00100000:0.0:1746065073.936376:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+253:27708:x1830881261068544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5238us (5475us total) trans 4294974704 rc 301/301 00000100:00100000:0.0:1746065073.936382:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11221 00000100:00100000:0.0:1746065073.939068:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.941722:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.941770:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.945243:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.949599:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.952870:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.953663:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.955586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.958198:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261070848 00000100:00100000:0.0:1746065073.958204:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261070848 00000100:00100000:0.0:1746065073.960308:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.962958:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.968059:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262524928 00000100:00100000:0.0:1746065073.968065:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262524928 00000100:00100000:0.0:1746065073.968090:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262525312 00000100:00100000:0.0:1746065073.968092:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262525312 00000100:00100000:0.0:1746065073.968101:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262525824 00000100:00100000:0.0:1746065073.968103:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262525824 00000100:00100000:0.0:1746065073.968249:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262525056 00000100:00100000:0.0:1746065073.968252:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262525056 00000100:00100000:0.0:1746065073.968263:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262525184 00000100:00100000:0.0:1746065073.968265:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262525184 00000100:00100000:0.0:1746065073.968312:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7804 00000100:00100000:0.0:1746065073.968318:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+40:3761:x1830881262525312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065073.968328:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:774 count 1 00002000:00010000:0.0:1746065073.968344:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065073.968348:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f1d1000/0xad6b7ddc145d2e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.968355:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.968356:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.968360:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1d1000/0xad6b7ddc145d2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.968367:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f1d1000/0xad6b7ddc145d2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.968373:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f1d1000/0xad6b7ddc145d2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.968378:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f1d1000/0xad6b7ddc145d2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.968389:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065073.968505:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+41:3761:x1830881262525312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 186us (510us total) trans 17179872209 rc 0/0 00000100:00100000:0.0:1746065073.968511:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7804 00000100:00100000:0.0:1746065073.968523:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7808 00000100:00100000:0.0:1746065073.968526:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+196:3761:x1830881262526336:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065073.968583:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+197:3761:x1830881262526336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 56us (507us total) trans 21474839479 rc 0/0 00000100:00100000:0.0:1746065073.968587:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7808 00000100:00100000:0.0:1746065073.972124:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261072000 00000100:00100000:0.0:1746065073.972130:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261072000 00000100:00100000:0.0:1746065073.972159:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7815 00000100:00100000:0.0:1746065073.972165:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+75:26180:x1830881261072000:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065073.972177:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065073.972189:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc145d337 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x306:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92af40 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.972223:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc145d27a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af16 expref: 76 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065073.972230:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.972231:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065073.972234:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc145d337 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x306:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af40 expref: 76 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.972269:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc145d27a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af16 expref: 76 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065073.972283:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc145d27a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af16 expref: 76 pid: 9549 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746065073.972293:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262526976:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065073.973013:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000001:00080000:0.0:1746065073.973112:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839481 is committed 00000001:00080000:0.0:1746065073.973122:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839477 is committed 00000004:00080000:0.0:1746065073.975557:0:10211:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 111 in progress, 0 in flight, 78 done 00000004:00080000:0.0:1746065073.976137:0:10211:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 109 done 00000100:00100000:0.0:1746065073.976189:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.978956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.979452:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.982919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.982998:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.988630:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.988674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.997362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065073.999234:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261074048 00000100:00100000:0.0:1746065073.999237:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261074048 00000100:00100000:0.0:1746065073.999324:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11231 00000100:00100000:0.0:1746065073.999330:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:27713:x1830881261074048:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065073.999351:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065073.999362:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145d2d5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af32 expref: 253 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.999378:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6200/0xad6b7ddc145d329 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af39 expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.999387:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc145d2ab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af24 expref: 251 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065073.999482:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e5:0x0].0x0 (ffff880097e34400) 00010000:00010000:0.0:1746065073.999486:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065073.999501:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.999507:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.999513:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.999524:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145d36f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.999529:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145d36f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.999534:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145d36f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.999585:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065073.999591:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065073.999596:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:0.0:1746065074.000054:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x2e5:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1746065074.000100:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000106:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000112:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000117:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.000121:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000126:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000133:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e5:0x0].0x0 (ffff880097e34400) 00010000:00010000:0.0:1746065074.000135:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065074.000138:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000142:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d376 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000152:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000156:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000159:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000163:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000166:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.000168:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000171:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000175:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508c00) 00010000:00010000:0.0:1746065074.000177:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.000179:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000183:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d368 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:0.0:1746065074.000192:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098663800 reply state ffff88009c17a000 transno 4294974717 ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145d36f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000198:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc145d36f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.000202:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008c508900) 00010000:00010000:0.0:1746065074.000204:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065074.000206:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065074.000262:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+251:27713:x1830881261074048:12345-192.168.202.27@tcp:36:rm.0 Request processed in 931us (1086us total) trans 4294974717 rc 0/0 00000100:00100000:0.0:1746065074.000267:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11231 00000100:00100000:0.0:1746065074.000996:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.002833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.007443:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.010548:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.011323:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.017326:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075072 00000100:00100000:0.0:1746065074.017330:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075072 00000100:00100000:0.0:1746065074.017373:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11235 00000100:00100000:0.0:1746065074.017378:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091327050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:27714:x1830881261075072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.017387:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.017396:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145d3a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92af71 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.017429:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.017436:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017442:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017449:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.017454:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017458:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017478:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017483:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017487:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017492:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017496:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.017499:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017504:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017557:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508500) 00010000:00010000:0.0:1746065074.017560:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.017563:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017567:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166e00/0xad6b7ddc145d3ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017583:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017587:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017590:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017593:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.017596:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017599:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017604:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008c508900) 00010000:00010000:0.0:1746065074.017606:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.017616:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017620:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc145d3b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.017642:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145d3a7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af71 expref: 254 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.017648:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145d3a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af71 expref: 254 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.017658:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166000, rc 0) 00000100:00100000:0.0:1746065074.018008:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091327050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:27714:x1830881261075072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 628us (1419us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065074.018014:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11235 00000100:00100000:0.0:1746065074.019578:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262527872 00000100:00100000:0.0:1746065074.019582:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262527872 00000100:00100000:0.0:1746065074.019638:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262527488 00000100:00100000:0.0:1746065074.019640:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262527488 00000100:00100000:0.0:1746065074.019657:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7820 00000100:00100000:0.0:1746065074.019662:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262527872:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.019760:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3761:x1830881262527872:12345-0@lo:2:osp-syn-0-1.0 Request processed in 99us (324us total) trans 21474839486 rc 0/0 00000100:00100000:0.0:1746065074.019765:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7820 00000100:00100000:0.0:1746065074.019790:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7821 00000100:00100000:0.0:1746065074.019794:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+41:3761:x1830881262527488:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065074.019843:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x307:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065074.019845:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x307:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.019847:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x307:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065074.019848:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x307:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.019850:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x307:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065074.019863:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+42:3761:x1830881262527488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 69us (376us total) trans 17179872215 rc 0/0 00000100:00100000:0.0:1746065074.019867:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7821 00000100:00100000:0.0:1746065074.020201:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7823 00000100:00100000:0.0:1746065074.020206:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3759:x1830881262527744:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.020395:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3759:x1830881262527744:12345-0@lo:2:osp-syn-0-1.0 Request processed in 187us (264us total) trans 21474839487 rc 0/0 00000100:00100000:0.0:1746065074.020400:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7823 00000100:00100000:0.0:1746065074.020413:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261075200 00000100:00100000:0.0:1746065074.020415:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261075200 00000100:00100000:0.0:1746065074.020438:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11236 00000100:00100000:0.0:1746065074.020442:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+247:27714:x1830881261075200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.020452:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.020462:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b600/0xad6b7ddc145d3bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92af78 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.020493:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a400/0xad6b7ddc145d3c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.020500:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a400/0xad6b7ddc145d3c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.020506:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a400/0xad6b7ddc145d3c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065074.020524:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1746065074.020527:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1746065074.020547:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b600/0xad6b7ddc145d3bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af78 expref: 249 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.020557:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a400/0xad6b7ddc145d3c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af78 expref: 248 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.020562:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508400) 00010000:00010000:0.0:1746065074.020564:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1746065074.020567:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a400, rc 0) 00000100:00100000:0.0:1746065074.020586:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+248:27714:x1830881261075200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 144us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.020592:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11236 00000100:00100000:0.0:1746065074.021725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.023137:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.026390:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.026546:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.029703:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.030044:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261076224 00000100:00100000:0.0:1746065074.030050:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261076224 00000100:00100000:0.0:1746065074.030090:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11241 00000100:00100000:0.0:1746065074.030096:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+251:27714:x1830881261076224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.030108:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.030119:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1ba00/0xad6b7ddc145d41e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92afa2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.030194:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d425 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.030204:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc145d409 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af9b expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.030209:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d425 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.030230:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc145d409 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af9b expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.030239:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc145d409 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92af9b expref: 252 pid: 7204 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.030249:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c53c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262528000:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065074.031555:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.033219:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.033332:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.037126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.037164:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.047871:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.048864:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261077760 00000100:00100000:0.0:1746065074.048867:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261077760 00000100:00100000:0.0:1746065074.048897:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11243 00000100:00100000:0.0:1746065074.048902:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+254:26180:x1830881261077760:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065074.048916:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.049132:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d43a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92afa9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.049217:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.049227:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049235:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049243:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.049248:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049253:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049283:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a000/0xad6b7ddc145d44f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.049287:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a000/0xad6b7ddc145d44f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049292:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a000/0xad6b7ddc145d44f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065074.049299:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2e7:0x0]: returning size 0 00010000:00010000:0.0:1746065074.049337:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049342:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049347:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049352:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049356:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.049359:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049365:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049374:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508200) 00010000:00010000:0.0:1746065074.049377:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.049380:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049385:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc145d441 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049410:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049415:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049419:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049423:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.049425:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049429:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049435:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72500) 00010000:00010000:0.0:1746065074.049437:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.049439:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049443:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d448 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.049473:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d43a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afa9 expref: 257 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.049486:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a000/0xad6b7ddc145d44f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afa9 expref: 256 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.049492:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e7:0x0].0x0 (ffff88008c508100) 00010000:00010000:0.0:1746065074.049494:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065074.049496:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a000, rc 0) 00000100:00100000:0.0:1746065074.049527:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+256:26180:x1830881261077760:12345-192.168.202.27@tcp:101:bash.0 Request processed in 624us (947us total) trans 4294974724 rc 0/0 00000100:00100000:0.0:1746065074.049533:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11243 00000100:00100000:0.0:1746065074.057309:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078016 00000100:00100000:0.0:1746065074.057318:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078016 00000100:00100000:0.0:1746065074.057371:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11244 00000100:00100000:0.0:1746065074.057378:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+256:27712:x1830881261078016:12345-192.168.202.27@tcp:55:lfs.0 00010000:00010000:0.0:1746065074.057431:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.057444:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057453:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057480:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057485:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057491:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057496:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1a600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.057499:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057506:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057515:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e5:0x0].0x0 (ffff880097e34400) 00010000:00010000:0.0:1746065074.057517:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1746065074.057520:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 2/0,0 mode: --/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057525:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d45d lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065074.057586:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+256:27712:x1830881261078016:12345-192.168.202.27@tcp:55:lfs.0 Request processed in 208us (466us total) trans 0 rc -22/-22 00000100:00100000:0.0:1746065074.057593:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11244 00000100:00100000:0.0:1746065074.057829:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261078144 00000100:00100000:0.0:1746065074.057832:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261078144 00000100:00100000:0.0:1746065074.057848:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11245 00000100:00100000:0.0:1746065074.057853:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+256:26180:x1830881261078144:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065074.057864:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.057874:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a200/0xad6b7ddc145d464 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92afb0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.057893:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145d46b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.057900:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145d46b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057906:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145d46b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.057978:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a200/0xad6b7ddc145d464 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afb0 expref: 258 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.057990:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145d46b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afb0 expref: 257 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.057996:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e7:0x0].0x0 (ffff88008c508100) 00010000:00010000:0.0:1746065074.057998:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065074.058000:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b000, rc 0) 00000100:00100000:0.0:1746065074.058019:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+257:26180:x1830881261078144:12345-192.168.202.27@tcp:101:bash.0 Request processed in 166us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.058025:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11245 00000100:00100000:0.0:1746065074.062120:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.062936:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.066187:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.066233:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.068430:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:0.0:1746065074.070205:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982df800/2, rc 0, transno 21474839490 00000100:00100000:0.0:1746065074.070209:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262528256:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065074.073706:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x2e5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065074.073756:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2158, 64 off179552 00000040:00080000:0.0:1746065074.073770:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2163, 64 off180032 00000040:00080000:0.0:1746065074.073801:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2164, 64 off180096 00000040:00080000:0.0:1746065074.073809:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2159, 64 off179616 00010000:00010000:0.0:1746065074.073849:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d49c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065074.073864:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d49c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.073872:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d49c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.073878:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d49c lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.073883:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d49c lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.073888:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d49c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.073911:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065074.074051:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+251:27712:x1830881261079552:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 834us (967us total) trans 4294974729 rc 0/0 00000100:00100000:0.0:1746065074.074057:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3867 00000100:00100000:0.0:1746065074.087165:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.088455:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261080064 00000100:00100000:0.0:1746065074.088459:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261080064 00000100:00100000:0.0:1746065074.088493:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7837 00000100:00100000:0.0:1746065074.088498:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:26180:x1830881261080064:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065074.088506:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.088516:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc145d4cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92afda expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065074.088530:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065074.088540:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.088542:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.088547:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc145d4cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afda expref: 22 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.088556:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc145d4cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afda expref: 22 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.088562:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ac00, rc 0) 00000100:00100000:0.0:1746065074.088587:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:26180:x1830881261080064:12345-192.168.202.27@tcp:101:bash.0 Request processed in 89us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.088592:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7837 00000100:00100000:0.0:1746065074.090093:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.092520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.093368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.098174:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.104433:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081088 00000100:00100000:0.0:1746065074.104441:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081088 00000100:00100000:0.0:1746065074.105316:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11251 00000100:00100000:0.0:1746065074.105325:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:27716:x1830881261081088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.105340:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.105354:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1aa00/0xad6b7ddc145d4d4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92afe1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.105437:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.105447:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.105456:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065074.105467:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2e7:0x0]: returning size 5 00010000:00010000:0.0:1746065074.105550:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1aa00/0xad6b7ddc145d4d4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afe1 expref: 256 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.105581:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afe1 expref: 255 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.105588:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e7:0x0].0x0 (ffff88008c508100) 00010000:00010000:0.0:1746065074.105590:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065074.105593:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b400, rc 0) 00000100:00100000:0.0:1746065074.105649:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+255:27716:x1830881261081088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 325us (1295us total) trans 4294974733 rc 0/0 00000100:00100000:0.0:1746065074.105655:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11251 00000100:00100000:0.0:1746065074.106242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.106256:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261081344 00000100:00100000:0.0:1746065074.106260:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261081344 00000100:00100000:0.0:1746065074.106276:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11252 00000100:00100000:0.0:1746065074.106281:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+255:27717:x1830881261081344:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065074.106303:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065074.106315:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145d48e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afbe expref: 255 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.106327:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00a00/0xad6b7ddc145d4bf lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afd3 expref: 254 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.106336:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b000/0xad6b7ddc145d46b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afb0 expref: 253 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.106348:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e7:0x0].0x0 (ffff88008c508100) 00010000:00010000:0.0:1746065074.106350:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065074.106361:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d4e9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.106367:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d4e9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.106372:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1be00/0xad6b7ddc145d4e9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.106379:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a200/0xad6b7ddc145d4f0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.106382:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a200/0xad6b7ddc145d4f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.106386:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a200/0xad6b7ddc145d4f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.106440:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d4f7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065074.106447:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afe1 expref: 252 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.106453:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1a600/0xad6b7ddc145d4f7 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.106475:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afe1 expref: 252 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.106489:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc145d4db lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2e7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92afe1 expref: 252 pid: 7231 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.106499:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262529280:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065074.106557:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.108366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.111525:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.116128:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.123505:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.124261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.131027:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.135360:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.136212:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.139103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.142384:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.155971:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084544 00000100:00100000:0.0:1746065074.155977:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084544 00000100:00100000:0.0:1746065074.156014:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3873 00000100:00100000:0.0:1746065074.156020:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27719:x1830881261084544:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065074.156173:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27719:x1830881261084544:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 152us (946us total) trans 4294974742 rc 0/0 00000100:00100000:0.0:1746065074.156179:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3873 00000100:00100000:0.0:1746065074.159978:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261084800 00000100:00100000:0.0:1746065074.159982:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261084800 00000100:00100000:0.0:1746065074.160014:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 519 00000100:00100000:0.0:1746065074.160020:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+267:2005:x1830881261084800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.160031:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.160044:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc145d5d0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b027 expref: 267 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.160057:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.160061:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065074.160104:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+267:2005:x1830881261084800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.160110:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 519 00000100:00100000:0.0:1746065074.161567:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.167029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.169038:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.170334:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261085952 00000100:00100000:0.0:1746065074.170338:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261085952 00000100:00100000:0.0:1746065074.170553:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3874 00000100:00100000:0.0:1746065074.170560:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27719:x1830881261085952:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065074.171093:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27719:x1830881261085952:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 532us (833us total) trans 4294974746 rc 0/0 00000100:00100000:0.0:1746065074.171099:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3874 00000100:00100000:0.0:1746065074.173480:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065074.173922:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc145d624 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.173928:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc145d624 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:0.0:1746065074.174181:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2162, 88 off179832 00000004:00080000:0.0:1746065074.174186:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670192412531ns, next at 671134959236ns, rc = 0 00000040:00080000:0.0:1746065074.174321:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2167, 88 off180312 00000004:00080000:0.0:1746065074.174326:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670192552071ns, next at 671134937577ns, rc = 0 00000040:00080000:0.0:1746065074.174351:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2168, 88 off180400 00000004:00080000:0.0:1746065074.174354:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670192580890ns, next at 671134937577ns, rc = 0 00000040:00080000:0.0:1746065074.174363:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2163, 88 off179920 00000004:00080000:0.0:1746065074.174365:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670192591700ns, next at 671134959236ns, rc = 0 00000100:00100000:0.0:1746065074.177896:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261086592 00000100:00100000:0.0:1746065074.177903:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261086592 00000100:00100000:0.0:1746065074.178326:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7841 00000100:00100000:0.0:1746065074.178331:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3761:x1830881262530048:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065074.178341:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:778 count 1 00002000:00010000:0.0:1746065074.178359:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065074.178365:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc145d64e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178373:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.178375:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.178379:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc145d64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178387:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc145d64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178392:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc145d64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178397:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc145d64e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178412:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065074.178531:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+52:3761:x1830881262530048:12345-0@lo:6:osp-syn-1-1.0 Request processed in 201us (333us total) trans 17179872223 rc 0/0 00000100:00100000:0.0:1746065074.178536:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7841 00000100:00100000:0.0:1746065074.178544:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262529920 00000100:00100000:0.0:1746065074.178546:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262529920 00000100:00100000:0.0:1746065074.178553:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262530432 00000100:00100000:0.0:1746065074.178555:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262530432 00000100:00100000:0.0:1746065074.178560:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262530944 00000100:00100000:0.0:1746065074.178562:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262530944 00000100:00100000:0.0:1746065074.178568:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7843 00000100:00100000:0.0:1746065074.178571:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+52:3759:x1830881262529792:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065074.178578:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:776 count 1 00002000:00010000:0.0:1746065074.178587:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065074.178590:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc145d65c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178596:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.178597:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.178599:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc145d65c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178618:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc145d65c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178623:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc145d65c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178631:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc145d65c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.178640:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065074.178707:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+54:3759:x1830881262529792:12345-0@lo:6:osp-syn-1-1.0 Request processed in 135us (298us total) trans 17179872224 rc 0/0 00000100:00100000:0.0:1746065074.178712:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7843 00000100:00100000:0.0:1746065074.178722:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7845 00000100:00100000:0.0:1746065074.178726:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3759:x1830881262530816:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065074.179565:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:777 count 1 00002000:00010000:0.0:1746065074.179575:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065074.179579:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc145d67f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.179585:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.179586:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.179588:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc145d67f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.179595:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc145d67f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.179599:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc145d67f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.179604:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc145d67f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.179624:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1746065074.179694:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3759:x1830881262530816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 968us (1227us total) trans 21474839497 rc 0/0 00000100:00100000:0.0:1746065074.179977:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7845 00010000:00010000:0.0:1746065074.179994:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065074.182445:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.182483:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.183715:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.183741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.183795:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.190823:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.192313:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.194240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.197105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.197137:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.201253:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.201296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.207311:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.212699:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261089024 00000100:00100000:0.0:1746065074.212709:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261089024 00010000:00010000:0.0:1746065074.212742:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d6a9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b066 expref: 256 pid: 7205 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.212810:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3347 00000100:00100000:0.0:1746065074.212818:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+256:2004:x1830881261089024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.212829:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.212841:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d6a9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b066 expref: 256 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.212851:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d6a9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b066 expref: 256 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.212871:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d6a9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b066 expref: 256 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.212898:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.212902:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc145d6be lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.212910:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc145d6be lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.212916:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc145d6be lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x2e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065074.213125:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.215617:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261089408 00000100:00100000:0.0:1746065074.215622:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261089408 00000100:00100000:0.0:1746065074.215854:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11272 00000100:00100000:0.0:1746065074.215860:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+258:27720:x1830881261089408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.215874:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.215935:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145d6e8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b07b expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.216117:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145d6ef lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065074.216128:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145d6ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.216134:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145d6ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065074.216151:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2e9:0x0]: returning size 5 00000004:00200000:0.0:1746065074.216155:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065074.216164:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145d6ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.216178:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145d6e8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b07b expref: 259 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.216187:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145d6ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b07b expref: 257 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.216192:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.216194:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065074.216196:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee800, rc 0) 00000100:00100000:0.0:1746065074.216215:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+257:27720:x1830881261089408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 356us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.216219:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11272 00000100:00100000:0.0:1746065074.219076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.219996:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090048 00000100:00100000:0.0:1746065074.219999:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090048 00000100:00100000:0.0:1746065074.220024:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11274 00000100:00100000:0.0:1746065074.220028:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+258:27721:x1830881261090048:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065074.220047:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065074.220057:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc145d624 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b04a expref: 258 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.220068:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145d6ef lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b07b expref: 257 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.220078:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145d5ec lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b035 expref: 256 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.220086:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.220088:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065074.220099:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065074.220105:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.220110:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.220115:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065074.220119:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.220123:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.220166:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065074.220172:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfa00/0xad6b7ddc145d6e1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b074 expref: 255 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.220177:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.220196:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfa00/0xad6b7ddc145d6e1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b074 expref: 255 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.220204:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfa00/0xad6b7ddc145d6e1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b074 expref: 255 pid: 7205 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.220215:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013189a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262532224:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065074.220260:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00010000:00010000:0.0:1746065074.221582:0:9571:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff88013189a300 x1830881262532224) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfa00/0xad6b7ddc145d6e1 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b074 expref: 255 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.221594:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfa00/0xad6b7ddc145d6e1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b074 expref: 255 pid: 7205 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.221603:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013189a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262532224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065074.221622:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.221626:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221633:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221637:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00080000:0.0:1746065074.221824:0:9571:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x2e9:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1746065074.221914:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221920:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221925:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221930:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.221933:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221938:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221945:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.221947:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065074.221949:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221953:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef800/0xad6b7ddc145d719 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221962:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221966:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221970:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221977:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221980:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.221982:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221985:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221990:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508000) 00010000:00010000:0.0:1746065074.221992:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.221994:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.221998:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef000/0xad6b7ddc145d70b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00000004:00010000:0.0:1746065074.222006:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5f2680 reply state ffff88009c17a000 transno 4294974755 ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.222013:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.222019:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008c508500) 00010000:00010000:0.0:1746065074.222020:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065074.222022:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065074.222071:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+256:27721:x1830881261090048:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2041us (2148us total) trans 4294974755 rc 0/0 00000100:00100000:0.0:1746065074.222077:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11274 00000100:00100000:0.0:1746065074.224401:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090176 00000100:00100000:0.0:1746065074.224409:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090176 00000100:00100000:0.0:1746065074.224452:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11275 00000100:00100000:0.0:1746065074.224459:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+256:27720:x1830881261090176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.224479:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.224492:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee200/0xad6b7ddc145d720 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b089 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.224535:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee200/0xad6b7ddc145d720 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b089 expref: 257 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.224544:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee200/0xad6b7ddc145d720 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b089 expref: 257 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.224558:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.224560:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065074.224563:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee200, rc 0) 00000100:00100000:0.0:1746065074.225094:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+257:27720:x1830881261090176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 633us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.225100:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11275 00000100:00100000:0.0:1746065074.230748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.232962:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.233017:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090432 00000100:00100000:0.0:1746065074.233020:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090432 00000100:00100000:0.0:1746065074.233058:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11276 00000100:00100000:0.0:1746065074.233063:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+257:27722:x1830881261090432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.233077:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.233089:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145d72e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b090 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.233145:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065074.233153:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233162:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233169:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065074.233175:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233180:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233212:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233217:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233222:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233228:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233232:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.233236:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233244:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233253:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508a00) 00010000:00010000:0.0:1746065074.233255:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.233258:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233263:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc145d735 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233273:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233277:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233281:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233286:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.233288:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233292:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233297:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008c508500) 00010000:00010000:0.0:1746065074.233298:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.233300:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233304:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc145d73c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.233325:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145d72e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b090 expref: 258 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.233332:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145d72e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b090 expref: 258 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.233342:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee400, rc 0) 00000100:00100000:0.0:1746065074.233367:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+257:27722:x1830881261090432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 304us (406us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065074.233373:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11276 00000100:00100000:0.0:1746065074.237655:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261090688 00000100:00100000:0.0:1746065074.237661:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261090688 00002000:00100000:0.0:1746065074.237697:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x30a:0x0] (0->4) req@ffff88009aec8e00 x1830881261090688/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:745/0 lens 496/0 e 0 to 0 dl 1746065085 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065074.237706:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8e00 with x1830881261090688 ext(0->4) 00010000:00010000:0.0:1746065074.237713:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc145d686 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b058 expref: 24 pid: 9550 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.237724:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc145d686 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b058 expref: 24 pid: 9550 timeout: 770 lvb_type: 0 00002000:00010000:0.0:1746065074.237730:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aec8e00 00000100:00100000:0.0:1746065074.237745:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 196 00000100:00100000:0.0:1746065074.237752:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261090688:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:0.0:1746065074.243969:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.244008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.255031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.255516:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.256090:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11280 00000100:00100000:0.0:1746065074.256097:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+259:27720:x1830881261091328:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065074.256118:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.256129:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee200/0xad6b7ddc145d720 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b089 expref: 259 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.256140:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.256143:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065074.256159:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145d77b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065074.256165:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145d77b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.256171:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc145d77b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:0.0:1746065074.256322:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2164, 88 off180008 00000004:00080000:0.0:1746065074.256328:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670274553735ns, next at 671134959236ns, rc = 0 00000040:00080000:0.0:1746065074.256358:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2169, 88 off180488 00000004:00080000:0.0:1746065074.256361:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670274587031ns, next at 671134937577ns, rc = 0 00010000:00010000:0.0:1746065074.261844:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.261851:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.261856:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.261864:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.261866:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.261871:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.261878:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008c508500) 00010000:00010000:0.0:1746065074.261880:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.261883:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.261887:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc145d712 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00000004:00080000:0.0:1746065074.263074:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc1f80/2, rc 0, transno 17179872230 00000100:00100000:0.0:1746065074.263078:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262532608:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.264900:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.265332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.273939:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.278160:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.283574:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.286822:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.289456:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.292210:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.296218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.299659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.302697:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.304972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.306971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.309041:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.309080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065074.313098:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974765 is committed 00000004:00080000:0.0:1746065074.313108:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1460 committed 00000004:00080000:0.0:1746065074.313554:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1470 committed 00000004:00080000:0.0:1746065074.313560:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1469 committed 00000004:00080000:0.0:1746065074.313562:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1459 committed 00000100:00100000:0.0:1746065074.314069:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262533248:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.314090:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.314236:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065074.314243:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262533632:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.314260:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.314280:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262533248 00000100:00100000:0.0:1746065074.314283:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262533248 00000100:00100000:0.0:1746065074.314297:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262533504 00000100:00100000:0.0:1746065074.314299:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262533504 00000100:00100000:0.0:1746065074.314307:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262533632 00000100:00100000:0.0:1746065074.314308:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262533632 00000100:00100000:0.0:1746065074.314317:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7863 00000100:00100000:0.0:1746065074.314321:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3762:x1830881262533248:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065074.314364:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x30a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065074.314366:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x30a:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.314368:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x30a:0x0] updating lvb atime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.314370:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x30a:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.314372:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x30a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065074.314401:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+23:3762:x1830881262533248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 80us (310us total) trans 21474839506 rc 0/0 00000100:00100000:0.0:1746065074.314409:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7863 00000100:00100000:0.0:1746065074.314419:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7864 00000100:00100000:0.0:1746065074.314422:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+56:3760:x1830881262533504:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065074.314472:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x30b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065074.314474:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x30b:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.314476:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x30b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065074.314477:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x30b:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.314479:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x30b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065074.314498:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+57:3760:x1830881262533504:12345-0@lo:2:osp-syn-1-1.0 Request processed in 75us (269us total) trans 17179872231 rc 0/0 00000100:00100000:0.0:1746065074.314502:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7864 00000100:00100000:0.0:1746065074.314512:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7865 00000100:00100000:0.0:1746065074.314516:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+56:3762:x1830881262533632:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.314602:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+57:3762:x1830881262533632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 85us (340us total) trans 17179872232 rc 0/0 00000100:00100000:0.0:1746065074.314617:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7865 00010000:00010000:0.0:1746065074.314857:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.314865:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.314870:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.314875:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.314878:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.314885:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.314894:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2e9:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065074.314896:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065074.314899:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065074.314903:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683bc00/0xad6b7ddc145d80e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065074.316650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.318633:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.321965:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065074.326899:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974767 is committed 00000004:00080000:0.0:1746065074.326912:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1472 committed 00000004:00080000:0.0:1746065074.326930:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1462 committed 00000004:00080000:0.0:1746065074.327086:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1461 committed 00000004:00080000:0.0:1746065074.327088:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1471 committed 00010000:00010000:0.0:1746065074.327139:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc400/0xad6b7ddc145d831 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b0eb expref: 251 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.327148:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2eb:0x0].0x0 (ffff880095561700) 00010000:00010000:0.0:1746065074.327151:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065074.327163:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145d82a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b0eb expref: 251 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065074.327180:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc400/0xad6b7ddc145d831 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b0eb expref: 250 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.327211:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2eb:0x0].0x0 (ffff880095561700) 00010000:00010000:0.0:1746065074.327213:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065074.327214:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc400, rc 0) 00000100:00100000:0.0:1746065074.327262:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+250:26180:x1830881261095040:12345-192.168.202.27@tcp:101:bash.0 Request processed in 8545us (8630us total) trans 4294974766 rc 0/0 00000100:00100000:0.0:1746065074.327269:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11291 00000100:00100000:0.0:1746065074.328384:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262533760 00000100:00100000:0.0:1746065074.328388:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262533760 00000100:00100000:0.0:1746065074.328404:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7868 00000100:00100000:0.0:1746065074.328408:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+58:3761:x1830881262533760:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.328474:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+59:3761:x1830881262533760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 66us (143us total) trans 17179872234 rc 0/0 00000100:00100000:0.0:1746065074.328479:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7868 00000100:00100000:0.0:1746065074.337768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.337826:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.342995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.347908:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.354670:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.364036:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.374352:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.374398:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.381555:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.381600:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.383576:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.384897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.385707:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.392172:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.396915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.402004:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.403438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.408441:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.411421:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.413554:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.413593:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.416963:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.423399:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.424046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.424103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.427340:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101184 00000100:00100000:0.0:1746065074.427346:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101184 00000100:00100000:0.0:1746065074.429225:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.432220:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261101568 00000100:00100000:0.0:1746065074.432226:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261101568 00000100:00100000:0.0:1746065074.432264:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11308 00000100:00100000:0.0:1746065074.432270:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27726:x1830881261101568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.432285:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.432304:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145d9a4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2ed:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b162 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.432378:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d9ab lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065074.432388:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d9ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.432396:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d9ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065074.432415:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2ed:0x0]: returning size 0 00000004:00200000:0.0:1746065074.432419:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065074.432429:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d9ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.432444:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc145d9a4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b162 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.432467:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc145d9ab lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b162 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.432473:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ed:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065074.432475:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065074.432478:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a200, rc 0) 00000100:00100000:0.0:1746065074.432510:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27726:x1830881261101568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 240us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.432515:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11308 00000100:00100000:0.0:1746065074.434722:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.438442:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261102464 00000100:00100000:0.0:1746065074.438447:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261102464 00000100:00100000:0.0:1746065074.438861:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11310 00000100:00100000:0.0:1746065074.438868:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27726:x1830881261102464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.438881:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.438895:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145d9c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b170 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.438954:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065074.438964:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.438972:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.438979:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065074.438984:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.438988:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439047:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065074.439054:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439059:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065074.439066:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2ed:0x0]: returning size 2 00010000:00010000:0.0:1746065074.439113:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439118:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439123:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439127:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.439130:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439135:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439142:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ed:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065074.439144:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065074.439147:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439151:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145d9d5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439161:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439165:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439169:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439172:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439175:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.439176:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439180:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439184:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508b00) 00010000:00010000:0.0:1746065074.439185:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.439187:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439191:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc145d9c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439196:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439201:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439205:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439208:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccc800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.439211:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439215:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439220:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561800) 00010000:00010000:0.0:1746065074.439221:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.439223:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439227:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145d9ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.439252:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145d9c0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b170 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.439259:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc145d9c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b170 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.439270:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ac00, rc 0) 00000100:00100000:0.0:1746065074.439306:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27726:x1830881261102464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 439us (1146us total) trans 4294974786 rc 301/301 00000100:00100000:0.0:1746065074.439311:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11310 00010000:00010000:0.0:1746065074.440010:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440016:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440021:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440024:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.440026:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440030:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440037:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561800) 00010000:00010000:0.0:1746065074.440038:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.440040:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440044:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145d893 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440053:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440060:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440064:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440067:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.440068:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440072:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440076:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561800) 00010000:00010000:0.0:1746065074.440077:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.440078:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440082:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc145d903 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.440091:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440094:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440098:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440101:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e26200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.440102:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440106:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440111:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ed:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065074.440113:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.440114:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.440117:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129e26200/0xad6b7ddc145d99d lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065074.440132:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262534656:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.440164:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.441928:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7881 00000100:00100000:0.0:1746065074.441934:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+26:3761:x1830881262535296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065074.441944:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:779 count 1 00002000:00010000:0.0:1746065074.441957:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065074.441960:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145da06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.441966:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.441967:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.441970:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145da06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.441976:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145da06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.441981:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145da06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.441987:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc145da06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.441992:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1746065074.442074:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:3761:x1830881262535296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 142us (1106us total) trans 21474839510 rc 0/0 00000100:00100000:0.0:1746065074.442078:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7881 00000100:00100000:0.0:1746065074.444987:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262535936:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.445014:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.445034:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065074.445039:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262536320:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.445054:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.445072:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262535936 00000100:00100000:0.0:1746065074.445075:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262535936 00000100:00100000:0.0:1746065074.445090:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262536320 00000100:00100000:0.0:1746065074.445092:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262536320 00000100:00100000:0.0:1746065074.445101:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7884 00000100:00100000:0.0:1746065074.445105:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3762:x1830881262535936:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065074.445117:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:780 count 1 00010000:00010000:0.0:1746065074.445127:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.445137:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc145d846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b100 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.445142:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065074.445143:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065074.445145:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.445165:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc145d846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b100 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.445174:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc145d846 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b100 expref: 27 pid: 9548 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.445182:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262536448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065074.445210:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.445221:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7885 00000100:00100000:0.0:1746065074.445225:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3762:x1830881262536320:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.445287:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3762:x1830881262536320:12345-0@lo:2:osp-syn-0-1.0 Request processed in 62us (232us total) trans 21474839514 rc 0/0 00000100:00100000:0.0:1746065074.445292:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7885 00000004:00080000:0.0:1746065074.445311:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e300/2, rc 0, transno 21474839514 00000100:00100000:0.0:1746065074.445314:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262536320:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065074.445320:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85f800/2, rc 0, transno 21474839513 00000100:00100000:0.0:1746065074.445322:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262534656:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.446106:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.447395:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.447430:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065074.449324:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065074.449329:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.449335:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065074.449338:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.449344:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.449354:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.449358:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc145da14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.449379:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065074.449380:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065074.449381:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065074.450332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.451368:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261103488 00000100:00100000:0.0:1746065074.451372:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261103488 00010000:00010000:0.0:1746065074.451387:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccd800/0xad6b7ddc145d973 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b146 expref: 29 pid: 1880 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746065074.451410:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3359 00000100:00100000:0.0:1746065074.451414:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261103488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.451421:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.451424:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099ccd800/0xad6b7ddc145d973 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b146 expref: 29 pid: 1880 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.451432:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099ccd800/0xad6b7ddc145d973 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b146 expref: 29 pid: 1880 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.451446:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.451448:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.451453:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc145da1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b177 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.451459:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc145da1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b177 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.451480:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc145da1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b177 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065074.451489:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262536704:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065074.451537:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.457578:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.462595:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.465986:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.467447:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.474287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.479890:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.486576:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.486635:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.489242:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.497000:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.497742:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261106048 00000100:00100000:0.0:1746065074.497745:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261106048 00010000:00010000:0.0:1746065074.497762:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145da84 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b19a expref: 258 pid: 7205 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.497877:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3362 00000100:00100000:0.0:1746065074.497884:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+258:2004:x1830881261106048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.497892:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.497896:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145da84 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b19a expref: 258 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.497905:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145da84 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b19a expref: 258 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.497917:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145da84 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b19a expref: 258 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.497928:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ed:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065074.497931:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145da99 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2ed:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.497937:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145da99 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2ed:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.497941:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145da99 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2ed:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.498223:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065074.498244:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+257:2004:x1830881261106048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 361us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.498252:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3362 00000100:00100000:0.0:1746065074.499282:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.501367:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.508012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.510244:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.512486:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.514684:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.516494:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065074.517640:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.517645:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.517649:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.517652:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.517654:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.517659:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.517665:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ed:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065074.517667:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065074.517669:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065074.517673:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145daed lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00000100:00100000:0.0:1746065074.517858:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262537728 00000100:00100000:0.0:1746065074.517861:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262537728 00000100:00100000:0.0:1746065074.517970:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262537600 00000100:00100000:0.0:1746065074.517973:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262537600 00000100:00100000:0.0:1746065074.517983:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262537472 00000100:00100000:0.0:1746065074.517985:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262537472 00000100:00100000:0.0:1746065074.517994:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7890 00000100:00100000:0.0:1746065074.518126:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+66:3761:x1830881262537728:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.518192:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+67:3761:x1830881262537728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 67us (523us total) trans 17179872244 rc 0/0 00000100:00100000:0.0:1746065074.518610:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7890 00000100:00100000:0.0:1746065074.520215:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.526382:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.526416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.529811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.530181:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.533413:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.534422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.535758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.536456:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.537206:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262538112 00000100:00100000:0.0:1746065074.537210:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262538112 00000100:00100000:0.0:1746065074.537228:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7896 00000100:00100000:0.0:1746065074.537232:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+67:11456:x1830881262538112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1746065074.537256:0:3068:0:(ofd_dev.c:1633:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 802 00000100:00100000:0.0:1746065074.538324:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+68:11456:x1830881262538112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1089us (1142us total) trans 17179872246 rc 0/0 00000100:00100000:0.0:1746065074.538334:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7896 00000100:00100000:0.0:1746065074.540089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.543355:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261108992 00000100:00100000:0.0:1746065074.543361:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261108992 00000100:00100000:0.0:1746065074.543394:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7897 00000100:00100000:0.0:1746065074.543400:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261108992:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065074.543512:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065074.543515:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.543517:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb atime from disk: 0 -> 1746065074 00002000:00010000:0.0:1746065074.543519:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.543520:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065074.543888:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261108992:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 486us (627us total) trans 21474839520 rc 0/0 00000100:00100000:0.0:1746065074.543895:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7897 00000100:00100000:0.0:1746065074.545350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.545918:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.550318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065074.554995:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555003:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555008:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555013:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555022:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b60400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.555025:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555030:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555038:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34c00) 00010000:00010000:0.0:1746065074.555041:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.555044:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555049:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145db80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555073:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555078:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555083:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555087:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b61e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.555089:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555093:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555113:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e1fc300) 00010000:00010000:0.0:1746065074.555115:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.555118:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555123:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61e00/0xad6b7ddc145db87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.555196:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61a00/0xad6b7ddc145db79 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1ee expref: 261 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.555211:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145db8e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1ee expref: 260 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.555217:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:0.0:1746065074.555219:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065074.555221:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:0.0:1746065074.555266:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+260:26180:x1830881261110016:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1726us (4953us total) trans 4294974801 rc 0/0 00000100:00100000:0.0:1746065074.555272:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11328 00010000:00010000:0.0:1746065074.558074:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558081:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558085:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558089:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.558091:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558095:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558101:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e1fc300) 00010000:00010000:0.0:1746065074.558103:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.558106:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558109:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145db41 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558124:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558128:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558137:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558141:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a656e400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.558142:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558147:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558153:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ed:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:0.0:1746065074.558155:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.558157:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.558161:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc145db6b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065074.558201:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540032:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.558221:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.558233:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065074.558237:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262539904:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.558250:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.558263:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262539904 00000100:00100000:0.0:1746065074.558265:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262539904 00000100:00100000:0.0:1746065074.558278:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7901 00000100:00100000:0.0:1746065074.558282:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+35:3760:x1830881262539904:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065074.558324:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065074.558326:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.558328:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb atime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.558330:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.558332:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x30e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065074.558348:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+35:3760:x1830881262539904:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (97us total) trans 21474839522 rc 0/0 00000100:00100000:0.0:1746065074.558353:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7901 00000004:00080000:0.0:1746065074.558370:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cf480/2, rc 0, transno 21474839522 00000100:00100000:0.0:1746065074.558374:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262539904:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065074.558380:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cd880/2, rc 0, transno 21474839521 00000100:00100000:0.0:1746065074.558382:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540032:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.558417:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.558441:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261110272 00000100:00100000:0.0:1746065074.558444:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261110272 00000100:00100000:0.0:1746065074.558459:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11329 00000100:00100000:0.0:1746065074.558464:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+250:26180:x1830881261110272:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065074.558474:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.558482:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145db9c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b1f5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.558504:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc145dba3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065074.558513:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc145dba3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.558519:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc145dba3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.558578:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145db9c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1f5 expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.558585:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc145dba3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1f5 expref: 251 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.558589:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:0.0:1746065074.558591:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065074.558592:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e600, rc 0) 00000100:00100000:0.0:1746065074.558627:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+251:26180:x1830881261110272:12345-192.168.202.27@tcp:101:bash.0 Request processed in 162us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.558632:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11329 00000100:00100000:0.0:1746065074.560047:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.560104:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.562076:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.562110:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.564832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065074.566527:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974805 is committed 00000004:00080000:0.0:1746065074.566534:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1480 committed 00000004:00080000:0.0:1746065074.566544:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1470 committed 00000004:00080000:0.0:1746065074.566627:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1469 committed 00000004:00080000:0.0:1746065074.566630:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1479 committed 00000100:00100000:0.0:1746065074.567247:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f2bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540544:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.568568:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.568591:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262541056:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.568620:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.568633:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065074.568637:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540416:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.568652:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.568660:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540928:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.568672:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.568688:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262541056 00000100:00100000:0.0:1746065074.568691:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262541056 00000100:00100000:0.0:1746065074.568704:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262540416 00000100:00100000:0.0:1746065074.568705:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262540416 00000100:00100000:0.0:1746065074.568712:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262540928 00000100:00100000:0.0:1746065074.568713:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262540928 00000100:00100000:0.0:1746065074.568723:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7908 00000100:00100000:0.0:1746065074.568728:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+73:3760:x1830881262540416:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.568806:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+74:3760:x1830881262540416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 78us (153us total) trans 17179872251 rc 0/0 00000100:00100000:0.0:1746065074.568813:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7908 00000004:00080000:0.0:1746065074.568845:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f2bf800/2, rc 0, transno 17179872251 00000100:00100000:0.0:1746065074.568849:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540416:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065074.568857:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f2bca80/2, rc 0, transno 17179872250 00000100:00100000:0.0:1746065074.568860:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f2bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540544:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065074.568867:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12a00/2, rc 0, transno 21474839524 00000100:00100000:0.0:1746065074.568870:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262541056:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065074.568978:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e13800/2, rc 0, transno 21474839525 00000100:00100000:0.0:1746065074.568982:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262540928:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.575709:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262541312:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065074.575723:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065074.576409:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f2be680/2, rc 0, transno 17179872252 00000100:00100000:0.0:1746065074.576414:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262540160:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.576912:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261111424 00000100:00100000:0.0:1746065074.576916:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261111424 00010000:00010000:0.0:1746065074.576935:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61c00/0xad6b7ddc145db2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1d9 expref: 31 pid: 9548 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746065074.576949:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3367 00000100:00100000:0.0:1746065074.576954:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261111424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.576960:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.576963:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61c00/0xad6b7ddc145db2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1d9 expref: 31 pid: 9548 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.576970:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61c00/0xad6b7ddc145db2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1d9 expref: 31 pid: 9548 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.576985:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61c00/0xad6b7ddc145db2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b1d9 expref: 31 pid: 9548 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.576996:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.576998:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.577000:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.577006:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.577016:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065074.577033:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261111424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.577037:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3367 00010000:00010000:0.0:1746065074.577050:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.577055:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.577061:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.577066:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc145dbe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.577078:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065074.580364:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3762:x1830881262540672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11911us (13456us total) trans 21474839526 rc 0/0 00000100:00100000:0.0:1746065074.580375:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7905 00000100:00100000:0.0:1746065074.583562:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261112064 00000100:00100000:0.0:1746065074.583569:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261112064 00000100:00100000:0.0:1746065074.583621:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7911 00000100:00100000:0.0:1746065074.583628:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:26180:x1830881261112064:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065074.583642:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.583658:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc145dbf7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b21f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065074.583679:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065074.583696:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.583697:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.583704:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc145dbf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b21f expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.583716:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc145dbf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b21f expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.583725:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:0.0:1746065074.583790:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:26180:x1830881261112064:12345-192.168.202.27@tcp:101:bash.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.583795:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7911 00000100:00100000:0.0:1746065074.599703:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.602622:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.603304:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.605562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.607825:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.613026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.616217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.621969:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.627583:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.632278:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.633204:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.635101:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.635640:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.635657:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115264 00000100:00100000:0.0:1746065074.635660:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115264 00000100:00100000:0.0:1746065074.635683:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11343 00000100:00100000:0.0:1746065074.635689:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+258:27732:x1830881261115264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.635698:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.635710:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc145dcb4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b250 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.635741:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065074.635747:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635753:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635760:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065074.635765:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635769:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635808:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635813:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635818:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635822:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635827:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.635829:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635834:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635840:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c508400) 00010000:00010000:0.0:1746065074.635843:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.635845:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635849:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc145dcbb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635861:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635866:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635870:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635874:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.635876:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635880:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635885:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:0.0:1746065074.635887:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.635889:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635894:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc145dcc2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.635912:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc145dcb4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b250 expref: 259 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.635918:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc145dcb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b250 expref: 259 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.635926:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7aca00, rc 0) 00000100:00100000:0.0:1746065074.635958:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+258:27732:x1830881261115264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 269us (318us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065074.635962:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11343 00000100:00100000:0.0:1746065074.637064:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262541952 00000100:00100000:0.0:1746065074.637068:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262541952 00000100:00100000:0.0:1746065074.637501:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1746065074.637511:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262541952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065074.637532:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445793792 avail 1316331520 00000100:00100000:0.0:1746065074.637561:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262541952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.638164:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00010000:00010000:0.0:1746065074.642896:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.642906:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.642913:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.642918:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b61600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.642923:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.642929:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.642942:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:0.0:1746065074.642944:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.642947:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065074.642951:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145dc7c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065074.642983:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262542336:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.643037:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.643169:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.643202:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262542080 00000100:00100000:1.0:1746065074.643204:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262542080 00000100:00100000:0.0:1746065074.643206:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7914 00000100:00100000:0.0:1746065074.643213:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262542208:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.643220:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7915 00000100:00100000:1.0:1746065074.643224:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3762:x1830881262542080:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.643274:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262542208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 61us (219us total) trans 17179872256 rc 0/0 00000100:00100000:0.0:1746065074.643279:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7914 00000004:00080000:0.0:1746065074.643299:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cfb80/2, rc 0, transno 17179872255 00000100:00100000:0.0:1746065074.643303:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262542336:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065074.643866:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x310:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065074.643869:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x310:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:1.0:1746065074.643871:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x310:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065074.643873:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x310:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:1.0:1746065074.643874:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x310:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065074.644077:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+41:3762:x1830881262542080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 852us (907us total) trans 21474839528 rc 0/0 00000100:00100000:1.0:1746065074.644084:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7915 00000004:00080000:1.0:1746065074.644110:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd1c00/2, rc 0, transno 21474839528 00000100:00100000:1.0:1746065074.644114:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262542080:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.645659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.645728:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.646377:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115520 00000100:00100000:1.0:1746065074.646384:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115520 00000100:00100000:1.0:1746065074.646412:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261115648 00000100:00100000:1.0:1746065074.646414:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261115648 00000100:00100000:1.0:1746065074.646433:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11346 00000100:00100000:1.0:1746065074.646439:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+252:27730:x1830881261115648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.646450:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.646460:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b265 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.646498:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b265 expref: 254 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.646508:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b265 expref: 254 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.646522:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:1.0:1746065074.646524:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065074.646526:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ba00, rc 0) 00000100:00100000:1.0:1746065074.646561:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+254:27730:x1830881261115648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 123us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.646566:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11346 00000100:00100000:1.0:1746065074.654043:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881262542592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065074.654079:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.654123:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262542592 00000100:00100000:0.0:1746065074.654128:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262542592 00000100:00100000:0.0:1746065074.654157:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1746065074.654163:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881262542592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065074.654175:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490223424 pending 86016 free 3919237120 avail 3687714816 00000100:00100000:0.0:1746065074.654204:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881262542592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.654209:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1746065074.654310:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881262542592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065074.656253:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261116160 00000100:00100000:1.0:1746065074.656257:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261116160 00000100:00100000:1.0:1746065074.656289:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7917 00000100:00100000:1.0:1746065074.656293:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261116160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.656302:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.656311:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc145dd24 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b27a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065074.656328:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x311:0x0] initial LVB size: 5, mtime: 0x6812d6b2, atime: 0x0, ctime: 0x6812d6b2, blocks: 0x8 00010000:00010000:1.0:1746065074.656339:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.656340:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.656346:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc145dd24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b27a expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065074.656355:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc145dd24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b27a expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065074.656367:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51a800, rc 0) 00000100:00100000:1.0:1746065074.656386:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261116160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.656391:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7917 00000100:00100000:0.0:1746065074.669490:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.669567:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.669718:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261116800 00000100:00100000:1.0:1746065074.669724:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261116800 00000100:00100000:1.0:1746065074.669767:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7919 00000100:00100000:1.0:1746065074.669795:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261116800:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065074.670384:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261116800:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 609us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.670391:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7919 00010000:00010000:0.0:1746065074.671749:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.671756:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065074.671797:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f1:0x0]: returning size 0 00000004:00080000:0.0:1746065074.672037:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x312:0x0], index 0: 0 00000004:00080000:0.0:1746065074.672042:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x313:0x0], index 1: 0 00000004:00080000:0.0:1746065074.672045:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x314:0x0], index 1: 0 00000004:00080000:0.0:1746065074.672048:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x313:0x0], index 0: 0 00010000:00010000:0.0:1746065074.672134:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672140:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672144:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672148:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.672151:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672157:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672165:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065074.672167:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065074.672170:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672174:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc145dd32 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.672211:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc145dd2b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b281 expref: 256 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.672221:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc145dd2b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b281 expref: 256 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.672231:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31a00, rc 0) 00000100:00100000:0.0:1746065074.672254:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+255:27732:x1830881261116416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7716us (8014us total) trans 4294974814 rc 301/301 00000100:00100000:0.0:1746065074.672259:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11349 00000100:00100000:1.0:1746065074.673609:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262542848 00000100:00100000:1.0:1746065074.673615:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262542848 00000100:00100000:1.0:1746065074.673647:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7920 00000100:00100000:1.0:1746065074.673653:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+41:10212:x1830881262542848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1746065074.673686:0:3067:0:(ofd_dev.c:1633:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 802 00000100:00100000:0.0:1746065074.675056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.677185:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+42:10212:x1830881262542848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 3529us (4528us total) trans 21474839530 rc 0/0 00000100:00100000:1.0:1746065074.677199:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7920 00000100:00100000:0.0:1746065074.677955:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.678003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.679496:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261117568 00000100:00100000:1.0:1746065074.679501:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261117568 00000100:00100000:1.0:1746065074.679532:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11350 00000100:00100000:1.0:1746065074.679538:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+257:27730:x1830881261117568:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065074.679565:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.679587:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145dcfa lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2ef:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b26c expref: 257 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.679621:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:1.0:1746065074.679626:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065074.679647:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc145dd40 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.679657:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc145dd40 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.679664:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc145dd40 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065074.679730:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880076cf6d80 reply state ffff88009a901000 transno 4294974817 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc145dd40 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.679738:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc145dd40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2ef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.679742:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:1.0:1746065074.679745:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065074.679747:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065074.679817:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+258:27730:x1830881261117568:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 278us (1813us total) trans 4294974817 rc 0/0 00000100:00100000:1.0:1746065074.679823:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11350 00000100:00100000:1.0:1746065074.683268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.683551:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261117696 00000100:00100000:0.0:1746065074.683556:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261117696 00000100:00100000:0.0:1746065074.683589:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7921 00000100:00100000:0.0:1746065074.683594:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261117696:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065074.683684:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x311:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065074.683687:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x311:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.683689:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x311:0x0] updating lvb atime from disk: 0 -> 1746065074 00002000:00010000:0.0:1746065074.683691:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x311:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:0.0:1746065074.683693:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x311:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065074.683730:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261117696:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 135us (498us total) trans 17179872257 rc 0/0 00000100:00100000:0.0:1746065074.683736:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7921 00000100:00100000:1.0:1746065074.684962:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262542976 00000100:00100000:1.0:1746065074.684966:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262542976 00000100:00100000:1.0:1746065074.684989:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1746065074.684994:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262542976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746065074.685005:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490194752 pending 57344 free 3920257024 avail 3688734720 00000100:00100000:1.0:1746065074.685033:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262542976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.685038:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1746065074.698503:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118208 00000100:00100000:0.0:1746065074.698511:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118208 00000100:00100000:0.0:1746065074.698552:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3902 00000100:00100000:0.0:1746065074.698559:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27730:x1830881261118208:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065074.698615:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x2ef:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dc67 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b23b expref: 261 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.698648:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065074.698658:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b265 expref: 262 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.698665:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.698686:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b265 expref: 262 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.698694:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b265 expref: 262 pid: 7204 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.698703:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262543104:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065074.699630:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065074.704723:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261118592 00000100:00100000:1.0:1746065074.704727:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261118592 00000100:00100000:1.0:1746065074.704755:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11353 00000100:00100000:1.0:1746065074.704760:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261118592:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065074.704813:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.704825:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc145dd5c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b288 expref: 263 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.704840:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880095561500) 00010000:00010000:1.0:1746065074.704843:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065074.704978:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc145dd7f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.704986:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc145dd7f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.704992:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc145dd7f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:1.0:1746065074.705020:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974819 00000004:00010000:1.0:1746065074.705036:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880137345880 reply state ffff88009a900000 transno 4294974820 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc145dd7f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.705043:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc145dd7f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.705048:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880095561500) 00010000:00010000:1.0:1746065074.705051:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065074.705053:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065074.705094:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261118592:12345-192.168.202.27@tcp:36:bash.0 Request processed in 333us (570us total) trans 4294974820 rc 0/0 00000100:00100000:1.0:1746065074.705099:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11353 00000020:00080000:1.0:1746065074.705103:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1746065074.705308:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc145dcd7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b265 expref: 263 pid: 7204 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.705322:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262543104:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065074.705337:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.705343:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.705348:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000040:00080000:0.0:1746065074.705477:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2191, 88 off182280 00000004:00080000:0.0:1746065074.705481:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670723707543ns, next at 671134937577ns, rc = 0 00000040:00080000:0.0:1746065074.705506:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2187, 88 off181840 00000004:00080000:0.0:1746065074.705509:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670723735765ns, next at 671134959236ns, rc = 0 00000040:00080000:0.0:1746065074.705534:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2188, 88 off181928 00000004:00080000:0.0:1746065074.705537:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670723763611ns, next at 671134959236ns, rc = 0 00000040:00080000:0.0:1746065074.705545:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2192, 88 off182368 00000004:00080000:0.0:1746065074.705547:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670723773623ns, next at 671134937577ns, rc = 0 00000001:00080000:0.0:1746065074.707848:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974821 is committed 00000004:00080000:0.0:1746065074.707856:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1484 committed 00000100:00100000:1.0:1746065074.709186:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065074.709199:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262543360:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.709243:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.709287:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262543360 00000100:00100000:1.0:1746065074.709292:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262543360 00000100:00100000:1.0:1746065074.709326:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7922 00000100:00100000:1.0:1746065074.709332:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+76:3762:x1830881262543360:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.709455:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+77:3762:x1830881262543360:12345-0@lo:2:osp-syn-1-1.0 Request processed in 123us (211us total) trans 17179872258 rc 0/0 00000100:00100000:1.0:1746065074.709460:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7922 00000004:00080000:1.0:1746065074.709489:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3e680/2, rc 0, transno 17179872258 00000100:00100000:1.0:1746065074.709492:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262543360:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065074.709548:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1474 committed 00000004:00080000:0.0:1746065074.709554:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1473 committed 00000004:00080000:0.0:1746065074.709555:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1483 committed 00000100:00100000:0.0:1746065074.709580:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262543232:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.709612:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1746065074.709649:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b27c50 reply state ffff880098589c00 transno 4294974821 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.709659:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc145dd78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.709664:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:0.0:1746065074.709666:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065074.709669:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065074.709673:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff880098c34a00) 00010000:00010000:0.0:1746065074.709675:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065074.709680:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dc67 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b23b expref: 251 pid: 7231 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065074.711277:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065074.711292:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+251:27730:x1830881261118208:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 12732us (12861us total) trans 4294974821 rc 0/0 00000100:00100000:0.0:1746065074.711299:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3902 00000004:00080000:0.0:1746065074.711335:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3c380/2, rc 0, transno 17179872259 00000100:00100000:0.0:1746065074.711339:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262543232:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.716769:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.719056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.719501:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11356 00000100:00100000:1.0:1746065074.719509:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+251:27730:x1830881261119232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.719522:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.719535:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6de00/0xad6b7ddc145dd8d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b2a4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.719582:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6de00/0xad6b7ddc145dd8d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2a4 expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.719592:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6de00/0xad6b7ddc145dd8d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2ef:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2a4 expref: 252 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.719616:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff88012d56c300) 00010000:00010000:1.0:1746065074.719619:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065074.719621:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6de00, rc 0) 00000100:00100000:1.0:1746065074.719663:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+252:27730:x1830881261119232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 156us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.719669:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11356 00000100:00100000:0.0:1746065074.729624:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261119488 00000100:00100000:0.0:1746065074.729632:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261119488 00000100:00100000:0.0:1746065074.729669:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3903 00000100:00100000:0.0:1746065074.729676:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+254:27730:x1830881261119488:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065074.729885:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x2ef:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065074.729930:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2195, 64 off182608 00000040:00080000:0.0:1746065074.729944:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2191, 64 off182168 00000040:00080000:0.0:1746065074.729951:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2192, 64 off182232 00000040:00080000:0.0:1746065074.729959:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2196, 64 off182672 00010000:00010000:0.0:1746065074.730002:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065074.730014:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.730023:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.730029:0:7206:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.730034:0:7206:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.730038:0:7206:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.730053:0:7206:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065074.730186:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+255:27730:x1830881261119488:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 510us (694us total) trans 4294974823 rc 0/0 00000100:00100000:0.0:1746065074.730193:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3903 00010000:00010000:1.0:1746065074.730370:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065074.730376:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.730381:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b60400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.730385:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.730390:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.730400:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2ef:0x0].0x0 (ffff88012d56c300) 00010000:00010000:1.0:1746065074.730402:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065074.730405:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.730410:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b60400/0xad6b7ddc145dda2 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.730422:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.730424:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.730425:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746065074.731054:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974822 is committed 00000004:00080000:0.0:1746065074.731060:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1476 committed 00000004:00080000:0.0:1746065074.731320:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1486 committed 00000004:00080000:0.0:1746065074.731361:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1485 committed 00000004:00080000:0.0:1746065074.731363:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1475 committed 00000100:00100000:0.0:1746065074.732307:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262543744:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.732330:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.732420:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262543744 00000100:00100000:1.0:1746065074.732423:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262543744 00000100:00100000:1.0:1746065074.732445:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7928 00000100:00100000:1.0:1746065074.732449:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+78:3760:x1830881262543744:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.732521:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+79:3760:x1830881262543744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 71us (189us total) trans 17179872260 rc 0/0 00000100:00100000:1.0:1746065074.732526:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7928 00000004:00080000:0.0:1746065074.732583:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3dc00/2, rc 0, transno 17179872260 00000100:00100000:0.0:1746065074.732589:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262543744:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.732594:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065074.732598:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262544128:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.732625:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.733072:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262544128 00000100:00100000:1.0:1746065074.733075:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262544128 00000100:00100000:1.0:1746065074.733092:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7929 00000100:00100000:1.0:1746065074.733096:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+79:3760:x1830881262544128:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.733158:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+80:3760:x1830881262544128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 62us (532us total) trans 17179872261 rc 0/0 00000100:00100000:1.0:1746065074.733163:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7929 00000004:00080000:0.0:1746065074.733263:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ce00/2, rc 0, transno 17179872261 00000100:00100000:0.0:1746065074.733268:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262544128:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.745461:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.748031:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.750240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.754669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.754959:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.760441:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.764568:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.773012:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.775394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.779989:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065074.780503:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780510:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:0.0:1746065074.780818:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x2f1:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1746065074.780903:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780912:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780917:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780922:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.780926:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780932:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780940:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880095561500) 00010000:00010000:0.0:1746065074.780943:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065074.780947:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780951:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145ddf6 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780980:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780986:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780990:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780994:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.780998:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.781000:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.781005:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.781012:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34800) 00010000:00010000:0.0:1746065074.781014:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.781016:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.781020:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145dde8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:0.0:1746065074.781031:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135220e00 reply state ffff88009ae65000 transno 4294974828 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719a00/0xad6b7ddc145ddef lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.781043:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719a00/0xad6b7ddc145ddef lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.781047:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34d00) 00010000:00010000:0.0:1746065074.781049:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065074.781051:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065074.781096:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+257:27734:x1830881261121280:12345-192.168.202.27@tcp:36:rm.0 Request processed in 5576us (5704us total) trans 4294974828 rc 0/0 00000100:00100000:0.0:1746065074.781103:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11359 00000100:00100000:0.0:1746065074.785847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.788961:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.790421:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.793586:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.796761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.796849:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261122176 00000100:00100000:0.0:1746065074.797013:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261122176 00000100:00100000:0.0:1746065074.797297:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11363 00000100:00100000:0.0:1746065074.797305:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27735:x1830881261122176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.797325:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.797342:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145de43 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b2dc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.797397:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065074.797407:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797416:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797429:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065074.797434:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797439:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797469:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797475:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797480:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797485:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797489:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.797492:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797497:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797505:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2ac00) 00010000:00010000:0.0:1746065074.797508:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.797511:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797516:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc145de4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797545:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797551:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797555:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797559:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.797561:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797565:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797571:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34d00) 00010000:00010000:0.0:1746065074.797573:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.797575:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797579:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc145de51 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.797612:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145de43 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2dc expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.797619:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61400/0xad6b7ddc145de43 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2dc expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.797629:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:0.0:1746065074.797676:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27735:x1830881261122176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 372us (921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065074.797683:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11363 00000100:00100000:1.0:1746065074.799158:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.800753:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.803029:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065074.804690:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804697:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804713:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804719:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804725:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804730:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065074.804733:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804739:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804749:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.804758:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c719600/0xad6b7ddc145de3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065074.804828:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261122048:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 11110us (11246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.804835:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7932 00000001:00080000:0.0:1746065074.812834:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974830 is committed 00000004:00080000:0.0:1746065074.812841:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1478 committed 00000004:00080000:0.0:1746065074.812851:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1488 committed 00000004:00080000:0.0:1746065074.812860:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1487 committed 00000004:00080000:0.0:1746065074.812862:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1477 committed 00000100:00100000:1.0:1746065074.813533:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262545280:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.813551:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.813565:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065074.813569:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262545408:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.813586:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.813612:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262545280 00000100:00100000:1.0:1746065074.813615:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262545280 00000100:00100000:1.0:1746065074.814137:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7936 00000100:00100000:1.0:1746065074.814143:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+49:3761:x1830881262544768:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.814209:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+50:3761:x1830881262544768:12345-0@lo:2:osp-syn-0-1.0 Request processed in 67us (1042us total) trans 21474839538 rc 0/0 00000100:00100000:1.0:1746065074.814215:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7936 00000100:00100000:1.0:1746065074.814225:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7937 00000100:00100000:1.0:1746065074.814229:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+81:3761:x1830881262545408:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065074.816271:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x313:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065074.816274:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x313:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:1.0:1746065074.816276:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x313:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065074.816278:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x313:0x0] updating lvb ctime from disk: 1746065074 -> 1746065074 00002000:00010000:1.0:1746065074.816280:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x313:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065074.816302:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+84:3761:x1830881262545408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2073us (2715us total) trans 17179872263 rc 0/0 00000100:00100000:1.0:1746065074.816307:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7937 00000004:00080000:1.0:1746065074.816329:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4fb800/2, rc 0, transno 17179872263 00000100:00100000:1.0:1746065074.816332:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262545408:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065074.816337:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4faa00/2, rc 0, transno 17179872264 00000100:00100000:1.0:1746065074.816340:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262545280:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065074.816347:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e52d80/2, rc 0, transno 21474839538 00000100:00100000:1.0:1746065074.816349:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262544768:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065074.816355:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cf800/2, rc 0, transno 21474839539 00000100:00100000:1.0:1746065074.816357:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262544640:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065074.822255:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065074.822260:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145de82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822267:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.822270:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145de82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822281:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145de82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822293:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145de82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822298:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145de82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822315:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065074.822317:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc145de97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822322:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.822324:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc145de97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822330:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc145de97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822337:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc145de97 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822342:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc145de97 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.822356:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.822358:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.822359:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065074.824107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.824143:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.830329:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.830370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.830482:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261124096 00000100:00100000:1.0:1746065074.830488:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261124096 00000100:00100000:1.0:1746065074.830581:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11370 00000100:00100000:1.0:1746065074.830590:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+257:27733:x1830881261124096:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.830617:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.830630:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145ded6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b306 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.830687:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145dedd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065074.830698:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145dedd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065074.830705:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145dedd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065074.830950:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f1:0x0]: returning size 5 00000004:00200000:1.0:1746065074.830955:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065074.830971:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145dedd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065074.831076:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145ded6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b306 expref: 259 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.831091:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145dedd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b306 expref: 258 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.831101:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065074.831103:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065074.831105:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a528800, rc 0) 00000100:00100000:1.0:1746065074.831458:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+257:27733:x1830881261124096:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 869us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.831464:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11370 00000100:00100000:0.0:1746065074.834749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.835010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.837233:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.838833:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.841879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.843964:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.845339:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.847107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.847147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.847197:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261125760 00000100:00100000:1.0:1746065074.847203:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261125760 00000100:00100000:1.0:1746065074.847240:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261125888 00000100:00100000:1.0:1746065074.847242:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261125888 00000100:00100000:1.0:1746065074.847254:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11373 00000100:00100000:1.0:1746065074.847259:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:26180:x1830881261125760:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065074.847286:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.847300:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130113600/0xad6b7ddc145df07 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b314 expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.847315:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72a00) 00010000:00010000:1.0:1746065074.847318:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065074.847434:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065074.847442:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065074.847449:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:1.0:1746065074.847473:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974836 00000004:00010000:1.0:1746065074.847486:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f09ce00 reply state ffff88009a903000 transno 4294974837 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065074.847492:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065074.847497:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72a00) 00010000:00010000:1.0:1746065074.847499:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065074.847501:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065074.847543:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:26180:x1830881261125760:12345-192.168.202.27@tcp:36:bash.0 Request processed in 283us (440us total) trans 4294974837 rc 0/0 00000100:00100000:1.0:1746065074.847549:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11373 00000020:00080000:1.0:1746065074.847552:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065074.849327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.850062:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.852958:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.853002:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.853179:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126528 00000100:00100000:1.0:1746065074.853183:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126528 00000100:00100000:1.0:1746065074.853207:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11376 00000100:00100000:1.0:1746065074.853212:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+265:26180:x1830881261126528:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065074.853226:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.853228:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065074.853624:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145df31 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b322 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.853635:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72a00) 00010000:00010000:1.0:1746065074.853638:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065074.853647:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145df3f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b330 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.853678:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145df46 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065074.853919:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145df46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065074.853928:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145df46 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:1.0:1746065074.854110:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2199, 88 off182936 00000004:00080000:1.0:1746065074.854115:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670872341498ns, next at 671134937577ns, rc = 0 00000040:00080000:1.0:1746065074.854156:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2195, 88 off182496 00000004:00080000:1.0:1746065074.854159:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670872385899ns, next at 671134959236ns, rc = 0 00000040:00080000:1.0:1746065074.854178:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2196, 88 off182584 00000004:00080000:1.0:1746065074.854182:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 670872408210ns, next at 671134959236ns, rc = 0 00000040:00080000:1.0:1746065074.854190:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2200, 88 off183024 00000004:00080000:1.0:1746065074.854192:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 670872418940ns, next at 671134937577ns, rc = 0 00010000:00010000:0.0:1746065074.855878:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855886:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855892:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855897:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.855900:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855906:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855916:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72500) 00010000:00010000:0.0:1746065074.855919:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.855921:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855925:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145deac lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855945:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855950:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855954:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855962:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.855964:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855969:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855974:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72a00) 00010000:00010000:0.0:1746065074.855976:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.855978:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855982:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145df23 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065074.855991:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855995:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.855999:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.856002:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.856004:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.856008:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.856013:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097e34800) 00010000:00010000:0.0:1746065074.856015:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.856018:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.856021:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145df2a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065074.856038:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262546176:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.856093:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.856114:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065074.856118:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262546560:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.856134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065074.856152:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262546176 00000100:00100000:0.0:1746065074.856157:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262546176 00000100:00100000:0.0:1746065074.856178:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262546560 00000100:00100000:0.0:1746065074.856179:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262546560 00000100:00100000:0.0:1746065074.856190:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7945 00000100:00100000:0.0:1746065074.856195:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+84:3760:x1830881262546176:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.856953:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262546304:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.856976:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.857312:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065074.857317:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262546432:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.857332:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065074.857376:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145df46 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b330 expref: 255 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.857383:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72a00) 00010000:00010000:1.0:1746065074.857385:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065074.857394:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145df3f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2f3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b330 expref: 255 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065074.857404:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145df46 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b330 expref: 254 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.857426:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72a00) 00010000:00010000:1.0:1746065074.857428:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065074.857430:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:1.0:1746065074.857464:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+254:26180:x1830881261126528:12345-192.168.202.27@tcp:101:bash.0 Request processed in 4251us (4461us total) trans 4294974839 rc 0/0 00000100:00100000:1.0:1746065074.857470:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11376 00000004:00080000:1.0:1746065074.858282:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d15500/2, rc 0, transno 21474839542 00000100:00100000:1.0:1746065074.858286:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262546432:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065074.858294:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d17b80/2, rc 0, transno 17179872267 00000100:00100000:1.0:1746065074.858297:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262546304:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.858301:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+86:3760:x1830881262546176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2106us (2209us total) trans 17179872268 rc 0/0 00000100:00100000:0.0:1746065074.858307:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7945 00000100:00100000:0.0:1746065074.859502:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262546048:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065074.859516:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065074.859541:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261126272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6474us (6588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.859548:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3379 00000100:00100000:1.0:1746065074.859566:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126656 00000100:00100000:1.0:1746065074.859569:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126656 00000100:00100000:1.0:1746065074.859606:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7949 00000100:00100000:1.0:1746065074.859612:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261126656:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065074.860068:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x312:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065074.860071:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x312:0x0] updating lvb mtime from disk: 1746065074 -> 1746065074 00002000:00010000:1.0:1746065074.860073:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x312:0x0] updating lvb atime from disk: 0 -> 1746065074 00002000:00010000:1.0:1746065074.860074:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x312:0x0] updating lvb ctime from disk: 1746065074 -> 1746065075 00002000:00010000:1.0:1746065074.860076:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x312:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065074.860732:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261126656:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 1117us (1208us total) trans 21474839543 rc 0/0 00000100:00100000:1.0:1746065074.860737:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7949 00000100:00100000:0.0:1746065074.861143:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.861282:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261126784 00000100:00100000:1.0:1746065074.861285:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261126784 00000100:00100000:1.0:1746065074.861305:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7950 00000100:00100000:1.0:1746065074.861310:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+41:26180:x1830881261126784:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065074.861321:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.861334:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719000/0xad6b7ddc145df4d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b337 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065074.861350:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065074.861364:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.861365:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.861371:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719000/0xad6b7ddc145df4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b337 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.861382:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c719000/0xad6b7ddc145df4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b337 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.861389:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719000, rc 0) 00000100:00100000:1.0:1746065074.861420:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:26180:x1830881261126784:12345-192.168.202.27@tcp:101:bash.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.861425:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7950 00000100:00100000:0.0:1746065074.863023:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.863066:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.863171:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127168 00000100:00100000:1.0:1746065074.863175:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127168 00000100:00100000:1.0:1746065074.863201:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7951 00000100:00100000:1.0:1746065074.863207:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+36:26180:x1830881261127168:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065074.863215:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.863227:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145df54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b33e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065074.863244:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065074.863256:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.863258:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.863263:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145df54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b33e expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.863274:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718e00/0xad6b7ddc145df54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b33e expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.863281:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718e00, rc 0) 00000100:00100000:1.0:1746065074.863316:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261127168:12345-192.168.202.27@tcp:101:bash.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.863321:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7951 00000100:00100000:0.0:1746065074.865714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.865744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.865802:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.866173:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127552 00000100:00100000:1.0:1746065074.866177:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127552 00010000:00010000:1.0:1746065074.866198:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc145dec8 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2ff expref: 255 pid: 7203 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746065074.866215:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3380 00000100:00100000:1.0:1746065074.866220:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+255:2004:x1830881261127552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065074.866227:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.866232:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc145dec8 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2ff expref: 255 pid: 7203 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.866240:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc145dec8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2ff expref: 255 pid: 7203 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.866253:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc145dec8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2ff expref: 255 pid: 7203 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.866268:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065074.866272:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.866278:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.866283:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.866295:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065074.866508:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+254:2004:x1830881261127552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 286us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.866514:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3380 00000100:00100000:0.0:1746065074.869858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.872295:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262546944:0@lo:2:osp-syn-1-1.0 00000004:00010000:1.0:1746065074.872363:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b27850 reply state ffff880134bd0400 transno 4294974840 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.872378:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.872385:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065074.872388:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065074.872391:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065074.872394:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262547200 00000100:00100000:0.0:1746065074.872400:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262547200 00000100:00100000:0.0:1746065074.872523:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7953 00000100:00100000:0.0:1746065074.872528:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+86:3759:x1830881262547200:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.872627:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+87:3759:x1830881262547200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 98us (286us total) trans 17179872270 rc 0/0 00000100:00100000:0.0:1746065074.872633:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7953 00010000:00010000:1.0:1746065074.872726:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065074.872729:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065074.872734:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718600/0xad6b7ddc145de19 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2ce expref: 253 pid: 7203 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065074.873037:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065074.873053:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+253:27733:x1830881261127040:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 9875us (10033us total) trans 4294974840 rc 0/0 00000100:00100000:1.0:1746065074.873059:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3908 00000100:00100000:1.0:1746065074.873099:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065074.873353:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.873361:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.873367:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.873372:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.873375:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.873381:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.873390:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff880097e34800) 00010000:00010000:0.0:1746065074.873392:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065074.873394:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065074.873399:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145df5b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00000004:00080000:1.0:1746065074.873731:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098665f80/2, rc 0, transno 17179872271 00000100:00100000:1.0:1746065074.873735:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262546944:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.873743:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065074.873747:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262547072:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.873765:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065074.877500:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d16a00/2, rc 0, transno 21474839546 00000100:00100000:1.0:1746065074.877506:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262547072:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.879420:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261127936 00000100:00100000:1.0:1746065074.879427:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261127936 00000100:00100000:1.0:1746065074.879524:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11377 00000100:00100000:1.0:1746065074.879532:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+252:27733:x1830881261127936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.879552:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.879569:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719600/0xad6b7ddc145df62 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b345 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.879624:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719600/0xad6b7ddc145df62 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b345 expref: 253 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.879636:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719600/0xad6b7ddc145df62 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b345 expref: 253 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.879650:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f1:0x0].0x0 (ffff88012d56cd00) 00010000:00010000:1.0:1746065074.879653:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065074.879656:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719600, rc 0) 00000100:00100000:1.0:1746065074.883186:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+253:27733:x1830881261127936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3645us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.883195:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11377 00000100:00100000:0.0:1746065074.883536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.886268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.888117:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261128320 00000100:00100000:1.0:1746065074.888125:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261128320 00000100:00100000:1.0:1746065074.888166:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3910 00000100:00100000:1.0:1746065074.888172:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+254:27733:x1830881261128320:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065074.888347:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x2f1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065074.888387:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2199, 64 off182824 00000040:00080000:1.0:1746065074.888401:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2203, 64 off183264 00000040:00080000:1.0:1746065074.888407:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2204, 64 off183328 00000040:00080000:1.0:1746065074.888413:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2200, 64 off182888 00010000:00010000:1.0:1746065074.888450:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145df85 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065074.888461:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145df85 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.888468:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145df85 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.888474:0:7206:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145df85 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.888478:0:7206:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145df85 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.888483:0:7206:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145df85 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065074.888504:0:7206:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065074.888835:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+255:27733:x1830881261128320:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 662us (2571us total) trans 4294974842 rc 0/0 00000100:00100000:1.0:1746065074.888841:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3910 00000100:00100000:0.0:1746065074.891664:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065074.892372:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065074.892377:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145dfa1 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.892383:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.892393:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145dfa1 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.892398:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145dfa1 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.892404:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f3:0x0].0x0 (ffff880097b72f00) 00010000:00010000:1.0:1746065074.892406:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065074.892408:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145dfa1 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.892411:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145dfa1 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2f3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.892421:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.892422:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.892423:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065074.898885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.902262:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.906987:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.908900:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.910497:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.912038:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11384 00000100:00100000:1.0:1746065074.912046:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+256:27738:x1830881261129344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.912053:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.912059:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145dffc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b36f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.912085:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145e003 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.912090:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145e003 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.912096:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145e003 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065074.912126:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065074.912130:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065074.912150:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145dffc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b36f expref: 257 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.912165:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145e003 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b36f expref: 256 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.912170:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065074.912172:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065074.912174:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:1.0:1746065074.913303:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+255:27738:x1830881261129344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1257us (2807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.913308:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11384 00000100:00100000:1.0:1746065074.916737:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261129600 00000100:00100000:1.0:1746065074.916744:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261129600 00000100:00100000:1.0:1746065074.916885:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11385 00000100:00100000:1.0:1746065074.916893:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+255:27738:x1830881261129600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.916909:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.916912:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065074.916933:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719800/0xad6b7ddc145e003 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b36f expref: 255 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.916947:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065074.916955:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065074.916966:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718600/0xad6b7ddc145e00a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b376 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.917047:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.917055:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917062:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917071:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.917076:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917081:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917340:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.917347:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917352:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065074.917360:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f5:0x0]: returning size 0 00010000:00010000:1.0:1746065074.917378:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917382:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917387:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917391:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917395:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065074.917398:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917403:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917409:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c000) 00010000:00010000:1.0:1746065074.917411:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065074.917414:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917418:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e011 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065074.917426:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135221c00 reply state ffff88009a7dc000 transno 4294974844 ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917432:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.917439:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72300) 00010000:00010000:1.0:1746065074.917441:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065074.917443:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065074.917461:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718600/0xad6b7ddc145e00a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b376 expref: 257 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.917474:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b376 expref: 256 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.917480:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065074.917482:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065074.917483:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a529400, rc 0) 00000100:00100000:1.0:1746065074.917523:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+257:27738:x1830881261129600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 632us (873us total) trans 4294974844 rc 0/0 00000100:00100000:1.0:1746065074.917529:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11385 00000100:00100000:0.0:1746065074.920031:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.920866:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.921102:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130112 00000100:00100000:1.0:1746065074.921107:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130112 00000100:00100000:1.0:1746065074.921130:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11387 00000100:00100000:1.0:1746065074.921135:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+259:27739:x1830881261130112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.921145:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.921156:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e03b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b384 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.921201:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.921209:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921220:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065074.921229:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f5:0x0]: returning size 0 00010000:00010000:1.0:1746065074.921294:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921300:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921305:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921309:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065074.921313:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921318:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921326:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065074.921329:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065074.921332:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921336:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc145e042 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.921450:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e03b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b384 expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.921457:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e03b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b384 expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.921466:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:1.0:1746065074.921504:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27739:x1830881261130112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 367us (638us total) trans 4294974845 rc 301/301 00000100:00100000:1.0:1746065074.921509:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11387 00000100:00100000:0.0:1746065074.922766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.923026:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130240 00000100:00100000:1.0:1746065074.923032:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130240 00010000:00010000:1.0:1746065074.923054:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b376 expref: 260 pid: 7205 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746065074.923494:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3381 00000100:00100000:1.0:1746065074.923501:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+260:2004:x1830881261130240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065074.923511:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.923517:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b376 expref: 260 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.923526:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b376 expref: 260 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.923541:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145e01f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b376 expref: 260 pid: 7205 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.923552:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065074.923555:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e034 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065074.923562:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e034 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065074.923571:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e034 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065074.923609:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065074.923652:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+259:2004:x1830881261130240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 151us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.923658:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3381 00000100:00100000:0.0:1746065074.925688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.925760:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130496 00000100:00100000:1.0:1746065074.925766:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130496 00000100:00100000:1.0:1746065074.925879:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3911 00000100:00100000:1.0:1746065074.925885:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+258:27738:x1830881261130496:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065074.926211:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+259:27738:x1830881261130496:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 325us (527us total) trans 4294974847 rc 0/0 00000100:00100000:1.0:1746065074.926217:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3911 00000100:00100000:0.0:1746065074.927111:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.927748:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261130752 00000100:00100000:1.0:1746065074.927753:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261130752 00000100:00100000:1.0:1746065074.927805:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3912 00000100:00100000:1.0:1746065074.927812:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+259:27738:x1830881261130752:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065074.927917:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27738:x1830881261130752:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 105us (806us total) trans 4294974848 rc 0/0 00000100:00100000:1.0:1746065074.927923:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3912 00000100:00100000:0.0:1746065074.928564:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.930621:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.931616:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.934917:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.934969:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131520 00000100:00100000:1.0:1746065074.934975:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131520 00000100:00100000:1.0:1746065074.935021:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3913 00000100:00100000:1.0:1746065074.935027:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27739:x1830881261131520:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065074.935166:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27739:x1830881261131520:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 138us (253us total) trans 4294974850 rc 0/0 00000100:00100000:1.0:1746065074.935172:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3913 00000100:00100000:0.0:1746065074.936868:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131648 00000100:00100000:0.0:1746065074.936873:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131648 00000100:00100000:0.0:1746065074.936916:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 522 00000100:00100000:0.0:1746065074.936922:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+264:2005:x1830881261131648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.936930:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.936953:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc145e081 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b399 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.936969:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065074.936973:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065074.937005:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+263:2005:x1830881261131648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.937011:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 522 00000100:00100000:1.0:1746065074.937097:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261131776 00000100:00100000:1.0:1746065074.937101:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261131776 00000100:00100000:1.0:1746065074.937120:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11390 00000100:00100000:1.0:1746065074.937125:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261131776:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065074.937140:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.937150:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e08f lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b3a0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.937174:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e096 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065074.937183:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e096 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.937191:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e096 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065074.937265:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e08f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3a0 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.937277:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e096 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3a0 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.937283:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065074.937285:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065074.937287:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d200, rc 0) 00000100:00100000:1.0:1746065074.937320:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261131776:12345-192.168.202.27@tcp:101:bash.0 Request processed in 194us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.937325:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11390 00000100:00100000:0.0:1746065074.940023:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261132032 00000100:00100000:0.0:1746065074.940030:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261132032 00000100:00100000:0.0:1746065074.940103:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11392 00000100:00100000:0.0:1746065074.940109:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+265:27739:x1830881261132032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065074.940119:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065074.940131:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145e09d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b3a7 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.940196:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e0a4 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065074.940256:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e0a4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.940264:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e0a4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065074.940274:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f5:0x0]: returning size 0 00010000:00010000:0.0:1746065074.940354:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145e09d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3a7 expref: 267 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.940365:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e0a4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3a7 expref: 266 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.940372:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065074.940374:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065074.940376:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:0.0:1746065074.940616:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+269:27739:x1830881261132032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 506us (878us total) trans 4294974851 rc 0/0 00000100:00100000:0.0:1746065074.940622:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11392 00000100:00100000:0.0:1746065074.942933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.943097:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.946573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.946895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.947038:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261132800 00000100:00100000:1.0:1746065074.947042:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261132800 00000100:00100000:1.0:1746065074.947066:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 523 00000100:00100000:1.0:1746065074.947070:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+270:2004:x1830881261132800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065074.947077:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.947095:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc145e0b9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ae expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.947121:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065074.947125:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065074.947141:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+269:2004:x1830881261132800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.947146:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 523 00000100:00100000:1.0:1746065074.947322:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.949375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.949501:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261133312 00000100:00100000:1.0:1746065074.949508:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261133312 00000100:00100000:1.0:1746065074.949713:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3915 00000100:00100000:1.0:1746065074.949720:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261133312:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065074.949866:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261133312:12345-192.168.202.27@tcp:35:bash.0 Request processed in 146us (1187us total) trans 4294974855 rc 0/0 00000100:00100000:1.0:1746065074.949872:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3915 00000100:00100000:0.0:1746065074.951895:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.951932:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.956405:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.956963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.956982:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134080 00000100:00100000:0.0:1746065074.956985:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134080 00010000:00010000:0.0:1746065074.957005:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145e0e3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3bc expref: 273 pid: 7203 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746065074.957023:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3382 00000100:00100000:0.0:1746065074.957028:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+273:2004:x1830881261134080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.957036:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.957040:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145e0e3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3bc expref: 273 pid: 7203 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.957050:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145e0e3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3bc expref: 273 pid: 7203 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.957067:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145e0e3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3bc expref: 273 pid: 7203 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746065074.957085:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065074.957088:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e0f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.957095:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e0f8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.957101:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e0f8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.957123:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065074.957673:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+272:2004:x1830881261134080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 643us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065074.957679:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3382 00010000:00010000:0.0:1746065074.959896:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959904:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959910:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959915:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.959918:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959924:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959935:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72300) 00010000:00010000:0.0:1746065074.959938:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.959942:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959946:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145df93 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959958:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959962:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959965:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959969:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.959970:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959974:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959979:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72300) 00010000:00010000:0.0:1746065074.959980:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.959982:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.959985:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e018 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065074.960001:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.960005:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.960051:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.960055:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065074.960057:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.960061:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.960068:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065074.960070:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065074.960072:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065074.960076:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc145e0b2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065074.960286:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262547712:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.960335:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.960357:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262548224:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.960372:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.960385:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065074.960389:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262547840:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.960403:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065074.962015:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09e300/2, rc 0, transno 17179872272 00000100:00100000:1.0:1746065074.962018:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262547712:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065074.962024:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a0a80/2, rc 0, transno 17179872273 00000100:00100000:1.0:1746065074.962026:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262548224:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065074.962343:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262548608:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.962367:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.962380:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262549120:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.962391:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.962401:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065074.962404:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262548992:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065074.962415:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065074.962431:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262548608 00000100:00100000:1.0:1746065074.962433:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262548608 00000100:00100000:1.0:1746065074.962450:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262549120 00000100:00100000:1.0:1746065074.962451:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262549120 00000100:00100000:1.0:1746065074.962459:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262548992 00000100:00100000:1.0:1746065074.962461:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262548992 00000100:00100000:1.0:1746065074.962469:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7963 00000100:00100000:1.0:1746065074.962473:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+56:3762:x1830881262548608:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065074.962483:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:786 count 1 00010000:00010000:1.0:1746065074.962495:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962504:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc145df38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b329 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962509:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065074.962511:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065074.962513:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962527:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc145df38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b329 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962535:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc145df38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b329 expref: 38 pid: 9549 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746065074.962543:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262549376:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065074.962577:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065074.962590:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7964 00000100:00100000:1.0:1746065074.962595:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+56:3762:x1830881262549120:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065074.962663:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065074.962666:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065074.962667:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065074.962669:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065074.962671:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065074.962694:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+57:3762:x1830881262549120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 99us (302us total) trans 21474839547 rc 0/0 00000100:00100000:1.0:1746065074.962700:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7964 00000100:00100000:1.0:1746065074.962712:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7965 00000100:00100000:1.0:1746065074.962716:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+56:3762:x1830881262548992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065074.962725:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:789 count 1 00002000:00010000:1.0:1746065074.962736:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065074.962740:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962745:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.962747:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.962749:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962757:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962763:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962769:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962800:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065074.962886:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+57:3762:x1830881262548992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 169us (469us total) trans 21474839548 rc 0/0 00000100:00100000:1.0:1746065074.962890:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7965 00010000:00010000:1.0:1746065074.962903:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065074.962907:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc145e114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962917:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2d600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.962919:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc145e114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962925:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc145e114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962934:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc145e114 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962939:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc145e114 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962949:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065074.962951:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962956:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.962958:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962963:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962969:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962977:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc145e122 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.962987:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.962989:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.962990:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065074.963009:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c458a80/2, rc 0, transno 21474839548 00000100:00100000:1.0:1746065074.963013:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262548992:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065074.963019:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45b480/2, rc 0, transno 21474839547 00000100:00100000:1.0:1746065074.963021:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262549120:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065074.969194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065074.970126:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065074.970132:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145e106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.970138:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.970142:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145e106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.970148:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145e106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.970158:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145e106 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.970163:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc145e106 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.970194:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.970196:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.970197:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065074.970252:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed2a00/2, rc 0, transno 17179872276 00000100:00100000:0.0:1746065074.970258:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262547840:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065074.972353:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.973108:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134464 00000100:00100000:0.0:1746065074.973111:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134464 00000100:00100000:1.0:1746065074.973229:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261134336 00000100:00100000:1.0:1746065074.973232:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261134336 00010000:00010000:1.0:1746065074.973247:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc145ddb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2b2 expref: 42 pid: 1880 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746065074.973272:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3384 00000100:00100000:1.0:1746065074.973277:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881261134336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065074.973285:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065074.973289:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc145ddb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2b2 expref: 42 pid: 1880 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.973298:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc145ddb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2b2 expref: 42 pid: 1880 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.973310:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc145ddb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b2b2 expref: 42 pid: 1880 timeout: 770 lvb_type: 0 00010000:00010000:1.0:1746065074.973320:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.973322:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.973325:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973331:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e10d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973352:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065074.973384:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261134336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.973390:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3384 00010000:00010000:1.0:1746065074.973410:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973417:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973423:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973428:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973445:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065074.973575:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+94:3760:x1830881262547584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12010us (12138us total) trans 17179872277 rc 0/0 00000100:00100000:1.0:1746065074.973581:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7960 00000100:00100000:1.0:1746065074.973593:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7969 00000100:00100000:1.0:1746065074.973598:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+39:26180:x1830881261134464:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065074.973614:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.973621:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b3ca expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973639:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 40 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065074.973644:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.973646:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.973648:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 40 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.973668:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 40 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065074.973676:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 40 pid: 10219 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746065074.973685:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262549632:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065074.973719:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bc00 going to sleep for 11 seconds 00000004:00080000:1.0:1746065074.973747:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c525c00/2, rc 0, transno 17179872277 00000100:00100000:1.0:1746065074.973752:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262547584:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065074.975669:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc145df38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b329 expref: 39 pid: 9549 timeout: 770 lvb_type: 0 00000100:00100000:1.0:1746065074.975677:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262549376:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065074.975686:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975696:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975701:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975706:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975711:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975720:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065074.975887:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+60:3762:x1830881262548608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13411us (13517us total) trans 21474839552 rc 0/0 00000100:00100000:1.0:1746065074.975892:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7963 00000004:00080000:1.0:1746065074.975919:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c459f80/2, rc 0, transno 21474839552 00000100:00100000:1.0:1746065074.975923:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262548608:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065074.975931:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065074.975935:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e130 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975941:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baee00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.975943:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e130 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975953:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e130 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975963:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e130 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975967:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e130 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975977:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065074.975979:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975983:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065074.975985:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975989:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975994:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.975999:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc145e11b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.976011:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.976013:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065074.976014:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065074.980569:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.981338:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.981366:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135360 00000100:00100000:0.0:1746065074.981373:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135360 00010000:00010000:0.0:1746065074.981402:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 39 pid: 10219 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746065074.981444:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3387 00000100:00100000:0.0:1746065074.981451:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261135360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065074.981463:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065074.981467:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 39 pid: 10219 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.981478:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 39 pid: 10219 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746065074.981498:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.981500:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065074.981506:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.981513:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065074.981538:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065074.981549:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c53d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262549760:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065074.981714:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5400/0xad6b7ddc145e065 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b392 expref: 39 pid: 10219 timeout: 770 lvb_type: 1 00000100:00100000:1.0:1746065074.981726:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262549632:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065074.981744:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.981752:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d600, rc 0) 00000100:00100000:1.0:1746065074.981805:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:26180:x1830881261134464:12345-192.168.202.27@tcp:101:bash.0 Request processed in 8206us (8818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.981812:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7969 00000100:00100000:0.0:1746065074.982214:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.992427:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.992834:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135488 00000100:00100000:1.0:1746065074.992842:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135488 00000100:00100000:1.0:1746065074.992878:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7970 00000100:00100000:1.0:1746065074.992884:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261135488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065074.992904:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.992920:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30800/0xad6b7ddc145e161 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b3d8 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065074.992964:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262549888:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065074.993030:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065074.994300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.994622:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261135616 00000100:00100000:1.0:1746065074.994627:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261135616 00000100:00100000:1.0:1746065074.994759:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7971 00000100:00100000:1.0:1746065074.994768:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:26180:x1830881261135616:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065074.994796:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065074.994809:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145e168 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b3df expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065074.994829:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065074.994846:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.994847:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065074.994855:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145e168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3df expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.994868:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc145e168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3df expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065074.994876:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c200, rc 0) 00000100:00100000:1.0:1746065074.994910:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:26180:x1830881261135616:12345-192.168.202.27@tcp:101:bash.0 Request processed in 144us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065074.994990:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7971 00002000:00010000:1.0:1746065074.995018:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb mtime: 0 -> 1746065075 00002000:00010000:1.0:1746065074.995021:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb atime: 0 -> 1746065075 00002000:00010000:1.0:1746065074.995023:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x316:0x0] updating lvb ctime: 0 -> 1746065075 00000100:00100000:1.0:1746065074.995033:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262549888:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065074.995051:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30800/0xad6b7ddc145e161 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3d8 expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065074.995064:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30800/0xad6b7ddc145e161 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3d8 expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065074.995075:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30800, rc 0) 00000100:00100000:1.0:1746065074.995105:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261135488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2220us (2691us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065074.995111:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7970 00000100:00100000:0.0:1746065074.996973:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065074.997008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065074.997223:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1190 00000100:00100000:1.0:1746065074.997231:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261135872:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065074.997305:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x317:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065074.997307:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x317:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065074.997309:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x317:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065074.997311:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x317:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065074.997312:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x317:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065074.997826:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261135872:12345-192.168.202.27@tcp:10:bash.0 Request processed in 595us (815us total) trans 17179872278 rc 0/0 00000100:00100000:1.0:1746065074.997833:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1190 00002000:00010000:1.0:1746065074.997836:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/791 (0->18446744073709551615) 00002000:00100000:1.0:1746065074.997838:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef100 with x1830881261135872 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065074.997842:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef100. 00000100:00100000:0.0:1746065075.002711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.012977:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.013025:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261136640 00000100:00100000:0.0:1746065075.013032:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261136640 00000100:00100000:0.0:1746065075.013065:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11399 00000100:00100000:0.0:1746065075.013071:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+259:27742:x1830881261136640:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065075.013091:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065075.013103:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e0f8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3c3 expref: 259 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.013119:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc145e14c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3d1 expref: 258 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.013129:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e096 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3a0 expref: 257 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.013137:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f5:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065075.013140:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.013153:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc145e184 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.013160:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc145e184 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.013166:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc145e184 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.013174:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.013178:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.013183:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.013238:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145e192 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.013245:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e176 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3e6 expref: 256 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.013250:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145e192 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.013272:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e176 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3e6 expref: 256 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.013281:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e176 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2f5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3e6 expref: 256 pid: 7203 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.013291:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a7a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262550016:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.013355:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.016877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.020718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.022619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.028268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.031906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.036627:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.036805:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.038161:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11403 00000100:00100000:1.0:1746065075.038170:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27741:x1830881261137536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.038187:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.038202:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e1d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b402 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.038248:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.038912:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038929:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038939:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.038945:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038950:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038984:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038988:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038993:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.038998:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039004:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.039016:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039022:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039030:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c900) 00010000:00010000:1.0:1746065075.039032:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.039035:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039039:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc145e1ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039059:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039064:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039068:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039072:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.039074:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039079:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039085:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:1.0:1746065075.039086:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.039088:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039095:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc145e1f4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.039113:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e1d8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b402 expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.039118:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e1d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b402 expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.039124:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:1.0:1746065075.039238:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27741:x1830881261137536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 974us (2522us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.039245:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11403 00000100:00100000:0.0:1746065075.042707:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.042806:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261137920 00000100:00100000:1.0:1746065075.042814:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261137920 00000100:00100000:1.0:1746065075.042968:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11405 00000100:00100000:1.0:1746065075.042976:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+260:27743:x1830881261137920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.042992:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.042995:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065075.043016:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc145e1e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b409 expref: 260 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.043028:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c900) 00010000:00010000:1.0:1746065075.043037:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.043047:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e1fb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b410 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.043118:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.043125:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043130:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043136:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.043139:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043142:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043424:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.043431:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043436:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065075.043444:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f7:0x0]: returning size 0 00010000:00010000:1.0:1746065075.043464:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043469:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043474:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043479:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043484:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.043488:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043493:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043505:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c000) 00010000:00010000:1.0:1746065075.043507:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.043510:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043514:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc145e202 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065075.043522:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095f57b80 reply state ffff88009ade6000 transno 4294974864 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043529:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.043534:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:1.0:1746065075.043536:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.043538:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065075.043556:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc145e1fb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b410 expref: 262 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.043570:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b410 expref: 261 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.043575:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065075.043578:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.043579:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719000, rc 0) 00000100:00100000:1.0:1746065075.043647:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27743:x1830881261137920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 671us (947us total) trans 4294974864 rc 0/0 00000100:00100000:1.0:1746065075.043653:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11405 00000100:00100000:0.0:1746065075.046374:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.046427:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138176 00000100:00100000:1.0:1746065075.046433:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138176 00000100:00100000:1.0:1746065075.046477:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11406 00000100:00100000:1.0:1746065075.046566:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27743:x1830881261138176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.046584:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.046596:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e21e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b417 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.046676:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.046686:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b410 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.046692:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.046714:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b410 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.046722:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719000/0xad6b7ddc145e210 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b410 expref: 263 pid: 7204 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.046731:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262550144:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.046819:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.051198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.051864:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262550144:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.051888:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053187:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053193:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065075.053212:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f7:0x0]: returning size 0 00000004:00080000:1.0:1746065075.053348:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x319:0x0], index 1: 0 00000004:00080000:1.0:1746065075.053353:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x318:0x0], index 0: 0 00000004:00080000:1.0:1746065075.053357:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x319:0x0], index 0: 0 00000004:00080000:1.0:1746065075.053360:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x31a:0x0], index 1: 0 00010000:00010000:1.0:1746065075.053435:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053441:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053446:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053450:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.053454:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053458:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053468:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065075.053470:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.053473:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053477:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e225 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.053511:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e21e lrc: 1/0,0 mode: --/CR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b417 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.053516:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e21e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b417 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.053527:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:1.0:1746065075.053548:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27743:x1830881261138176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7065us (7179us total) trans 4294974865 rc 301/301 00000100:00100000:1.0:1746065075.053554:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11406 00000100:00100000:0.0:1746065075.057067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.057563:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261138816 00000100:00100000:1.0:1746065075.057567:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261138816 00000100:00100000:1.0:1746065075.057588:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11407 00000100:00100000:1.0:1746065075.057593:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27744:x1830881261138816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.057612:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.057629:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e233 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b41e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.057679:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.057693:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057702:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057709:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.057714:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057719:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057798:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e248 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.057803:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e248 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057808:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e248 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065075.057815:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f7:0x0]: returning size 0 00010000:00010000:1.0:1746065075.057849:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057855:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057859:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057864:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057869:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.057872:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057878:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057886:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c900) 00010000:00010000:1.0:1746065075.057889:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.057892:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057897:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc145e23a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057904:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057908:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057912:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057916:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.057918:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057922:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057927:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:1.0:1746065075.057928:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.057930:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057934:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e241 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.057955:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e233 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b41e expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.057968:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e248 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b41e expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.057972:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff88012d56c100) 00010000:00010000:1.0:1746065075.057974:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.057975:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:1.0:1746065075.057996:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27744:x1830881261138816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 403us (915us total) trans 4294974867 rc 0/0 00000100:00100000:1.0:1746065075.058000:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11407 00000100:00100000:1.0:1746065075.061858:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139072 00000100:00100000:1.0:1746065075.061866:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139072 00000100:00100000:1.0:1746065075.061915:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3922 00000100:00100000:1.0:1746065075.061923:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27743:x1830881261139072:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065075.062221:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139200 00000100:00100000:0.0:1746065075.062225:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139200 00000100:00100000:0.0:1746065075.062252:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7972 00000100:00100000:0.0:1746065075.062257:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261139200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.062265:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.062320:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8e00/0xad6b7ddc145e256 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b425 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065075.062340:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065075.062353:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.062354:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.062362:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8e00/0xad6b7ddc145e256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b425 expref: 44 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.062374:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8e00/0xad6b7ddc145e256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b425 expref: 44 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.062382:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8e00, rc 0) 00000100:00100000:1.0:1746065075.062717:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27743:x1830881261139072:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 792us (1629us total) trans 4294974868 rc 0/0 00000100:00100000:1.0:1746065075.062723:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3922 00000100:00100000:0.0:1746065075.062914:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261139200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 656us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.062920:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7972 00000100:00100000:0.0:1746065075.065353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.065406:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261139456 00000100:00100000:1.0:1746065075.065414:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261139456 00000100:00100000:1.0:1746065075.065460:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3923 00000100:00100000:1.0:1746065075.065641:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27744:x1830881261139456:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.065841:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27744:x1830881261139456:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 374us (493us total) trans 4294974869 rc 0/0 00000100:00100000:1.0:1746065075.065847:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3923 00000100:00100000:0.0:1746065075.067110:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.069895:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.069926:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.072401:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.072431:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.072485:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140352 00000100:00100000:1.0:1746065075.072490:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140352 00000100:00100000:1.0:1746065075.072520:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140480 00000100:00100000:1.0:1746065075.072522:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140480 00000100:00100000:1.0:1746065075.072534:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11411 00000100:00100000:1.0:1746065075.072540:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261140352:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065075.072572:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.072585:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e264 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x2f7:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b42c expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.072596:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff880098ce5100) 00010000:00010000:1.0:1746065075.072609:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.072722:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.072731:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.072737:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.072765:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.072794:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.072808:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262550272:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.072856:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065075.074743:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262550272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.074756:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065075.075240:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140608 00000100:00100000:0.0:1746065075.075245:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140608 00010000:00010000:0.0:1746065075.075267:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.075287:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3390 00000100:00100000:0.0:1746065075.075293:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+272:2005:x1830881261140608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.075301:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.075305:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.075313:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.075326:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc145e2aa lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b441 expref: 272 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.075347:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff880098ce5100) 00010000:00010000:0.0:1746065075.075351:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.075357:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.075362:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.075376:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065075.075401:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+273:2005:x1830881261140608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.075407:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3390 00010000:00010000:1.0:1746065075.075586:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.075592:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:1.0:1746065075.075656:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974872 00000004:00010000:1.0:1746065075.075678:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed5880 reply state ffff88009a902000 transno 4294974873 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.075685:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.075690:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff880098ce5100) 00010000:00010000:1.0:1746065075.075692:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.075694:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065075.075734:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261140352:12345-192.168.202.27@tcp:36:bash.0 Request processed in 3194us (3338us total) trans 4294974873 rc 0/0 00000100:00100000:1.0:1746065075.075739:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11411 00000020:00080000:1.0:1746065075.075741:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065075.078189:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261140992 00000100:00100000:1.0:1746065075.078193:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261140992 00000100:00100000:1.0:1746065075.078214:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3924 00000100:00100000:1.0:1746065075.078220:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27744:x1830881261140992:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.078383:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27744:x1830881261140992:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 163us (664us total) trans 4294974875 rc 0/0 00000100:00100000:1.0:1746065075.078389:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3924 00000100:00100000:1.0:1746065075.089517:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.089630:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261141504 00000100:00100000:0.0:1746065075.089638:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261141504 00000100:00100000:0.0:1746065075.089682:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11415 00000100:00100000:0.0:1746065075.089688:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27744:x1830881261141504:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.089710:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.089728:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145e2cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b456 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.089813:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.089823:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089831:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089838:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.089844:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089848:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089920:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.089926:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089931:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065075.089938:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f7:0x0]: returning size 2 00010000:00010000:0.0:1746065075.089986:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089992:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.089997:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090001:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.090004:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090009:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090017:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff880098ce5100) 00010000:00010000:0.0:1746065075.090020:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065075.090022:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090026:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e2e2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090043:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090047:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090058:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090062:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090065:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.090067:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090071:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090075:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:0.0:1746065075.090077:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.090078:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090082:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145e2d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090088:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090092:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090096:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090099:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.090101:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090108:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090112:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:0.0:1746065075.090114:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.090115:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090119:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e2db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.090142:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145e2cd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b456 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.090147:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145e2cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b456 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.090156:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9600, rc 0) 00000100:00100000:0.0:1746065075.090203:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27744:x1830881261141504:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 515us (693us total) trans 4294974876 rc 301/301 00000100:00100000:0.0:1746065075.090208:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11415 00010000:00010000:1.0:1746065075.092196:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092207:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092213:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092218:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.092221:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092227:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092239:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:1.0:1746065075.092242:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.092244:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092248:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145e18b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.092262:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092270:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092274:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092277:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.092279:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092284:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092289:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47900) 00010000:00010000:1.0:1746065075.092291:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.092293:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092298:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145e209 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092312:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092316:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092320:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092324:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.092327:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092332:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092337:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff880098ce5100) 00010000:00010000:1.0:1746065075.092339:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.092341:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.092345:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc145e2b1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065075.092511:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262550528:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.092560:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.092611:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262551040:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.092631:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.092646:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065075.092651:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262550656:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.092664:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.092675:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262551168:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.092689:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.092720:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262550528 00000100:00100000:0.0:1746065075.092726:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262550528 00000100:00100000:0.0:1746065075.092753:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262551040 00000100:00100000:0.0:1746065075.092755:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262551040 00000100:00100000:0.0:1746065075.092765:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262551168 00000100:00100000:0.0:1746065075.092767:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262551168 00000100:00100000:1.0:1746065075.092974:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262550400:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065075.094247:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.096298:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.097497:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.097532:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.097667:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.097879:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3392 00000100:00100000:1.0:1746065075.097887:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261142016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065075.097895:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.097900:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 38 pid: 12258 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.097909:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 38 pid: 12258 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.097922:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d600/0xad6b7ddc145e15a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b3ca expref: 38 pid: 12258 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.097931:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.097932:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.097935:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.097942:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.097955:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065075.097970:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261142016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.097975:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3392 00000100:00100000:1.0:1746065075.097991:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142144 00000100:00100000:1.0:1746065075.097994:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142144 00000100:00100000:1.0:1746065075.098010:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7981 00000100:00100000:1.0:1746065075.098014:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:26180:x1830881261142144:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.098023:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.098033:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc145e30c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b45d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.098047:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8e00/0xad6b7ddc145e256 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b425 expref: 44 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.098052:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.098054:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.098057:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc145e30c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b45d expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.098075:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8e00/0xad6b7ddc145e256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b425 expref: 44 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.098084:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8e00/0xad6b7ddc145e256 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b425 expref: 44 pid: 12258 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746065075.098093:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262551680:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.098127:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b240 going to sleep for 11 seconds 00010000:00010000:0.0:1746065075.098525:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.098529:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.098536:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.098538:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.098544:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.098552:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.098558:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc145e305 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.098574:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.098575:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.098577:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065075.103242:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262551680:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.103268:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc145e30c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b45d expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.103285:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:1.0:1746065075.103327:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+44:26180:x1830881261142144:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5311us (5659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.103335:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7981 00000100:00100000:0.0:1746065075.103660:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142400 00000100:00100000:0.0:1746065075.103664:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142400 00000100:00100000:0.0:1746065075.104537:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3926 00000100:00100000:0.0:1746065075.104548:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+257:27744:x1830881261142400:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065075.104656:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+257:27744:x1830881261142400:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 111us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.104661:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3926 00000100:00100000:0.0:1746065075.107644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.107835:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142528 00000100:00100000:1.0:1746065075.107841:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142528 00000100:00100000:1.0:1746065075.107877:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7982 00000100:00100000:1.0:1746065075.107884:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261142528:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.107897:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.107911:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45600/0xad6b7ddc145e313 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b464 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.107933:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.107949:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.107951:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.107957:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45600/0xad6b7ddc145e313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b464 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.107970:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45600/0xad6b7ddc145e313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b464 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.107979:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45600, rc 0) 00000100:00100000:1.0:1746065075.108003:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+38:26180:x1830881261142528:12345-192.168.202.27@tcp:101:bash.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.108008:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7982 00000100:00100000:0.0:1746065075.109730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.109770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.110038:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142784 00000100:00100000:1.0:1746065075.110045:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142784 00002000:00010000:1.0:1746065075.110074:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/792 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.110077:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881261142784 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.110086:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80. 00000100:00100000:1.0:1746065075.110110:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261142656 00000100:00100000:1.0:1746065075.110112:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261142656 00002000:00010000:1.0:1746065075.110121:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/793 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.110123:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed7800 with x1830881261142656 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.110129:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed7800. 00000100:00100000:1.0:1746065075.110140:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1191 00000100:00100000:1.0:1746065075.110146:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261142784:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065075.110281:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x318:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.110284:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x318:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.110286:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x318:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.110288:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x318:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.110289:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x318:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.110321:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261142784:12345-192.168.202.27@tcp:10:bash.0 Request processed in 176us (596us total) trans 21474839558 rc 0/0 00000100:00100000:1.0:1746065075.110327:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1191 00002000:00010000:1.0:1746065075.110329:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/792 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.110331:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881261142784 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.110334:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80. 00000100:00100000:0.0:1746065075.113175:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261143040 00000100:00100000:0.0:1746065075.113181:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261143040 00000100:00100000:0.0:1746065075.113226:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3927 00000100:00100000:0.0:1746065075.113233:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+257:26180:x1830881261143040:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065075.113558:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.113623:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+258:26180:x1830881261143040:12345-192.168.202.27@tcp:35:bash.0 Request processed in 390us (488us total) trans 4294974878 rc 0/0 00000100:00100000:0.0:1746065075.113629:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3927 00000100:00100000:0.0:1746065075.118629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.118708:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.119533:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.119539:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e352 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.119562:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.119566:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e352 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.119571:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e352 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.119579:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f7:0x0].0x0 (ffff880098c34600) 00010000:00010000:1.0:1746065075.119581:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065075.119584:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e352 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.119588:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e352 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.119618:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.119620:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.119621:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.124385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.132848:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.143139:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.143195:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.143277:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261144576 00000100:00100000:1.0:1746065075.143281:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261144576 00000100:00100000:1.0:1746065075.143321:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11421 00000100:00100000:1.0:1746065075.143327:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27747:x1830881261144576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.143342:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.143368:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e398 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b48e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.143414:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e39f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.143423:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e39f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.143431:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e39f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.143465:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065075.143469:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065075.143492:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e398 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b48e expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.143507:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e39f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b48e expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.143513:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065075.143515:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065075.143517:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:1.0:1746065075.143553:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27747:x1830881261144576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 227us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.143558:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11421 00000100:00100000:0.0:1746065075.149975:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.154557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.165584:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.189208:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.189324:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.194615:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261146496 00000100:00100000:0.0:1746065075.194622:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261146496 00000100:00100000:1.0:1746065075.194716:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261146624 00000100:00100000:1.0:1746065075.194719:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261146624 00000100:00100000:1.0:1746065075.194749:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7983 00000100:00100000:1.0:1746065075.194756:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261146624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.194770:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065075.194829:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11428 00000100:00100000:0.0:1746065075.194834:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261146496:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065075.194845:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.194859:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e42b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b4b8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.194953:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.194963:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.194972:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.194979:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.194985:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.194990:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.195027:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e440 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.195033:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e440 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.195038:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e440 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065075.195045:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 0 00010000:00010000:0.0:1746065075.195107:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.195114:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.195119:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.195124:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.195128:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.195132:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.195379:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc145e44e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b4bf expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.195397:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.195410:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.195412:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.195419:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc145e44e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4bf expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.195430:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc145e44e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4bf expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.195439:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:1.0:1746065075.195486:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261146624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 730us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.195493:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7983 00010000:00010000:0.0:1746065075.198021:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198045:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4f4f00) 00010000:00010000:0.0:1746065075.198048:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.198053:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198061:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc145e432 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198091:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198096:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198100:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198105:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.198108:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198113:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198119:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34400) 00010000:00010000:0.0:1746065075.198121:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.198123:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198126:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc145e439 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.198454:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e42b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4b8 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.198471:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e440 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4b8 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.198481:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065075.198483:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065075.198484:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9600, rc 0) 00000100:00100000:0.0:1746065075.198523:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261146496:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3688us (3997us total) trans 4294974887 rc 0/0 00000100:00100000:0.0:1746065075.198529:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11428 00000100:00100000:0.0:1746065075.201513:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.202129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.202694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.208328:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.208356:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.208526:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11432 00000100:00100000:0.0:1746065075.208533:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27750:x1830881261147776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.208542:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.208552:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e478 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b4d4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.208594:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145e47f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.208614:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145e47f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.208621:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145e47f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065075.209160:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 0 00000004:00200000:0.0:1746065075.209164:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065075.209179:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145e47f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.209200:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e478 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4d4 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.209211:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc145e47f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4d4 expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.209216:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065075.209218:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065075.209220:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:0.0:1746065075.209258:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27750:x1830881261147776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 726us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.209264:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11432 00000100:00100000:0.0:1746065075.212939:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.217479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.217531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.217973:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3932 00000100:00100000:1.0:1746065075.217980:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27750:x1830881261148416:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.218106:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27750:x1830881261148416:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 126us (574us total) trans 4294974892 rc 0/0 00000100:00100000:1.0:1746065075.218111:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3932 00000100:00100000:0.0:1746065075.219632:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.222868:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261148800 00000100:00100000:0.0:1746065075.222875:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261148800 00000100:00100000:0.0:1746065075.222922:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3934 00000100:00100000:0.0:1746065075.222929:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261148800:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065075.223094:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261148800:12345-192.168.202.27@tcp:35:bash.0 Request processed in 164us (254us total) trans 4294974894 rc 0/0 00000100:00100000:0.0:1746065075.223100:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3934 00000100:00100000:0.0:1746065075.231370:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.232511:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149056 00000100:00100000:0.0:1746065075.232518:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149056 00000100:00100000:0.0:1746065075.232568:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149312 00000100:00100000:0.0:1746065075.232571:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149312 00000100:00100000:0.0:1746065075.232610:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11434 00000100:00100000:0.0:1746065075.232618:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261149056:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065075.232639:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.232642:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746065075.232664:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145e46a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4cd expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.232681:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e4a2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4db expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.232690:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065075.232693:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.232701:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e4b0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b4e2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.232742:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e4b7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.232751:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e4b7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.232759:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e4b7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:0.0:1746065075.232947:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2211, 88 off183712 00000004:00080000:0.0:1746065075.232953:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671251178915ns, next at 672137658713ns, rc = 0 00000040:00080000:0.0:1746065075.232973:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2215, 88 off184152 00000004:00080000:0.0:1746065075.232976:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671251202686ns, next at 672137633000ns, rc = 0 00000040:00080000:0.0:1746065075.232984:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2216, 88 off184240 00000004:00080000:0.0:1746065075.232987:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671251213693ns, next at 672137633000ns, rc = 0 00000040:00080000:0.0:1746065075.232995:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2212, 88 off183800 00000004:00080000:0.0:1746065075.232998:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671251224067ns, next at 672137658713ns, rc = 0 00000100:00100000:1.0:1746065075.233076:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11435 00000100:00100000:1.0:1746065075.233083:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27751:x1830881261149312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.233091:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.233101:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e4be lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b4e9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.233149:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065075.233155:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.233161:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.233169:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065075.233174:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.233179:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.234149:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065075.234159:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.234166:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065075.234175:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 2 00010000:00010000:1.0:1746065075.238513:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238525:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238532:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238536:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.238539:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238544:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238558:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065075.238561:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746065075.238564:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238568:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e4d3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238607:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238612:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238617:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238620:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238623:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.238625:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238633:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238638:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:1.0:1746065075.238640:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.238642:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238646:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e4c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238653:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238657:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238662:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238665:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.238667:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238672:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238677:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34400) 00010000:00010000:1.0:1746065075.238679:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.238681:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238684:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e4cc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.238732:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e4be lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4e9 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.238739:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e4be lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4e9 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.238749:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:1.0:1746065075.239525:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27751:x1830881261149312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6437us (7064us total) trans 4294974896 rc 301/301 00000100:00100000:1.0:1746065075.239533:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11435 00000100:00100000:1.0:1746065075.241173:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262552448:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.241219:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.241262:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065075.241267:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262552320:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.241279:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.241296:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262552448 00000100:00100000:1.0:1746065075.241301:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262552448 00000100:00100000:1.0:1746065075.241324:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262552320 00000100:00100000:1.0:1746065075.241326:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262552320 00000100:00100000:1.0:1746065075.241335:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7984 00000100:00100000:1.0:1746065075.241340:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+65:3762:x1830881262552448:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065075.241435:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.241438:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.241440:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.241441:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.241443:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.241462:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+66:3762:x1830881262552448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 122us (243us total) trans 21474839559 rc 0/0 00000100:00100000:1.0:1746065075.241468:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7984 00000100:00100000:1.0:1746065075.241479:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7985 00000100:00100000:1.0:1746065075.241482:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+65:3762:x1830881262552320:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065075.241492:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:793 count 1 00002000:00010000:1.0:1746065075.241506:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.241511:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44400/0xad6b7ddc145e4e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.241521:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.241522:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.241526:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44400/0xad6b7ddc145e4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.241535:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44400/0xad6b7ddc145e4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.241542:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44400/0xad6b7ddc145e4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.241547:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44400/0xad6b7ddc145e4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.241557:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065075.241669:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+66:3762:x1830881262552320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 186us (389us total) trans 21474839560 rc 0/0 00000100:00100000:1.0:1746065075.241673:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7985 00000004:00080000:1.0:1746065075.241700:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925c8e00/2, rc 0, transno 21474839560 00000100:00100000:1.0:1746065075.241704:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262552320:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065075.241710:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ccb100/2, rc 0, transno 21474839559 00000100:00100000:1.0:1746065075.241712:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262552448:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065075.242976:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.242983:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.242987:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.242993:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.242996:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.243002:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.243015:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34400) 00010000:00010000:0.0:1746065075.243017:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.243019:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.243023:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc145e344 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.243038:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243042:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243046:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243050:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.243051:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243055:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243060:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34400) 00010000:00010000:0.0:1746065075.243061:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.243063:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243067:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e3de lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.243079:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.243084:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.243087:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.243090:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f182e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.243092:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.243096:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.243102:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065075.243105:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.243107:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.243110:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e486 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065075.243365:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.244011:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7991 00000100:00100000:1.0:1746065075.244018:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+101:3761:x1830881262553088:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.244088:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+103:3761:x1830881262553088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (533us total) trans 17179872286 rc 0/0 00000100:00100000:1.0:1746065075.244094:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7991 00000004:00080000:1.0:1746065075.244119:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834ed80/2, rc 0, transno 17179872286 00000100:00100000:1.0:1746065075.244123:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262553088:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065075.244131:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834df80/2, rc 0, transno 17179872285 00000100:00100000:1.0:1746065075.244133:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262552960:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065075.245200:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.245206:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e4f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.245212:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.245214:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e4f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.245220:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e4f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.245229:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e4f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.245233:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc145e4f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.245242:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.245243:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.245244:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.247497:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.247516:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.248309:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3397 00000100:00100000:1.0:1746065075.248316:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261149568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065075.248323:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.248328:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45600/0xad6b7ddc145e313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b464 expref: 40 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.248336:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45600/0xad6b7ddc145e313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b464 expref: 40 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.248347:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45600/0xad6b7ddc145e313 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b464 expref: 40 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.248359:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.248360:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.248362:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc145e4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248368:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc145e4e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248381:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065075.248396:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261149568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.248401:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3397 00010000:00010000:1.0:1746065075.248415:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.248419:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc145e4ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248424:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.248427:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc145e4ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248434:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc145e4ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248441:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc145e4ef lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248446:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc145e4ef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.248460:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.248461:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.248462:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.249169:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc145e4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.249176:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc145e4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.249182:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc145e4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.249187:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc145e4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.249202:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065075.249433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.249649:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+68:3759:x1830881262552192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7625us (7745us total) trans 21474839562 rc 0/0 00000100:00100000:0.0:1746065075.249655:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7987 00000100:00100000:1.0:1746065075.249697:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.249712:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150080 00000100:00100000:1.0:1746065075.249715:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150080 00000100:00100000:1.0:1746065075.249735:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3935 00000100:00100000:0.0:1746065075.249824:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261149824 00000100:00100000:0.0:1746065075.249827:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261149824 00000100:00100000:1.0:1746065075.249862:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+256:27751:x1830881261150080:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.250439:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+257:27751:x1830881261150080:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 697us (739us total) trans 4294974897 rc 0/0 00000100:00100000:1.0:1746065075.250445:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3935 00000100:00100000:0.0:1746065075.252345:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.253862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.254222:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150336 00000100:00100000:1.0:1746065075.254227:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150336 00000100:00100000:1.0:1746065075.254266:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11437 00000100:00100000:1.0:1746065075.254272:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+257:27751:x1830881261150336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.254292:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.254305:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e512 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b4fe expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.254461:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.254755:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065075.254764:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254792:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254804:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065075.254809:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254814:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254869:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065075.254876:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254881:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065075.254911:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 2 00000004:00200000:1.0:1746065075.254915:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065075.254928:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254935:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254942:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254946:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254951:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254959:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254963:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.254966:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254971:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254978:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065075.254981:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.254983:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254987:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e520 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.254996:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255000:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255004:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255007:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.255009:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255013:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255020:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cc00) 00010000:00010000:1.0:1746065075.255022:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.255024:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255028:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc145e527 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.255053:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e512 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4fe expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.255064:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4fe expref: 258 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.255068:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065075.255070:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.255072:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45a00, rc 0) 00000100:00100000:1.0:1746065075.255094:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:27751:x1830881261150336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 823us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.255099:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11437 00000100:00100000:0.0:1746065075.258121:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.258157:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.259150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.259959:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261150848 00000100:00100000:0.0:1746065075.259964:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261150848 00000100:00100000:0.0:1746065075.259996:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 525 00000100:00100000:0.0:1746065075.260003:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+258:2005:x1830881261150848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.260018:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.260038:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc145e52e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4fe expref: 258 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.260053:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065075.260057:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065075.260108:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+257:2005:x1830881261150848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.260114:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 525 00000100:00100000:0.0:1746065075.268215:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261151104 00000100:00100000:0.0:1746065075.268223:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261151104 00000100:00100000:0.0:1746065075.268276:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11438 00000100:00100000:0.0:1746065075.268284:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+257:27752:x1830881261151104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.268299:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.268314:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc145e535 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b50c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.268621:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e53c lrc: 3/1,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.268635:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e53c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.268644:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e53c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065075.268655:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 2 00000100:00100000:1.0:1746065075.268805:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.268837:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc145e535 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b50c expref: 260 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.268853:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e53c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b50c expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.268860:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065075.268862:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065075.268865:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8000, rc 0) 00000100:00100000:0.0:1746065075.268908:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+260:27752:x1830881261151104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 624us (781us total) trans 4294974898 rc 0/0 00000100:00100000:0.0:1746065075.268913:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11438 00000100:00100000:0.0:1746065075.274249:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.278916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.279881:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262553728:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065075.279899:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065075.284294:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.284343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.284529:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152384 00000100:00100000:1.0:1746065075.284534:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152384 00000100:00100000:1.0:1746065075.284557:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11440 00000100:00100000:1.0:1746065075.284562:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27753:x1830881261152384:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065075.284607:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065075.284620:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e53c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b50c expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.284641:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e4b7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4e2 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.284650:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc145e45c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4c6 expref: 260 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.284657:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065075.284660:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.284676:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.284678:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.284682:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.284689:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.284694:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065075.284697:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 5 00010000:00010000:1.0:1746065075.284701:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.284706:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.284709:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.284760:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.284765:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 2/0,1 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.284796:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.284811:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e54a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 261 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.284819:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 260 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.284827:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 260 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.284834:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 6/0,0 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 260 pid: 7231 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.284837:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ccb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262553856:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065075.284841:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 6/0,0 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 260 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.284846:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668600, rc 0) 00000100:00100000:0.0:1746065075.284870:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+260:27752:x1830881261151616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10483us (10630us total) trans 4294974901 rc 0/0 00000100:00100000:0.0:1746065075.284875:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11439 00000100:00100000:1.0:1746065075.284876:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.286837:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.287044:0:7203:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880099ccb480 x1830881262553856) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40201400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 260 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.287053:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e551 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x2f8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b513 expref: 260 pid: 7231 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.287062:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ccb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262553856:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.287075:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065075.287079:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287085:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287089:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:1.0:1746065075.287267:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x2f8:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1746065075.287339:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287346:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287351:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287355:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.287359:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287364:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287370:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065075.287372:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065075.287375:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287378:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc145e56d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287394:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287399:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287414:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287422:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287425:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.287427:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287432:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287436:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c100) 00010000:00010000:1.0:1746065075.287438:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.287440:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287444:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc145e558 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065075.287454:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ed09180 reply state ffff88009a901000 transno 4294974902 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287461:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.287464:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cf00) 00010000:00010000:1.0:1746065075.287466:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.287468:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065075.287503:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27753:x1830881261152384:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2940us (3159us total) trans 4294974902 rc 0/0 00000100:00100000:1.0:1746065075.287509:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11440 00000100:00100000:0.0:1746065075.290139:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.291557:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261152640 00000100:00100000:1.0:1746065075.291566:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261152640 00000100:00100000:1.0:1746065075.291998:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11441 00000100:00100000:1.0:1746065075.292007:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27752:x1830881261152640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.292029:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.292044:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e574 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b51a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.292102:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc145e57b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.292112:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc145e57b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.292121:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc145e57b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.292154:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2f8:0x0]: returning size 5 00000004:00200000:1.0:1746065075.292158:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065075.292170:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc145e57b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.292192:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e574 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b51a expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.292203:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc145e57b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b51a expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.292210:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:1.0:1746065075.292213:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065075.292215:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45600, rc 0) 00000100:00100000:1.0:1746065075.292272:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27752:x1830881261152640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 267us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.292282:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11441 00000100:00100000:0.0:1746065075.296611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.305250:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153024 00000100:00100000:1.0:1746065075.305258:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153024 00000100:00100000:1.0:1746065075.305306:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11443 00000100:00100000:1.0:1746065075.305314:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27754:x1830881261153024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.305331:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.305348:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44400/0xad6b7ddc145e597 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b528 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.305402:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.305412:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305427:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305436:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.305441:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305446:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305477:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305482:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305490:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305495:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305499:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.305502:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305507:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305515:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c000) 00010000:00010000:1.0:1746065075.305518:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.305521:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305525:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc145e59e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305547:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305552:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305555:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305559:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.305561:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305569:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305574:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cf00) 00010000:00010000:1.0:1746065075.305576:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.305578:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305581:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145e5a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.305614:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44400/0xad6b7ddc145e597 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b528 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.305620:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44400/0xad6b7ddc145e597 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b528 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.305630:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44400, rc 0) 00000100:00100000:1.0:1746065075.306175:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27754:x1830881261153024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 859us (995us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.306182:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11443 00000100:00100000:0.0:1746065075.306857:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.307336:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153152 00000100:00100000:1.0:1746065075.307342:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153152 00000100:00100000:1.0:1746065075.307380:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7994 00000100:00100000:1.0:1746065075.307386:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261153152:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065075.307414:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.307833:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc145e50b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4f7 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.307844:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.307846:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.307849:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.307875:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc145e50b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4f7 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.307886:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc145e50b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b4f7 expref: 40 pid: 11461 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.307898:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ccb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262553984:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.307989:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.310204:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.311638:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153280 00000100:00100000:1.0:1746065075.311645:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153280 00000100:00100000:1.0:1746065075.311683:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11444 00000100:00100000:1.0:1746065075.311690:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27754:x1830881261153280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.311708:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.311725:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e5b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b52f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.311796:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.311806:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311814:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311823:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.311827:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311832:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311865:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311870:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311874:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311879:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311883:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.311886:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311891:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311905:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c900) 00010000:00010000:1.0:1746065075.311908:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.311911:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311915:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc145e5ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311925:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311929:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311933:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311937:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091bae000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.311939:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311943:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311948:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cf00) 00010000:00010000:1.0:1746065075.311950:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.311952:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311956:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e5c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.311981:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e5b3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b52f expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.311987:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145e5b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b52f expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.311998:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:1.0:1746065075.312042:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27754:x1830881261153280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 352us (1843us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.312048:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11444 00000100:00100000:0.0:1746065075.312443:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.316157:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.316379:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153536 00000100:00100000:1.0:1746065075.316385:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153536 00000100:00100000:1.0:1746065075.316418:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11445 00000100:00100000:1.0:1746065075.316423:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27754:x1830881261153536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.316435:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.316448:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e5c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b536 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.316489:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e5cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.316499:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e5cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.316508:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e5cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.316544:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065075.316548:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065075.316574:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e5c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b536 expref: 265 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.316587:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e5cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b536 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.316593:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065075.316604:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065075.316607:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bafe00, rc 0) 00000100:00100000:1.0:1746065075.316655:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27754:x1830881261153536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 231us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.316660:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11445 00000100:00100000:0.0:1746065075.317434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.317867:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317875:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317892:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317899:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317910:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317916:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.317919:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317924:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317933:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.317937:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44800/0xad6b7ddc145e5ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.317973:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261153152:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10587us (11117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.317981:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7994 00000100:00100000:0.0:1746065075.319659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.328349:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261153920 00000100:00100000:0.0:1746065075.328361:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261153920 00000100:00100000:0.0:1746065075.328421:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11446 00000100:00100000:0.0:1746065075.328428:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27752:x1830881261153920:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065075.328470:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.328495:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc145e57b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b51a expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.328513:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:0.0:1746065075.328517:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.328550:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.328561:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.328568:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:0.0:1746065075.328732:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2213, 88 off183888 00000004:00080000:0.0:1746065075.328736:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671346962260ns, next at 672137658713ns, rc = 0 00000040:00080000:0.0:1746065075.328844:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2217, 88 off184328 00000004:00080000:0.0:1746065075.328847:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671347073406ns, next at 672137633000ns, rc = 0 00000040:00080000:0.0:1746065075.328870:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2218, 88 off184416 00000004:00080000:0.0:1746065075.328873:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671347099402ns, next at 672137633000ns, rc = 0 00000040:00080000:0.0:1746065075.328881:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2214, 88 off183976 00000004:00080000:0.0:1746065075.328884:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671347110383ns, next at 672137658713ns, rc = 0 00000100:00100000:0.0:1746065075.329017:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065075.330222:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974904 is committed 00000004:00080000:0.0:1746065075.330228:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1491 committed 00010000:00010000:1.0:1746065075.330283:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.330290:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.330295:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.330298:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.330300:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.330304:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.330312:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cf00) 00010000:00010000:1.0:1746065075.330314:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.330316:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.330320:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc145e55f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00080000:0.0:1746065075.330857:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1501 committed 00000004:00080000:0.0:1746065075.330873:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1500 committed 00000004:00080000:0.0:1746065075.330875:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1490 committed 00000004:00010000:0.0:1746065075.330916:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009835aa00 reply state ffff880099e54400 transno 4294974904 ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.332016:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.332025:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:0.0:1746065075.332027:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065075.332030:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065075.332051:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262554112 00000100:00100000:0.0:1746065075.332057:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262554112 00000100:00100000:0.0:1746065075.332094:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7995 00000100:00100000:0.0:1746065075.332099:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+102:3760:x1830881262554112:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065075.332210:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x31b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065075.332213:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x31b:0x0] updating lvb mtime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.332215:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x31b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.332217:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x31b:0x0] updating lvb ctime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.332218:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x31b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065075.332258:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+103:3760:x1830881262554112:12345-0@lo:2:osp-syn-1-1.0 Request processed in 159us (1226us total) trans 17179872289 rc 0/0 00000100:00100000:0.0:1746065075.332264:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7995 00000100:00100000:1.0:1746065075.332318:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262554240:0@lo:2:osp-syn-0-1.0 00010000:00080000:0.0:1746065075.332325:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065075.332333:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+255:27752:x1830881261153920:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 3905us (12677us total) trans 4294974904 rc 0/0 00000100:00100000:0.0:1746065075.332338:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11446 00000100:00100000:1.0:1746065075.332343:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262554368:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065075.332353:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.332357:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065075.332360:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.332364:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.332370:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.332373:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.332375:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262554496 00000100:00100000:1.0:1746065075.332378:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262554496 00010000:00010000:0.0:1746065075.332378:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.332386:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:0.0:1746065075.332388:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065075.332390:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.332393:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262554368 00000100:00100000:1.0:1746065075.332394:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262554368 00010000:00010000:0.0:1746065075.332394:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9200/0xad6b7ddc145e5d6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.332405:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7996 00000100:00100000:1.0:1746065075.332409:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+68:3759:x1830881262554496:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.332484:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+69:3759:x1830881262554496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (144us total) trans 21474839565 rc 0/0 00000100:00100000:1.0:1746065075.332489:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7996 00000100:00100000:1.0:1746065075.332500:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7997 00000100:00100000:1.0:1746065075.332504:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+103:3762:x1830881262554368:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.332553:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+104:3762:x1830881262554368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 48us (195us total) trans 17179872290 rc 0/0 00000100:00100000:1.0:1746065075.332558:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7997 00000100:00100000:1.0:1746065075.332574:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.332590:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262554240 00000100:00100000:1.0:1746065075.332593:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262554240 00000100:00100000:1.0:1746065075.332620:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7998 00000100:00100000:1.0:1746065075.332624:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+69:3761:x1830881262554240:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.332693:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+70:3761:x1830881262554240:12345-0@lo:2:osp-syn-0-1.0 Request processed in 68us (118us total) trans 21474839566 rc 0/0 00000100:00100000:1.0:1746065075.332698:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7998 00000004:00080000:0.0:1746065075.334109:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ccaa00/2, rc 0, transno 17179872290 00000100:00100000:0.0:1746065075.334117:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262554368:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.334476:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154304 00000100:00100000:0.0:1746065075.334481:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154304 00000100:00100000:0.0:1746065075.334511:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11448 00000100:00100000:0.0:1746065075.334516:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+254:27754:x1830881261154304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.334529:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.334531:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065075.334549:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e5cf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b536 expref: 254 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.334561:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065075.334570:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.334578:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8400/0xad6b7ddc145e5f2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b544 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.334661:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.334670:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.334677:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.334685:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.334689:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.334693:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.334951:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e607 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.334957:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e607 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.334962:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e607 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.335065:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00200000:0.0:1746065075.335642:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2fa:0x0]: returning size 0 00010000:00010000:0.0:1746065075.335670:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335676:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335684:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335689:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335693:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.335696:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335702:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335709:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:0.0:1746065075.335711:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.335714:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335718:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc145e5f9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:0.0:1746065075.335727:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed6300 reply state ffff88008f49e000 transno 4294974905 ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335734:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.335739:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47c00) 00010000:00010000:0.0:1746065075.335741:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065075.335743:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065075.335763:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8400/0xad6b7ddc145e5f2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b544 expref: 257 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.336418:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc145e607 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b544 expref: 256 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.336424:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff88008ec47500) 00010000:00010000:0.0:1746065075.336427:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065075.336429:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:0.0:1746065075.337809:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+257:27754:x1830881261154304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3288us (3583us total) trans 4294974905 rc 0/0 00000100:00100000:0.0:1746065075.337816:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11448 00000100:00100000:0.0:1746065075.340365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.341590:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.346352:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.346449:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261154944 00000100:00100000:1.0:1746065075.346456:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261154944 00000100:00100000:1.0:1746065075.346501:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7999 00000100:00100000:1.0:1746065075.346508:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261154944:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065075.346814:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.346876:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.346891:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baec00/0xad6b7ddc145e638 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b560 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.346910:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31a:0x0] initial LVB size: 5, mtime: 0x6812d6b3, atime: 0x0, ctime: 0x6812d6b3, blocks: 0x8 00010000:00010000:1.0:1746065075.346925:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.346927:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.346934:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baec00/0xad6b7ddc145e638 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b560 expref: 42 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.346946:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091baec00/0xad6b7ddc145e638 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b560 expref: 42 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.346954:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baec00, rc 0) 00000100:00100000:1.0:1746065075.346990:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261154944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 482us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.346996:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7999 00000100:00100000:0.0:1746065075.351480:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.351671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.351765:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155200 00000100:00100000:1.0:1746065075.351768:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155200 00000100:00100000:1.0:1746065075.351808:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8000 00000100:00100000:1.0:1746065075.351813:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881261155200:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065075.351887:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881261155200:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.351893:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8000 00000100:00100000:0.0:1746065075.354249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.354487:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.354700:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261155584 00000100:00100000:1.0:1746065075.354704:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261155584 00000100:00100000:1.0:1746065075.354726:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8001 00000100:00100000:1.0:1746065075.354730:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881261155584:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065075.355277:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881261155584:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 545us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.355283:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8001 00000100:00100000:0.0:1746065075.359343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.360204:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.360508:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156352 00000100:00100000:1.0:1746065075.360513:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156352 00000100:00100000:1.0:1746065075.360668:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11453 00000100:00100000:1.0:1746065075.360674:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+262:27752:x1830881261156352:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065075.360696:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.360710:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc145e623 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2f8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b552 expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.360720:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:1.0:1746065075.360723:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.360738:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.360744:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.360749:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065075.360813:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009835b480 reply state ffff88009a900000 transno 4294974910 ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.360820:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.360824:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:1.0:1746065075.360826:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.360829:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065075.361513:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27752:x1830881261156352:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 836us (1306us total) trans 4294974910 rc 0/0 00000100:00100000:1.0:1746065075.361527:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11453 00000100:00100000:0.0:1746065075.363688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.363739:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.363745:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261156480 00000100:00100000:1.0:1746065075.363751:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261156480 00000100:00100000:1.0:1746065075.363809:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8002 00000100:00100000:1.0:1746065075.363816:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881261156480:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065075.363925:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065075.363928:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb mtime from disk: 1746065075 -> 1746065075 00002000:00010000:1.0:1746065075.363930:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb atime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.363932:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb ctime from disk: 1746065075 -> 1746065075 00002000:00010000:1.0:1746065075.363933:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x31a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065075.363968:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881261156480:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 153us (286us total) trans 21474839567 rc 0/0 00000100:00100000:1.0:1746065075.363974:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8002 00000100:00100000:0.0:1746065075.366317:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.367744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.370480:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.372324:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.374458:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261157632 00000100:00100000:0.0:1746065075.374463:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261157632 00000100:00100000:0.0:1746065075.374488:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11457 00000100:00100000:0.0:1746065075.374493:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261157632:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065075.374505:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.374507:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065075.374521:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc145e68c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b575 expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.374546:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:0.0:1746065075.374549:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.374557:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e693 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b57c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.374814:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e69a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.374823:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e69a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.374830:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e69a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:0.0:1746065075.374945:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2221, 88 off184680 00000004:00080000:0.0:1746065075.374950:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671393176017ns, next at 672137633000ns, rc = 0 00000040:00080000:0.0:1746065075.374964:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2217, 88 off184240 00000004:00080000:0.0:1746065075.374967:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671393193604ns, next at 672137658713ns, rc = 0 00000040:00080000:0.0:1746065075.375181:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2218, 88 off184328 00000004:00080000:0.0:1746065075.375186:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671393412664ns, next at 672137658713ns, rc = 0 00000040:00080000:0.0:1746065075.375210:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2222, 88 off184768 00000004:00080000:0.0:1746065075.375213:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671393438937ns, next at 672137633000ns, rc = 0 00000001:00080000:1.0:1746065075.375228:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974913 is committed 00000004:00080000:1.0:1746065075.375235:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1493 committed 00000004:00080000:1.0:1746065075.375238:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1503 committed 00000004:00080000:1.0:1746065075.375239:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1502 committed 00000004:00080000:1.0:1746065075.375240:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1492 committed 00000100:00100000:1.0:1746065075.375300:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262555136:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065075.375341:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.375347:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065075.375348:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375353:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375358:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.375361:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375366:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375374:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47c00) 00000100:00100000:1.0:1746065075.375376:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262555136 00010000:00010000:0.0:1746065075.375377:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.375379:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262555136 00010000:00010000:0.0:1746065075.375380:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375384:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145e600 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375397:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375401:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065075.375402:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8003 00000100:00100000:1.0:1746065075.375406:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+104:3762:x1830881262555136:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065075.375406:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375410:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baee00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.375412:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375416:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375422:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:0.0:1746065075.375424:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.375425:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375429:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc145e669 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.375436:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.375440:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.375443:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.375447:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.375448:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.375452:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.375458:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:0.0:1746065075.375459:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.375461:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.375468:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e685 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065075.375493:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+105:3762:x1830881262555136:12345-0@lo:2:osp-syn-1-1.0 Request processed in 85us (145us total) trans 17179872291 rc 0/0 00000100:00100000:1.0:1746065075.375498:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8003 00000100:00100000:1.0:1746065075.375509:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262555264 00000100:00100000:1.0:1746065075.375511:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262555264 00000100:00100000:1.0:1746065075.375531:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8005 00000100:00100000:1.0:1746065075.375535:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+71:3760:x1830881262555264:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.375617:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+73:3760:x1830881262555264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 81us (132us total) trans 21474839568 rc 0/0 00000100:00100000:1.0:1746065075.375622:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8005 00000004:00080000:1.0:1746065075.375646:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52ad80/2, rc 0, transno 17179872291 00000100:00100000:1.0:1746065075.375651:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262555136:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065075.375994:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.375999:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.376003:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.376007:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.376009:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.376012:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.376018:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:0.0:1746065075.376020:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065075.376022:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.376026:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145e67e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065075.378630:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065075.383385:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974914 is committed 00000004:00080000:0.0:1746065075.383394:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1505 committed 00000004:00080000:0.0:1746065075.383409:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1495 committed 00000004:00080000:0.0:1746065075.383421:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1494 committed 00000004:00080000:0.0:1746065075.383423:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1504 committed 00010000:00010000:0.0:1746065075.383472:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e69a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b57c expref: 256 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.383481:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:0.0:1746065075.383483:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065075.383495:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e693 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b57c expref: 256 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065075.383509:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc145e69a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b57c expref: 255 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.383532:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:0.0:1746065075.383533:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065075.383535:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577bc00, rc 0) 00000100:00100000:0.0:1746065075.383574:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+255:26180:x1830881261157632:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9080us (9151us total) trans 4294974914 rc 0/0 00000100:00100000:0.0:1746065075.383580:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11457 00000100:00100000:1.0:1746065075.383754:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065075.383763:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262555520:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.384323:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.384713:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262555648:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.384874:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065075.384881:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262555776:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.385378:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8008 00000100:00100000:0.0:1746065075.385384:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+74:3759:x1830881262555392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.385457:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.385483:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262555776 00000100:00100000:1.0:1746065075.385486:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262555776 00000100:00100000:1.0:1746065075.385502:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8009 00000100:00100000:1.0:1746065075.385506:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+106:3760:x1830881262555776:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.385570:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+107:3760:x1830881262555776:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (113us total) trans 17179872293 rc 0/0 00000100:00100000:1.0:1746065075.385575:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8009 00000004:00080000:1.0:1746065075.385612:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cff100/2, rc 0, transno 17179872293 00000100:00100000:1.0:1746065075.385617:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262555776:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.386361:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+74:3759:x1830881262555392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 977us (1635us total) trans 21474839571 rc 0/0 00000100:00100000:0.0:1746065075.386366:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8008 00000100:00100000:0.0:1746065075.386379:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065075.386489:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834dc00/2, rc 0, transno 21474839570 00000100:00100000:0.0:1746065075.386492:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262555520:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.386539:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.386592:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262555648 00000100:00100000:1.0:1746065075.386603:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262555648 00000100:00100000:1.0:1746065075.386630:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8010 00000100:00100000:1.0:1746065075.386635:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+107:3762:x1830881262555648:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.387267:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+108:3762:x1830881262555648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 631us (886us total) trans 17179872294 rc 0/0 00000100:00100000:1.0:1746065075.387272:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8010 00010000:00010000:0.0:1746065075.387566:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.387571:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc145e6a8 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.387576:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.387579:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc145e6a8 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.387584:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc145e6a8 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.387605:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2f8:0x0].0x0 (ffff8800b4838f00) 00010000:00010000:0.0:1746065075.387608:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065075.387612:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc145e6a8 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.387616:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc145e6a8 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065075.387623:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.387624:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.387626:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065075.387665:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158144 00000100:00100000:1.0:1746065075.387668:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158144 00000100:00100000:1.0:1746065075.387686:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8011 00000100:00100000:1.0:1746065075.387690:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+45:26180:x1830881261158144:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.387700:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.387711:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b58a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.387725:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.387736:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.387738:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.387744:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b58a expref: 46 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.387753:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b58a expref: 46 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.387764:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4400, rc 0) 00000100:00100000:1.0:1746065075.388137:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881261158144:12345-192.168.202.27@tcp:101:bash.0 Request processed in 444us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.388143:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8011 00000100:00100000:0.0:1746065075.395077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.396461:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158272 00000100:00100000:1.0:1746065075.396471:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158272 00000100:00100000:1.0:1746065075.396528:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8012 00000100:00100000:1.0:1746065075.396536:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:26180:x1830881261158272:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.396551:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.396571:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b591 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.396592:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.396622:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.396624:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.396632:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b591 expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.396644:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b591 expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.396653:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ac00, rc 0) 00000100:00100000:1.0:1746065075.396715:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+44:26180:x1830881261158272:12345-192.168.202.27@tcp:101:bash.0 Request processed in 180us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.396722:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8012 00000100:00100000:0.0:1746065075.399132:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.402877:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.402924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.403096:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158656 00000100:00100000:1.0:1746065075.403103:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158656 00002000:00010000:1.0:1746065075.403136:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/797 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.403140:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009576d880 with x1830881261158656 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.403149:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009576d880. 00000100:00100000:1.0:1746065075.403179:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261158784 00000100:00100000:1.0:1746065075.403181:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261158784 00002000:00010000:1.0:1746065075.403190:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/796 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.403192:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009576f800 with x1830881261158784 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.403197:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009576f800. 00000100:00100000:1.0:1746065075.403208:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1195 00000100:00100000:1.0:1746065075.403213:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881261158656:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065075.403348:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.403351:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.403353:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.403355:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.403356:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.403394:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261158656:12345-192.168.202.27@tcp:10:bash.0 Request processed in 181us (523us total) trans 17179872295 rc 0/0 00000100:00100000:1.0:1746065075.403401:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1195 00002000:00010000:1.0:1746065075.403404:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/797 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.403405:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009576d880 with x1830881261158656 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.403409:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009576d880. 00000100:00100000:1.0:1746065075.403424:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1196 00000100:00100000:1.0:1746065075.403429:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261158784:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065075.403495:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.403497:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.403499:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.403501:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.403502:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.403520:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881261158784:12345-192.168.202.27@tcp:10:bash.0 Request processed in 91us (596us total) trans 21474839572 rc 0/0 00000100:00100000:1.0:1746065075.403526:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1196 00002000:00010000:1.0:1746065075.403528:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/796 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.403530:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009576f800 with x1830881261158784 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.403533:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009576f800. 00000100:00100000:0.0:1746065075.404164:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.404239:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159040 00000100:00100000:1.0:1746065075.404243:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159040 00000100:00100000:1.0:1746065075.404273:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3942 00000100:00100000:1.0:1746065075.404278:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+258:27755:x1830881261159040:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.404394:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+259:27755:x1830881261159040:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 116us (230us total) trans 4294974917 rc 0/0 00000100:00100000:1.0:1746065075.404400:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3942 00000100:00100000:0.0:1746065075.406027:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.406089:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261159296 00000100:00100000:1.0:1746065075.406094:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261159296 00000100:00100000:1.0:1746065075.406127:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3943 00000100:00100000:1.0:1746065075.406133:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+259:26180:x1830881261159296:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065075.406608:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+260:26180:x1830881261159296:12345-192.168.202.27@tcp:35:bash.0 Request processed in 463us (573us total) trans 4294974918 rc 0/0 00000100:00100000:1.0:1746065075.406614:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3943 00000100:00100000:0.0:1746065075.408746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.413450:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.413488:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.413637:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11462 00000100:00100000:0.0:1746065075.413645:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+262:27756:x1830881261159936:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1746065075.413655:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.413669:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e6fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b5ad expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.413716:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065075.413727:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.413736:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.413746:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065075.413750:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.413755:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.413835:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065075.413841:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.413847:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065075.415274:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.415716:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415721:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065075.415754:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2fa:0x0]: returning size 5 00000004:00200000:0.0:1746065075.415758:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065075.415800:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415809:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415818:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415823:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415828:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415833:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415838:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.415841:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415847:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415857:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893000) 00010000:00010000:0.0:1746065075.415860:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.415863:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415867:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc145e703 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415884:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415888:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415892:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415895:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.415897:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415901:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415907:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893c00) 00010000:00010000:0.0:1746065075.415909:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.415911:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415915:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc145e711 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.415934:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc145e6fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5ad expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.415944:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145e718 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5ad expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.415949:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:0.0:1746065075.415951:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065075.415952:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f182e00, rc 0) 00000100:00100000:0.0:1746065075.415965:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27756:x1830881261159936:12345-192.168.202.27@tcp:101:rm.0 Request processed in 2323us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.415970:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11462 00000100:00100000:0.0:1746065075.417636:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.418237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.420983:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.425693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.426508:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.429415:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.429739:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161088 00000100:00100000:1.0:1746065075.429745:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161088 00000100:00100000:1.0:1746065075.429817:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11467 00000100:00100000:1.0:1746065075.430264:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27757:x1830881261161088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.430279:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.430293:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc145e76c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b5c9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.430343:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.430352:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430362:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430369:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.430374:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430379:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430412:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430417:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430421:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430426:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430430:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.430434:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430442:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430451:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4f4c00) 00010000:00010000:1.0:1746065075.430453:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.430456:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430461:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145e773 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430485:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430490:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430495:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430499:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.430501:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430505:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430510:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554f400) 00010000:00010000:1.0:1746065075.430512:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.430514:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430517:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc145e77a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.430539:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc145e76c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5c9 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.430544:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc145e76c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5c9 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.430556:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:1.0:1746065075.430608:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27757:x1830881261161088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 347us (1198us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.430614:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11467 00000100:00100000:0.0:1746065075.431048:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.431205:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161216 00000100:00100000:1.0:1746065075.431211:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161216 00002000:00100000:1.0:1746065075.431236:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x31d:0x0] (0->4) req@ffff88012e37ca80 x1830881261161216/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:746/0 lens 496/0 e 0 to 0 dl 1746065086 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1746065075.431245:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ca80 with x1830881261161216 ext(0->4) 00010000:00010000:1.0:1746065075.431251:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b58a expref: 48 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.431263:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b58a expref: 48 pid: 1880 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746065075.431269:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e37ca80 00000100:00100000:1.0:1746065075.431296:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 202 00000100:00100000:1.0:1746065075.431301:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261161216:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:1.0:1746065075.431995:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261161216:12345-192.168.202.27@tcp:4:bash.0 Request processed in 691us (946us total) trans 17179872296 rc 0/0 00000100:00100000:1.0:1746065075.432001:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 202 00002000:00100000:1.0:1746065075.432006:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x31d:0x0] (0->4) req@ffff88012e37ca80 x1830881261161216/t17179872296(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:746/0 lens 496/448 e 0 to 0 dl 1746065086 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1746065075.432013:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ca80 with x1830881261161216 ext(0->4) 00010000:00010000:1.0:1746065075.432017:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b58a expref: 50 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.432026:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc145e6af lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b58a expref: 50 pid: 1880 timeout: 771 lvb_type: 0 00002000:00010000:1.0:1746065075.432031:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e37ca80 00000100:00100000:0.0:1746065075.433222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.433286:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161344 00000100:00100000:1.0:1746065075.433291:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161344 00000100:00100000:1.0:1746065075.433367:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11468 00000100:00100000:1.0:1746065075.433374:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27757:x1830881261161344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.433385:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.433398:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc145e781 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b5d0 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.433439:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e788 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.433446:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.433452:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.433483:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065075.433486:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065075.433503:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc145e781 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5d0 expref: 265 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.433512:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc145e788 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5d0 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.433515:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4f4f00) 00010000:00010000:1.0:1746065075.433517:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065075.433519:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4c00, rc 0) 00000100:00100000:1.0:1746065075.433548:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27757:x1830881261161344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 176us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.433556:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11468 00000100:00100000:0.0:1746065075.434765:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.437371:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.437510:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161728 00000100:00100000:1.0:1746065075.437516:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161728 00000100:00100000:1.0:1746065075.437553:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11469 00000100:00100000:1.0:1746065075.437558:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27755:x1830881261161728:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065075.437592:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.437621:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66a00/0xad6b7ddc145e749 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5bb expref: 264 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.437636:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:1.0:1746065075.437639:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.437660:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e78f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.437669:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e78f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.437676:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e78f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:1.0:1746065075.437853:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2225, 88 off184984 00000004:00080000:1.0:1746065075.437858:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671456083771ns, next at 672137633000ns, rc = 0 00000040:00080000:1.0:1746065075.437878:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2221, 88 off184544 00000004:00080000:1.0:1746065075.437881:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671456107328ns, next at 672137658713ns, rc = 0 00000040:00080000:1.0:1746065075.437902:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2222, 88 off184632 00000004:00080000:1.0:1746065075.437905:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671456131318ns, next at 672137658713ns, rc = 0 00000040:00080000:1.0:1746065075.437911:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2226, 88 off185072 00000004:00080000:1.0:1746065075.437913:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671456139620ns, next at 672137633000ns, rc = 0 00000100:00100000:1.0:1746065075.439035:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065075.441129:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974922 is committed 00000004:00080000:0.0:1746065075.441138:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1507 committed 00000004:00080000:0.0:1746065075.441145:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1497 committed 00010000:00010000:1.0:1746065075.441155:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000004:00080000:0.0:1746065075.441158:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1496 committed 00000004:00080000:0.0:1746065075.441160:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1506 committed 00010000:00010000:1.0:1746065075.441164:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.441170:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.441175:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.441179:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.441185:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.441200:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554f400) 00010000:00010000:1.0:1746065075.441202:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.441206:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.441211:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc145e73b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065075.441242:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262556288:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.441285:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.441935:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262556800:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.441956:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556288 00000100:00100000:1.0:1746065075.441959:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556288 00000100:00100000:1.0:1746065075.441976:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556544 00000100:00100000:1.0:1746065075.441978:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556544 00000100:00100000:1.0:1746065075.441986:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556416 00000100:00100000:1.0:1746065075.441988:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556416 00000100:00100000:1.0:1746065075.441999:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8014 00000100:00100000:1.0:1746065075.442003:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+109:3760:x1830881262556288:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065075.442017:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:795 count 1 00010000:00010000:1.0:1746065075.442031:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442042:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 47 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442048:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.442050:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.442052:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442070:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 47 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442081:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 47 pid: 11461 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.442091:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262557056:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.442117:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.442129:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065075.442140:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262557184:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.442162:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.442181:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262557184 00000100:00100000:0.0:1746065075.442183:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262557184 00000100:00100000:1.0:1746065075.442410:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8016 00000100:00100000:1.0:1746065075.442416:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+76:3762:x1830881262556416:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.442428:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8018 00000100:00100000:1.0:1746065075.442432:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262556672:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.442438:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8019 00000100:00100000:0.0:1746065075.442442:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+111:3761:x1830881262557184:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.442515:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+112:3761:x1830881262557184:12345-0@lo:2:osp-syn-1-1.0 Request processed in 72us (352us total) trans 17179872298 rc 0/0 00000100:00100000:0.0:1746065075.442519:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8019 00000004:00080000:0.0:1746065075.442542:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85ea00/2, rc 0, transno 17179872298 00000100:00100000:0.0:1746065075.442550:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262557184:0@lo:2:osp-syn-1-1.0 00002000:00080000:1.0:1746065075.442584:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:795 count 1 00002000:00010000:1.0:1746065075.442609:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.442613:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718c00/0xad6b7ddc145e7b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442620:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.442621:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.442623:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718c00/0xad6b7ddc145e7b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442631:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718c00/0xad6b7ddc145e7b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442636:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718c00/0xad6b7ddc145e7b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442646:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718c00/0xad6b7ddc145e7b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.442656:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065075.442798:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+77:3759:x1830881262556672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 365us (753us total) trans 21474839574 rc 0/0 00000100:00100000:1.0:1746065075.442803:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8018 00000100:00100000:1.0:1746065075.442811:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262557312 00000100:00100000:1.0:1746065075.442814:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262557312 00000100:00100000:1.0:1746065075.442825:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8020 00000100:00100000:1.0:1746065075.442829:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+112:3759:x1830881262557312:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.442881:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+113:3759:x1830881262557312:12345-0@lo:2:osp-syn-1-1.0 Request processed in 52us (86us total) trans 17179872299 rc 0/0 00000100:00100000:1.0:1746065075.442886:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8020 00000100:00100000:1.0:1746065075.442902:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.442988:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556800 00000100:00100000:0.0:1746065075.442991:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556800 00000100:00100000:0.0:1746065075.443011:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8021 00000100:00100000:0.0:1746065075.443015:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+77:3760:x1830881262556800:12345-0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065075.443035:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008d85dc00 reply state ffff88008c52ec00 transno 4294974922 ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e78f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.443044:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bafe00/0xad6b7ddc145e78f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.443049:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:1.0:1746065075.443051:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065075.443053:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1746065075.443056:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065075.443058:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb mtime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.443060:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.443061:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb ctime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.443063:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065075.443093:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+78:3760:x1830881262556800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (186us total) trans 21474839575 rc 0/0 00000100:00100000:0.0:1746065075.443098:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8021 00000004:00080000:1.0:1746065075.443309:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925c8380/2, rc 0, transno 21474839575 00000100:00100000:1.0:1746065075.443312:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262556800:0@lo:2:osp-syn-0-1.0 00010000:00080000:1.0:1746065075.443341:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065075.443360:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+256:27755:x1830881261161728:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 5801us (5994us total) trans 4294974922 rc 0/0 00000100:00100000:1.0:1746065075.443365:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11469 00000100:00100000:1.0:1746065075.446130:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262557056:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.446148:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.446541:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.446570:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.446617:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.446636:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162112 00000100:00100000:0.0:1746065075.446641:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162112 00000100:00100000:1.0:1746065075.446647:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261161984 00000100:00100000:1.0:1746065075.446649:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261161984 00010000:00010000:0.0:1746065075.446664:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 48 pid: 11461 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.446673:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162368 00000100:00100000:1.0:1746065075.446675:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162368 00000100:00100000:0.0:1746065075.446681:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3407 00000100:00100000:0.0:1746065075.446686:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261162112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065075.446692:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11471 00010000:00010000:0.0:1746065075.446695:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065075.446696:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+256:27755:x1830881261161984:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.446699:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 48 pid: 11461 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.446707:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 48 pid: 11461 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.446715:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.446724:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70b400/0xad6b7ddc145e519 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b505 expref: 48 pid: 11461 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.446726:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b5de expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446739:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.446740:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.446744:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446750:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.446763:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 257 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446765:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.446787:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 257 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.446802:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:1.0:1746065075.446805:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.446807:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:0.0:1746065075.446808:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261162112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.446814:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3407 00000100:00100000:1.0:1746065075.446820:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+257:27755:x1830881261161984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 124us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.446827:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11471 00010000:00010000:1.0:1746065075.446842:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.446847:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.446855:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.446861:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.446878:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065075.446879:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.446890:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.446895:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446900:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.446903:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446909:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446918:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446922:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c719a00/0xad6b7ddc145e7ab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.446936:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.446937:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.446938:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.446943:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261162496 00000100:00100000:0.0:1746065075.446946:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261162496 00010000:00010000:0.0:1746065075.446956:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091baec00/0xad6b7ddc145e638 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b560 expref: 45 pid: 9548 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746065075.446976:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3408 00000100:00100000:0.0:1746065075.446980:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261162496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.446989:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.446992:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091baec00/0xad6b7ddc145e638 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b560 expref: 45 pid: 9548 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746065075.447000:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091baec00/0xad6b7ddc145e638 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b560 expref: 45 pid: 9548 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746065075.447010:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.447012:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.447014:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.447019:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.447027:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065075.447034:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+112:3760:x1830881262556288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5029us (5748us total) trans 17179872300 rc 0/0 00000100:00100000:0.0:1746065075.447038:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261162496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.447040:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8014 00000100:00100000:0.0:1746065075.447043:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3408 00000004:00080000:1.0:1746065075.447066:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85ca80/2, rc 0, transno 17179872300 00000100:00100000:1.0:1746065075.447071:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262556288:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065075.448217:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.448222:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.448228:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.448230:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.448237:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.448247:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.448252:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f66c00/0xad6b7ddc145e7c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.448265:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.448266:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.448267:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065075.449889:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.451526:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.453569:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.453977:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.453997:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163136 00000100:00100000:0.0:1746065075.454000:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163136 00010000:00010000:0.0:1746065075.454017:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5e5 expref: 261 pid: 7231 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.454032:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3409 00000100:00100000:0.0:1746065075.454036:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+261:2005:x1830881261163136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.454042:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.454046:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5e5 expref: 261 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.454054:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5e5 expref: 261 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.454067:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae000/0xad6b7ddc145e7e3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5e5 expref: 261 pid: 7231 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.454078:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff880098c34000) 00010000:00010000:0.0:1746065075.454082:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145e806 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.454088:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145e806 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.454092:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145e806 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.454103:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065075.454116:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+260:2005:x1830881261163136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.454239:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3409 00000100:00100000:0.0:1746065075.456366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.456426:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163264 00000100:00100000:1.0:1746065075.456432:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163264 00000100:00100000:1.0:1746065075.456464:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8023 00000100:00100000:1.0:1746065075.456470:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2007:x1830881261163264:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065075.456543:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2007:x1830881261163264:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.456552:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8023 00000100:00100000:0.0:1746065075.459276:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.459689:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163520 00000100:00100000:1.0:1746065075.459697:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163520 00000100:00100000:1.0:1746065075.459746:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3944 00000100:00100000:1.0:1746065075.459753:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+259:27757:x1830881261163520:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.459995:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27757:x1830881261163520:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 242us (724us total) trans 4294974925 rc 0/0 00000100:00100000:1.0:1746065075.460002:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3944 00000100:00100000:0.0:1746065075.460863:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.461006:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163648 00000100:00100000:1.0:1746065075.461010:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163648 00000100:00100000:1.0:1746065075.461031:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8024 00000100:00100000:1.0:1746065075.461035:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881261163648:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065075.461092:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881261163648:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 56us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.461097:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8024 00000100:00100000:1.0:1746065075.467078:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.467124:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261163904 00000100:00100000:0.0:1746065075.467132:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261163904 00000100:00100000:1.0:1746065075.467170:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.467179:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3945 00000100:00100000:0.0:1746065075.467186:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27757:x1830881261163904:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065075.467364:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27757:x1830881261163904:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 177us (292us total) trans 4294974926 rc 0/0 00000100:00100000:0.0:1746065075.467370:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3945 00000100:00100000:0.0:1746065075.468972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.471606:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.473138:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.473608:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261164800 00000100:00100000:0.0:1746065075.473614:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261164800 00000100:00100000:0.0:1746065075.473647:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3946 00000100:00100000:0.0:1746065075.473653:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27755:x1830881261164800:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065075.473682:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x2fa:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc145e726 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2fa:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5b4 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.473703:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc145e845 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065075.473711:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 264 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.473716:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc145e845 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065075.473736:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 264 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.473744:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 264 pid: 7204 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.473754:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262557696:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.473823:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.476164:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.477293:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261164928 00000100:00100000:0.0:1746065075.477297:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261164928 00010000:00010000:0.0:1746065075.477314:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 266 pid: 7204 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.477331:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3410 00000100:00100000:0.0:1746065075.477337:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+266:2005:x1830881261164928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.477345:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.477349:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 266 pid: 7204 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.477358:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 266 pid: 7204 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.477370:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc145e7c7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5de expref: 266 pid: 7204 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.477379:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:0.0:1746065075.477383:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc145e845 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065075.477389:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc145e845 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065075.477398:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc145e845 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065075.477421:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065075.478221:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+266:2005:x1830881261164928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 882us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.478227:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3410 00000100:00100000:1.0:1746065075.480267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.480329:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165312 00000100:00100000:0.0:1746065075.480335:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165312 00000100:00100000:0.0:1746065075.480588:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11478 00000100:00100000:0.0:1746065075.480604:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+266:26180:x1830881261165312:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:0.0:1746065075.480646:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.480666:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145e837 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b601 expref: 266 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.480679:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff880098c34d00) 00010000:00010000:0.0:1746065075.480682:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.480845:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145e85a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065075.480855:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145e85a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.480863:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145e85a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:0.0:1746065075.480893:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294974930 00000004:00010000:0.0:1746065075.480910:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cff800 reply state ffff88009a999000 transno 4294974931 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145e85a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.480917:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc145e85a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.480921:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff880098c34d00) 00010000:00010000:0.0:1746065075.480923:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065075.480925:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065075.480989:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261165312:12345-192.168.202.27@tcp:36:bash.0 Request processed in 394us (727us total) trans 4294974931 rc 0/0 00000100:00100000:0.0:1746065075.480993:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11478 00000020:00080000:0.0:1746065075.480997:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1746065075.482112:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974929 is committed 00000004:00080000:0.0:1746065075.482119:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1509 committed 00000004:00080000:0.0:1746065075.482128:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1499 committed 00010000:00010000:1.0:1746065075.482222:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.482230:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.482235:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.482243:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.482246:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.482252:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.482260:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34600) 00010000:00010000:1.0:1746065075.482262:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.482264:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.482268:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145e7dc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00080000:0.0:1746065075.482922:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1498 committed 00000004:00080000:0.0:1746065075.482926:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1508 committed 00010000:00010000:1.0:1746065075.483864:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.483871:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.483876:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.483880:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.483883:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.483888:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.483896:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800b4838b00) 00010000:00010000:1.0:1746065075.483899:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.483901:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.483905:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc145e81b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065075.483970:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.483993:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261165440 00000100:00100000:1.0:1746065075.483999:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261165440 00000100:00100000:1.0:1746065075.484032:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11479 00000100:00100000:1.0:1746065075.484038:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+259:26180:x1830881261165440:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.484051:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.484061:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e861 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b60f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.484100:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e861 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b60f expref: 260 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.484109:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145e861 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b60f expref: 260 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.484121:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff880098c34d00) 00010000:00010000:1.0:1746065075.484123:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.484124:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:1.0:1746065075.484160:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:26180:x1830881261165440:12345-192.168.202.27@tcp:101:bash.0 Request processed in 122us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.484166:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11479 00000100:00100000:0.0:1746065075.484683:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262557952:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.484713:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.484747:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065075.484751:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262558080:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.484765:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.484944:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8026 00000100:00100000:0.0:1746065075.484951:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+113:3761:x1830881262557952:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065075.485031:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065075.485033:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb mtime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.485035:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb atime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.485037:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb ctime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.485039:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x31d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065075.485053:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+114:3761:x1830881262557952:12345-0@lo:2:osp-syn-1-1.0 Request processed in 104us (341us total) trans 17179872302 rc 0/0 00000100:00100000:0.0:1746065075.485060:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8026 00000100:00100000:0.0:1746065075.485067:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8029 00000100:00100000:0.0:1746065075.485071:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+79:3759:x1830881262557824:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065075.485100:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065075.485102:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb mtime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.485104:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.485105:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb ctime from disk: 1746065075 -> 1746065075 00002000:00010000:0.0:1746065075.485107:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x31c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065075.485120:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+80:3759:x1830881262557824:12345-0@lo:2:osp-syn-0-1.0 Request processed in 49us (235us total) trans 21474839578 rc 0/0 00000100:00100000:0.0:1746065075.485124:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8029 00000004:00080000:0.0:1746065075.485207:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bd180/2, rc 0, transno 21474839577 00000100:00100000:0.0:1746065075.485211:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262558080:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065075.485217:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abb8a80/2, rc 0, transno 17179872302 00000100:00100000:0.0:1746065075.485220:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262557952:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.486500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.487141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.487252:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11481 00000100:00100000:1.0:1746065075.487258:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+259:27755:x1830881261165824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.487268:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.487277:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e868 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b61d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.487309:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e868 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b61d expref: 260 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.487317:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718c00/0xad6b7ddc145e868 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b61d expref: 260 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.487327:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fa:0x0].0x0 (ffff8800ac4f4c00) 00010000:00010000:1.0:1746065075.487329:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.487331:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718c00, rc 0) 00000100:00100000:1.0:1746065075.487367:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+260:27755:x1830881261165824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.487372:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11481 00000001:00080000:0.0:1746065075.491347:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974932 is committed 00000004:00080000:0.0:1746065075.491446:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1501 committed 00000004:00080000:0.0:1746065075.491455:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1511 committed 00000004:00080000:0.0:1746065075.492689:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1510 committed 00000100:00100000:1.0:1746065075.493131:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065075.493143:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009835a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262558336:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065075.493207:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1500 committed 00000100:00100000:0.0:1746065075.493224:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262558464:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.493419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.493456:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262558336 00000100:00100000:1.0:1746065075.493459:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262558336 00000100:00100000:1.0:1746065075.493479:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8030 00000100:00100000:1.0:1746065075.493484:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+114:3759:x1830881262558336:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.493567:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+115:3759:x1830881262558336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 82us (148us total) trans 17179872304 rc 0/0 00000100:00100000:1.0:1746065075.493571:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8030 00000004:00080000:1.0:1746065075.493611:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009835a300/2, rc 0, transno 17179872304 00000100:00100000:1.0:1746065075.493618:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262558336:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.493661:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.493858:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262558720:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.493877:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.493910:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262558464 00000100:00100000:0.0:1746065075.493913:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262558464 00000100:00100000:0.0:1746065075.493928:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262558720 00000100:00100000:0.0:1746065075.493929:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262558720 00000100:00100000:0.0:1746065075.493937:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262558592 00000100:00100000:0.0:1746065075.493939:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262558592 00000100:00100000:0.0:1746065075.493947:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8031 00000100:00100000:0.0:1746065075.493951:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+115:3761:x1830881262558464:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.494008:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+116:3761:x1830881262558464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (346us total) trans 17179872305 rc 0/0 00000100:00100000:0.0:1746065075.494015:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8031 00000100:00100000:0.0:1746065075.494024:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8032 00000100:00100000:0.0:1746065075.494028:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+81:3759:x1830881262558720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.494091:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+82:3759:x1830881262558720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 63us (213us total) trans 21474839579 rc 0/0 00000100:00100000:0.0:1746065075.494096:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8032 00000004:00080000:0.0:1746065075.494115:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098359500/2, rc 0, transno 17179872305 00000100:00100000:0.0:1746065075.494120:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262558464:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065075.494133:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bea00/2, rc 0, transno 21474839579 00000100:00100000:0.0:1746065075.494137:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262558720:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.496335:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.496749:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166208 00000100:00100000:1.0:1746065075.496754:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166208 00000100:00100000:1.0:1746065075.496808:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8034 00000100:00100000:1.0:1746065075.496815:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+44:26180:x1830881261166208:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.496826:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.496843:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b624 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.496861:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.496875:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.496876:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.496882:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.496893:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.496900:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baee00, rc 0) 00000100:00100000:1.0:1746065075.496929:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+45:26180:x1830881261166208:12345-192.168.202.27@tcp:101:bash.0 Request processed in 115us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.496935:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8034 00000100:00100000:0.0:1746065075.499965:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.500043:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166336 00000100:00100000:1.0:1746065075.500049:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166336 00000100:00100000:1.0:1746065075.500092:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8035 00000100:00100000:1.0:1746065075.500098:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+49:26180:x1830881261166336:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.500111:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.500128:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baec00/0xad6b7ddc145e88b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b62b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.500203:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.500221:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.500223:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.500230:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baec00/0xad6b7ddc145e88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b62b expref: 50 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.500242:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baec00/0xad6b7ddc145e88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b62b expref: 50 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.500249:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baec00, rc 0) 00000100:00100000:1.0:1746065075.500293:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+50:26180:x1830881261166336:12345-192.168.202.27@tcp:101:bash.0 Request processed in 195us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.500299:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8035 00000100:00100000:0.0:1746065075.501507:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.501660:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.501770:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166592 00000100:00100000:1.0:1746065075.501801:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166592 00002000:00010000:1.0:1746065075.501823:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/799 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.501826:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed5880 with x1830881261166592 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.501833:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed5880. 00000100:00100000:1.0:1746065075.501854:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261166464 00000100:00100000:1.0:1746065075.501856:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261166464 00002000:00010000:1.0:1746065075.501863:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/798 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.501865:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ccb480 with x1830881261166464 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.501870:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ccb480. 00000100:00100000:1.0:1746065075.501883:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1197 00000100:00100000:1.0:1746065075.501888:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261166592:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065075.502006:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x31f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.502009:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x31f:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.502010:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x31f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.502012:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x31f:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.502014:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x31f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.503363:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881261166592:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1469us (1854us total) trans 17179872306 rc 0/0 00000100:00100000:1.0:1746065075.503370:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1197 00002000:00010000:1.0:1746065075.503373:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/799 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.503376:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed5880 with x1830881261166592 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.503381:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed5880. 00000100:00100000:0.0:1746065075.503982:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.507681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.514020:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.514111:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.514278:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167616 00000100:00100000:1.0:1746065075.514282:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167616 00000100:00100000:1.0:1746065075.514316:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11483 00000100:00100000:1.0:1746065075.514321:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27759:x1830881261167616:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065075.514970:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065075.514990:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc145e876 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2fc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b616 expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.515014:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145e8a7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b632 expref: 260 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.515023:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145e853 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b608 expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.515031:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff880098c34d00) 00010000:00010000:1.0:1746065075.515037:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.515054:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.515062:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515069:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515077:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145e8bc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.515081:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145e8bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515085:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145e8bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515136:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.515141:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515145:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:1.0:1746065075.515273:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2229, 64 off185176 00000040:00080000:1.0:1746065075.515287:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2233, 64 off185616 00000040:00080000:1.0:1746065075.515293:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2234, 64 off185680 00000040:00080000:1.0:1746065075.515310:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2230, 64 off185240 00010000:00010000:1.0:1746065075.515331:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.515337:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515342:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515347:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515351:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515355:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515365:0:7203:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065075.515375:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.515379:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515384:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abace00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.515387:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515393:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515399:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff88012f893c00) 00010000:00010000:1.0:1746065075.515401:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065075.515403:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515407:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e8ca lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515415:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.515417:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.515419:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.515427:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515433:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515437:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515441:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929fac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.515444:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515449:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515454:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fc:0x0].0x0 (ffff88012f893c00) 00010000:00010000:1.0:1746065075.515455:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065075.515457:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515461:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145e8c3 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x2fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515538:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515542:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515546:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515550:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515554:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.515556:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515560:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515565:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88013527f300) 00010000:00010000:1.0:1746065075.515566:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.515568:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515571:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145e8b5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065075.515579:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c528380 reply state ffff88009a903000 transno 4294974937 ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145e8bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515585:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145e8bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.515589:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065075.515591:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.515592:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065075.515628:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27759:x1830881261167616:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1306us (1516us total) trans 4294974937 rc 0/0 00000100:00100000:1.0:1746065075.515632:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11483 00000100:00100000:0.0:1746065075.517156:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.518612:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167744 00000100:00100000:1.0:1746065075.518621:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167744 00000100:00100000:1.0:1746065075.518674:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11484 00000100:00100000:1.0:1746065075.518682:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27758:x1830881261167744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.518703:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.518718:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e8d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b639 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.518764:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.519039:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519049:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519059:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.519065:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519070:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519104:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519109:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519115:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519119:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519124:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.519128:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519133:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519142:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065075.519144:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.519147:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519152:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e8d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519161:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519166:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519170:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519174:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abaca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.519176:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519180:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519185:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065075.519187:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.519189:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519197:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e8df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.519219:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e8d1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b639 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.519226:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e8d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b639 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.519235:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:1.0:1746065075.519486:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27758:x1830881261167744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 803us (2332us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.519492:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11484 00000100:00100000:0.0:1746065075.523016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.523224:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261167872 00000100:00100000:1.0:1746065075.523231:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261167872 00000100:00100000:1.0:1746065075.523277:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11485 00000100:00100000:1.0:1746065075.523285:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27760:x1830881261167872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.523301:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.523318:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e8e6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b640 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.523367:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.523377:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523387:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523398:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.523403:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523407:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523437:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523442:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523446:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523450:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523454:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.523457:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523461:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523469:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4838200) 00010000:00010000:1.0:1746065075.523472:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.523474:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523478:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e8ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523487:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523491:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523495:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523497:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.523499:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523502:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523506:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065075.523507:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.523509:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523513:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e8f4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.523532:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e8e6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b640 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.523537:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e8e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b640 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.523546:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:1.0:1746065075.523604:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27760:x1830881261167872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 311us (585us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.523610:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11485 00000100:00100000:0.0:1746065075.525841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.528247:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.528360:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261168128 00000100:00100000:1.0:1746065075.528366:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261168128 00000100:00100000:1.0:1746065075.528400:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11487 00000100:00100000:1.0:1746065075.528406:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27760:x1830881261168128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.528417:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.528429:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc145e910 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b64e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.528466:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e917 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.528475:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e917 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.528482:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e917 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.528520:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065075.528524:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065075.528548:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc145e910 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b64e expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.529590:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e917 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b64e expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.529608:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4838200) 00010000:00010000:1.0:1746065075.529610:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065075.529612:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:1.0:1746065075.529659:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27760:x1830881261168128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1253us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.529665:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11487 00000100:00100000:0.0:1746065075.530969:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.531030:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261168384 00000100:00100000:1.0:1746065075.531036:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261168384 00000100:00100000:1.0:1746065075.531203:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11488 00000100:00100000:1.0:1746065075.531210:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27761:x1830881261168384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.531223:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.531234:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e91e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b655 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.531287:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.531296:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531304:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531312:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.531318:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531323:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531349:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531355:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531360:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531365:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531370:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.531374:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531379:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531387:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4838200) 00010000:00010000:1.0:1746065075.531390:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.531392:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531396:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc145e925 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531405:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531409:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531413:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531417:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.531419:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531427:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531433:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065075.531435:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.531437:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531441:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e92c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.531460:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e91e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b655 expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.531467:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc145e91e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b655 expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.531472:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad800, rc 0) 00000100:00100000:1.0:1746065075.531510:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27761:x1830881261168384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 300us (543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065075.531515:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11488 00000100:00100000:0.0:1746065075.537668:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.541493:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.547394:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169024 00000100:00100000:0.0:1746065075.547401:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169024 00010000:00010000:0.0:1746065075.547437:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145e948 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b65c expref: 265 pid: 7205 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.547947:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3411 00000100:00100000:0.0:1746065075.547955:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+265:2005:x1830881261169024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.547966:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.547972:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145e948 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b65c expref: 265 pid: 7205 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.548707:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145e948 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b65c expref: 265 pid: 7205 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.548729:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145e948 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b65c expref: 265 pid: 7205 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.548802:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169280 00000100:00100000:1.0:1746065075.548807:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169280 00000100:00100000:1.0:1746065075.548833:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11491 00000100:00100000:1.0:1746065075.548838:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27762:x1830881261169280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.548852:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.548864:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e964 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b66a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.548928:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.548938:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.548945:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.548952:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.548957:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.548961:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549035:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.549039:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549044:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.549050:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2fe:0x0]: returning size 0 00010000:00010000:1.0:1746065075.549100:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549105:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549113:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549118:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.549121:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549126:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.549129:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34000) 00010000:00010000:0.0:1746065075.549134:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145e95d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.549140:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145e95d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.549144:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145e95d lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.549877:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34000) 00010000:00010000:1.0:1746065075.549880:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065075.549883:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549892:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145e979 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.549908:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.549909:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549914:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549919:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549923:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549927:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.549929:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549937:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549943:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4838200) 00010000:00010000:1.0:1746065075.549945:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.549946:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065075.549950:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+267:2005:x1830881261169024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1995us (2970us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065075.549951:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145e96b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549956:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065075.549959:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3411 00010000:00010000:1.0:1746065075.549960:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549964:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549968:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abace00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.549970:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549974:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549979:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065075.549981:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.549983:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.549987:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145e972 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.550012:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e964 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b66a expref: 266 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.550019:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145e964 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b66a expref: 266 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.550029:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abaca00, rc 0) 00000100:00100000:1.0:1746065075.550064:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27762:x1830881261169280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1225us (1306us total) trans 4294974939 rc 301/301 00000100:00100000:1.0:1746065075.550069:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11491 00000100:00100000:0.0:1746065075.555251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.559856:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261169792 00000100:00100000:0.0:1746065075.559864:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261169792 00000100:00100000:0.0:1746065075.559911:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3951 00000100:00100000:0.0:1746065075.559918:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27760:x1830881261169792:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065075.560550:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27760:x1830881261169792:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 632us (849us total) trans 4294974942 rc 0/0 00000100:00100000:0.0:1746065075.560556:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3951 00000100:00100000:0.0:1746065075.563540:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.563587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.567561:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.567616:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.567655:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.568340:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261170816 00000100:00100000:1.0:1746065075.568345:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261170816 00000100:00100000:1.0:1746065075.568378:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3952 00000100:00100000:1.0:1746065075.568384:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27762:x1830881261170816:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.568563:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27762:x1830881261170816:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 111us (839us total) trans 4294974944 rc 0/0 00000100:00100000:1.0:1746065075.568571:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3952 00000100:00100000:0.0:1746065075.569971:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.570627:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.572969:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.573659:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261171456 00000100:00100000:1.0:1746065075.573663:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261171456 00000100:00100000:1.0:1746065075.574067:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11497 00000100:00100000:1.0:1746065075.574074:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261171456:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.574088:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.574097:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e9fe lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b694 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.574126:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e9fe lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b694 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.574135:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145e9fe lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b694 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.574147:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34700) 00010000:00010000:1.0:1746065075.574150:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.574151:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:1.0:1746065075.574179:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261171456:12345-192.168.202.27@tcp:101:bash.0 Request processed in 106us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.574183:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11497 00000100:00100000:0.0:1746065075.576410:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.576485:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.576545:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261171712 00000100:00100000:1.0:1746065075.576551:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261171712 00000100:00100000:1.0:1746065075.576580:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3953 00000100:00100000:1.0:1746065075.576585:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27762:x1830881261171712:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.577568:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27762:x1830881261171712:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 982us (1163us total) trans 4294974948 rc 0/0 00000100:00100000:1.0:1746065075.577575:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3953 00000100:00100000:1.0:1746065075.579795:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172224 00000100:00100000:1.0:1746065075.579801:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172224 00000100:00100000:1.0:1746065075.579831:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11499 00000100:00100000:1.0:1746065075.579837:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27762:x1830881261172224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.579852:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.579866:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145ea13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b6a2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.579924:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.579935:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.579943:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.579952:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.579958:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.579963:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580030:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.580038:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580043:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.580051:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2fe:0x0]: returning size 2 00010000:00010000:1.0:1746065075.580097:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580103:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580108:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580113:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.580117:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580123:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580131:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34700) 00010000:00010000:1.0:1746065075.580134:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746065075.580137:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580141:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc145ea28 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580155:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580159:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580163:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580168:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580172:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abace00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.580174:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580178:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580182:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4838200) 00010000:00010000:1.0:1746065075.580184:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.580186:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580191:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145ea1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580197:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580201:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580205:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580208:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.580210:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580214:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580218:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065075.580220:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.580222:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580225:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abadc00/0xad6b7ddc145ea21 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.580248:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145ea13 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6a2 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.580254:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145ea13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6a2 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.580264:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abaca00, rc 0) 00000100:00100000:1.0:1746065075.580312:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27762:x1830881261172224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 475us (848us total) trans 4294974950 rc 301/301 00000100:00100000:1.0:1746065075.580317:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11499 00000001:00080000:0.0:1746065075.581152:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974949 is committed 00000004:00080000:0.0:1746065075.581157:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1513 committed 00000004:00080000:0.0:1746065075.581173:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1503 committed 00000004:00080000:0.0:1746065075.581177:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1502 committed 00000004:00080000:0.0:1746065075.581179:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1512 committed 00000100:00100000:0.0:1746065075.581302:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262559360:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.581346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.581366:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559360 00000100:00100000:1.0:1746065075.581370:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559360 00000100:00100000:0.0:1746065075.581385:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065075.581390:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262558976:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.581399:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8037 00000100:00100000:1.0:1746065075.581406:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+82:3759:x1830881262559360:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.581407:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.581417:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262559488:0@lo:2:osp-syn-0-1.0 00002000:00080000:1.0:1746065075.581424:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:799 count 1 00000100:00100000:0.0:1746065075.581429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.581444:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262559104:0@lo:6:osp-syn-0-1.0 00002000:00010000:1.0:1746065075.581446:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.581451:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.581457:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065075.581467:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065075.581468:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262559616:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065075.581469:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.581473:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.581478:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065075.581483:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.581488:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1746065075.581489:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.581491:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262559232:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065075.581494:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.581504:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065075.581510:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065075.581521:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262558976 00000100:00100000:0.0:1746065075.581524:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262558976 00000100:00100000:0.0:1746065075.581539:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559488 00000100:00100000:0.0:1746065075.581540:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559488 00000100:00100000:0.0:1746065075.581549:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559104 00000100:00100000:0.0:1746065075.581550:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559104 00000100:00100000:0.0:1746065075.581557:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559616 00000100:00100000:0.0:1746065075.581559:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559616 00000100:00100000:0.0:1746065075.581564:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559232 00000100:00100000:0.0:1746065075.581566:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559232 00000100:00100000:0.0:1746065075.581573:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8038 00000100:00100000:0.0:1746065075.581576:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+88:3759:x1830881262558976:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065075.581586:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:796 count 1 00010000:00010000:0.0:1746065075.581610:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581621:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b591 expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581627:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065075.581628:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065075.581630:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581648:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b591 expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581657:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b591 expref: 45 pid: 1880 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.581665:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+88:3759:x1830881262559360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 259us (318us total) trans 21474839582 rc 0/0 00000100:00100000:0.0:1746065075.581666:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262559744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.581671:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8037 00000100:00100000:1.0:1746065075.581685:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8039 00000100:00100000:1.0:1746065075.581690:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+87:3759:x1830881262559488:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.581706:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.581719:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8040 00000100:00100000:0.0:1746065075.581724:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+87:3761:x1830881262559104:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065075.581734:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:797 count 1 00002000:00010000:0.0:1746065075.581744:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065075.581748:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581754:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.581755:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065075.581757:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+88:3759:x1830881262559488:12345-0@lo:2:osp-syn-0-1.0 Request processed in 67us (327us total) trans 21474839583 rc 0/0 00010000:00010000:0.0:1746065075.581758:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.581762:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8039 00010000:00010000:0.0:1746065075.581765:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581771:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.581796:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.581800:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8041 00000100:00100000:1.0:1746065075.581805:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+87:3761:x1830881262559616:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065075.581806:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065075.581842:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8042 00000100:00100000:1.0:1746065075.581846:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+89:3761:x1830881262559232:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065075.581857:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:798 count 1 00010000:00010000:1.0:1746065075.581866:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581875:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581880:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.581881:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.581883:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.581892:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+89:3761:x1830881262559104:12345-0@lo:6:osp-syn-0-1.0 Request processed in 168us (433us total) trans 21474839584 rc 0/0 00000100:00100000:0.0:1746065075.581897:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8040 00010000:00010000:1.0:1746065075.581901:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581908:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 45 pid: 1880 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.581915:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098358000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262559872:192.168.202.27@tcp:104: 00000004:00080000:0.0:1746065075.581929:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc3b80/2, rc 0, transno 21474839584 00000100:00100000:0.0:1746065075.581933:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262559104:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.581952:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065075.581961:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065075.581967:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581973:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.581977:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581982:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581993:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.581998:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad800/0xad6b7ddc145ea36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582009:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.582013:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582017:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84bc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.582019:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582024:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582031:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582035:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84bc00/0xad6b7ddc145ea44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582042:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.582043:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.582044:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065075.582060:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ce9880/2, rc 0, transno 21474839583 00000100:00100000:1.0:1746065075.582063:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262559488:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065075.582068:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc3800/2, rc 0, transno 21474839582 00000100:00100000:1.0:1746065075.582071:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262559360:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.582106:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+88:3761:x1830881262559616:12345-0@lo:2:osp-syn-0-1.0 Request processed in 301us (626us total) trans 21474839585 rc 0/0 00000100:00100000:1.0:1746065075.582111:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8041 00000100:00100000:1.0:1746065075.582127:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262560128:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.582144:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.582155:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262560640:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.582167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.582177:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065075.582181:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262560256:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.582193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.582207:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560128 00000100:00100000:1.0:1746065075.582210:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560128 00000100:00100000:1.0:1746065075.582225:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560640 00000100:00100000:1.0:1746065075.582226:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560640 00000100:00100000:1.0:1746065075.582236:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560256 00000100:00100000:1.0:1746065075.582238:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560256 00000100:00100000:1.0:1746065075.582247:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8043 00000100:00100000:1.0:1746065075.582250:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+118:3759:x1830881262560128:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065075.582261:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:798 count 1 00002000:00010000:1.0:1746065075.582277:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.582281:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc145ea52 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582288:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.582289:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.582291:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc145ea52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582298:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc145ea52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582303:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc145ea52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582309:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc145ea52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582317:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065075.582409:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+119:3759:x1830881262560128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 157us (263us total) trans 17179872307 rc 0/0 00000100:00100000:1.0:1746065075.582414:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8043 00000100:00100000:1.0:1746065075.582424:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560000 00000100:00100000:1.0:1746065075.582426:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560000 00000100:00100000:1.0:1746065075.582434:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560512 00000100:00100000:1.0:1746065075.582435:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560512 00000100:00100000:1.0:1746065075.582441:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560384 00000100:00100000:1.0:1746065075.582442:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560384 00000100:00100000:1.0:1746065075.582449:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8044 00000100:00100000:1.0:1746065075.582453:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+121:3759:x1830881262560640:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.582510:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+122:3759:x1830881262560640:12345-0@lo:2:osp-syn-1-1.0 Request processed in 56us (341us total) trans 17179872308 rc 0/0 00000100:00100000:1.0:1746065075.582516:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8044 00000100:00100000:1.0:1746065075.582524:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8045 00000100:00100000:1.0:1746065075.582528:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+121:3759:x1830881262560256:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065075.582536:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:799 count 1 00010000:00010000:1.0:1746065075.582543:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582551:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baec00/0xad6b7ddc145e88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b62b expref: 51 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582561:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.582562:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065075.582564:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582579:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091baec00/0xad6b7ddc145e88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b62b expref: 51 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582587:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091baec00/0xad6b7ddc145e88b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b62b expref: 51 pid: 1880 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.582604:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262560768:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.582628:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065075.582635:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065075.582644:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8046 00000100:00100000:1.0:1746065075.582649:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+121:3762:x1830881262560000:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065075.582659:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:797 count 1 00010000:00010000:1.0:1746065075.582667:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582677:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66400/0xad6b7ddc145e80d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5fa expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.582681:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.582682:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.582684:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582697:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66400/0xad6b7ddc145e80d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5fa expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065075.582703:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f66400/0xad6b7ddc145e80d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b5fa expref: 51 pid: 9548 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746065075.582710:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262560896:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.582728:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe000 going to sleep for 11 seconds 00000004:00080000:1.0:1746065075.582745:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf800/2, rc 0, transno 17179872307 00000100:00100000:1.0:1746065075.582748:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262560128:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065075.582754:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8000/2, rc 0, transno 17179872308 00000100:00100000:1.0:1746065075.582757:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262560640:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065075.582960:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.582964:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ea67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582970:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.582972:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ea67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582978:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ea67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582986:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ea67 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.582999:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ea67 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.583009:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.583011:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.583012:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065075.584913:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ce8700/2, rc 0, transno 21474839585 00000100:00100000:0.0:1746065075.584920:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262559616:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.585094:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098358000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262559872:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.585105:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.585119:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262560768:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.585126:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.585137:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261172480 00000100:00100000:1.0:1746065075.585140:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261172480 00000100:00100000:1.0:1746065075.585159:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3954 00000100:00100000:1.0:1746065075.585163:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+257:27762:x1830881261172480:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.585268:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+258:27762:x1830881261172480:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 104us (195us total) trans 4294974951 rc 0/0 00000100:00100000:1.0:1746065075.585272:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3954 00000100:00100000:1.0:1746065075.585296:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3413 00000100:00100000:1.0:1746065075.585300:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261172736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065075.585304:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.585307:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 46 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.585312:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 46 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.585320:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baee00/0xad6b7ddc145e884 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b624 expref: 46 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.585325:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.585326:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.585327:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585331:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585338:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065075.585346:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261172736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.585349:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3413 00000100:00100000:1.0:1746065075.585375:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262560896:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.585381:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585389:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585396:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585400:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585404:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585410:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065075.585496:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+88:3761:x1830881262559232:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3649us (3990us total) trans 21474839586 rc 0/0 00000100:00100000:1.0:1746065075.585500:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8042 00010000:00010000:1.0:1746065075.585509:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.585512:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585515:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.585518:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585522:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585528:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585534:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145ea4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585543:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.585543:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.585544:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.585547:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585551:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585555:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585558:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.585563:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065075.585641:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+122:3759:x1830881262560256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3113us (3447us total) trans 17179872311 rc 0/0 00000100:00100000:1.0:1746065075.585645:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8045 00000004:00080000:1.0:1746065075.585660:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bd500/2, rc 0, transno 17179872311 00000100:00100000:1.0:1746065075.585663:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262560256:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065075.586132:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc3480/2, rc 0, transno 21474839586 00000100:00100000:0.0:1746065075.586138:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262559232:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065075.586156:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc145e6b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b591 expref: 44 pid: 1880 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.586165:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262559744:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065075.586176:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.586182:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.586188:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.586195:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.586201:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.586221:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065075.586305:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+88:3759:x1830881262558976:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4727us (4897us total) trans 21474839587 rc 0/0 00000100:00100000:0.0:1746065075.586311:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8038 00010000:00010000:1.0:1746065075.586389:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586400:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586406:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586412:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586421:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1746065075.586547:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+122:3762:x1830881262560000:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3897us (4220us total) trans 17179872312 rc 0/0 00000100:00100000:1.0:1746065075.586553:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8046 00010000:00010000:1.0:1746065075.586565:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1746065075.586569:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586574:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d927200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.586577:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586582:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586590:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586615:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927200/0xad6b7ddc145ea59 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586625:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065075.586628:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586633:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdae00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.586635:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586641:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586648:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586654:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc145ea3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586663:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.586665:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586670:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d927400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.586672:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586678:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586685:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586690:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc145ea60 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.586698:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.586700:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.586701:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065075.586713:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc0380/2, rc 0, transno 21474839587 00000100:00100000:1.0:1746065075.586716:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262558976:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065075.586835:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065075.586936:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.586969:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173120 00000100:00100000:0.0:1746065075.586972:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173120 00000100:00100000:1.0:1746065075.586984:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.586987:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8049 00000100:00100000:0.0:1746065075.586991:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+50:26180:x1830881261173120:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065075.586996:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173248 00000100:00100000:1.0:1746065075.586999:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173248 00010000:00010000:0.0:1746065075.586999:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.587007:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095668400/0xad6b7ddc145ea6e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b6a9 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.587014:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3955 00000100:00100000:1.0:1746065075.587019:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+258:27762:x1830881261173248:12345-192.168.202.27@tcp:33:lfs.0 00010000:00010000:0.0:1746065075.587020:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb400/0xad6b7ddc145e9a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b678 expref: 51 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.587025:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.587027:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.587029:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095668400/0xad6b7ddc145ea6e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6a9 expref: 51 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.587043:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdb400/0xad6b7ddc145e9a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b678 expref: 51 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.587051:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb400/0xad6b7ddc145e9a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b678 expref: 51 pid: 1880 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746065075.587059:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262561024:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.587085:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+258:27762:x1830881261173248:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 66us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.587091:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3955 00000100:00100000:0.0:1746065075.587094:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.588024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.592414:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.594093:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.595039:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.595077:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261173888 00000100:00100000:1.0:1746065075.595081:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261173888 00000100:00100000:0.0:1746065075.595084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065075.595103:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/801 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.595111:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009570f100 with x1830881261173888 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.595118:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009570f100. 00000100:00100000:1.0:1746065075.595141:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174016 00000100:00100000:1.0:1746065075.595144:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174016 00002000:00010000:1.0:1746065075.595152:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/800 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.595155:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009570df80 with x1830881261174016 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.595159:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009570df80. 00000100:00100000:1.0:1746065075.595170:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1199 00000100:00100000:1.0:1746065075.595176:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261173888:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065075.595730:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x321:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.595946:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x321:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.595948:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x321:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.595950:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x321:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:1.0:1746065075.595951:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x321:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.596190:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261173888:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1013us (1150us total) trans 17179872313 rc 0/0 00000100:00100000:1.0:1746065075.596197:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1199 00002000:00010000:1.0:1746065075.596199:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/801 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.596201:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009570f100 with x1830881261173888 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.596206:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009570f100. 00000100:00100000:0.0:1746065075.599770:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.599827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.600033:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174272 00000100:00100000:1.0:1746065075.600044:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174272 00000100:00100000:1.0:1746065075.600089:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261174528 00000100:00100000:1.0:1746065075.600091:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261174528 00000100:00100000:1.0:1746065075.600099:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3956 00000100:00100000:1.0:1746065075.600104:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+261:27763:x1830881261174272:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.600348:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27763:x1830881261174272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 242us (583us total) trans 4294974953 rc 0/0 00000100:00100000:1.0:1746065075.600353:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3956 00000100:00100000:0.0:1746065075.602921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.606608:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.606649:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.607153:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc145eaa6 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.607159:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc145eaa6 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x2fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065075.607171:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2fe:0x0]: returning size 5 00010000:00010000:0.0:1746065075.607252:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc145ea9f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6be expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.607267:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc145eaa6 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6be expref: 262 pid: 7204 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.607273:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc145eaa6 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x2fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6be expref: 262 pid: 7204 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.607278:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:0.0:1746065075.607298:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27763:x1830881261174784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4252us (4383us total) trans 4294974955 rc 0/0 00000100:00100000:0.0:1746065075.607303:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11501 00000100:00100000:0.0:1746065075.609751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.617929:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.621923:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.621964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.621991:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175552 00000100:00100000:1.0:1746065075.621999:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175552 00000100:00100000:1.0:1746065075.622034:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261175808 00000100:00100000:1.0:1746065075.622035:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261175808 00000100:00100000:1.0:1746065075.622051:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11505 00000100:00100000:1.0:1746065075.622056:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27763:x1830881261175808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.622066:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.622079:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145ead7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b6d3 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.622158:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eaec lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.622165:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eaec lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.622172:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eaec lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065075.622183:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x2fe:0x0]: returning size 5 00010000:00010000:1.0:1746065075.622262:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145ead7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6d3 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.622290:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eaec lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6d3 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.622297:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:1.0:1746065075.622300:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065075.622302:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:1.0:1746065075.622337:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27763:x1830881261175808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 281us (372us total) trans 4294974957 rc 0/0 00000100:00100000:1.0:1746065075.622342:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11505 00000100:00100000:0.0:1746065075.624971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.625014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.627150:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.628070:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.631177:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.631845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.635321:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261176960 00000100:00100000:0.0:1746065075.635327:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261176960 00000100:00100000:0.0:1746065075.635364:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177088 00000100:00100000:0.0:1746065075.635366:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177088 00000100:00100000:0.0:1746065075.635382:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11509 00000100:00100000:0.0:1746065075.635387:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27763:x1830881261176960:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065075.635419:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.635437:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145ead0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6c5 expref: 267 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.635486:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11510 00000100:00100000:1.0:1746065075.635493:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27765:x1830881261177088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.635500:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.635501:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065075.635511:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc145eb24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6e1 expref: 266 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.635529:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34700) 00010000:00010000:1.0:1746065075.635536:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.635545:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145eb40 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b6ef expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.635618:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.635627:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635634:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635641:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145eb4e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.635646:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145eb4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635651:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145eb4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635940:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x300:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.635947:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x300:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635952:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x300:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.635960:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x300:0x0]: returning size 0 00010000:00010000:1.0:1746065075.635981:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635987:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635992:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.635997:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.636001:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.636004:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.636009:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.636015:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065075.636018:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.636020:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.636024:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eb47 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065075.636033:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a649180 reply state ffff88009522c000 transno 4294974958 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145eb4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.636039:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145eb4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.636043:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:1.0:1746065075.636045:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.636047:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065075.636064:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145eb40 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6ef expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.636074:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x300:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6ef expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.636079:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x300:0x0].0x0 (ffff88012f854300) 00010000:00010000:1.0:1746065075.636080:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.636082:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090790600, rc 0) 00000100:00100000:1.0:1746065075.636118:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27765:x1830881261177088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 626us (920us total) trans 4294974958 rc 0/0 00000100:00100000:1.0:1746065075.636123:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11510 00010000:00010000:0.0:1746065075.637150:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:0.0:1746065075.637155:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.637172:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145eb63 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065075.637180:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145eb63 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.637186:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145eb63 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:0.0:1746065075.637321:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2237, 88 off185944 00000004:00080000:0.0:1746065075.637327:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671655552617ns, next at 672137633000ns, rc = 0 00000040:00080000:0.0:1746065075.637364:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2233, 88 off185504 00000004:00080000:0.0:1746065075.637368:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671655594466ns, next at 672137658713ns, rc = 0 00000040:00080000:0.0:1746065075.637390:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2234, 88 off185592 00000004:00080000:0.0:1746065075.637393:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671655619097ns, next at 672137658713ns, rc = 0 00000040:00080000:0.0:1746065075.637401:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2238, 88 off186032 00000004:00080000:0.0:1746065075.637404:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671655630107ns, next at 672137633000ns, rc = 0 00000001:00080000:0.0:1746065075.639812:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974959 is committed 00000004:00080000:0.0:1746065075.639821:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1515 committed 00000004:00080000:0.0:1746065075.639833:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1505 committed 00000004:00080000:0.0:1746065075.639837:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1504 committed 00000004:00080000:0.0:1746065075.639839:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1514 committed 00000004:00010000:0.0:1746065075.639879:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a648700 reply state ffff880098586800 transno 4294974959 ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145eb63 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.639896:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc145eb63 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.639901:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:0.0:1746065075.639904:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065075.639906:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746065075.639973:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065075.639986:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+259:27763:x1830881261176960:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 4594us (4811us total) trans 4294974959 rc 0/0 00000100:00100000:0.0:1746065075.639993:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11509 00000100:00100000:1.0:1746065075.640094:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065075.640107:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262561536:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.640143:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.640187:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262561536 00000100:00100000:1.0:1746065075.640192:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262561536 00000100:00100000:1.0:1746065075.640215:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8052 00000100:00100000:1.0:1746065075.640220:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+88:3759:x1830881262561536:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065075.640308:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x320:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.640311:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x320:0x0] updating lvb mtime from disk: 1746065075 -> 1746065075 00002000:00010000:1.0:1746065075.640313:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x320:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.640314:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x320:0x0] updating lvb ctime from disk: 1746065075 -> 1746065075 00002000:00010000:1.0:1746065075.640315:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x320:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.640337:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+89:3759:x1830881262561536:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (194us total) trans 21474839589 rc 0/0 00000100:00100000:1.0:1746065075.640342:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8052 00000004:00080000:1.0:1746065075.640370:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da680/2, rc 0, transno 21474839589 00000100:00100000:1.0:1746065075.640374:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262561536:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065075.640420:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.640467:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177344 00000100:00100000:1.0:1746065075.640470:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177344 00000100:00100000:1.0:1746065075.640488:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11511 00000100:00100000:1.0:1746065075.640493:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+259:27765:x1830881261177344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.640503:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.640513:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145eb6a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x300:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b6f6 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.640570:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc145eb71 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x300:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065075.640581:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x300:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6ef expref: 260 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.640591:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc145eb71 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x300:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065075.640621:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x300:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6ef expref: 260 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.640634:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145eb55 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x300:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6ef expref: 260 pid: 7203 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.640642:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262561792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.640654:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262561664:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.640678:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.640681:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.640708:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262561664 00000100:00100000:0.0:1746065075.640711:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262561664 00000100:00100000:0.0:1746065075.640727:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8053 00000100:00100000:0.0:1746065075.640731:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+89:3761:x1830881262561664:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.640812:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+90:3761:x1830881262561664:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (132us total) trans 21474839590 rc 0/0 00000100:00100000:0.0:1746065075.640818:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8053 00000100:00100000:0.0:1746065075.640829:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8054 00000100:00100000:0.0:1746065075.640833:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+122:3759:x1830881262562048:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.640903:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+124:3759:x1830881262562048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (132us total) trans 17179872315 rc 0/0 00000100:00100000:0.0:1746065075.640909:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8054 00000004:00080000:0.0:1746065075.640933:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957dad80/2, rc 0, transno 21474839590 00000100:00100000:0.0:1746065075.640937:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262561664:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.643054:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.643371:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261177472 00000100:00100000:1.0:1746065075.643376:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261177472 00000100:00100000:1.0:1746065075.644089:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11512 00000100:00100000:1.0:1746065075.644095:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:27763:x1830881261177472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.644112:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.644125:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145eb78 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b6fd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.644165:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145eb78 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6fd expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.644175:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc145eb78 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6fd expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.644189:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:1.0:1746065075.644191:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.644194:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9dc00, rc 0) 00000100:00100000:1.0:1746065075.644228:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+259:27763:x1830881261177472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 132us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.644233:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11512 00000100:00100000:0.0:1746065075.644860:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.646999:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.648946:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.651635:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.651728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.651806:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261178240 00000100:00100000:1.0:1746065075.651813:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261178240 00000100:00100000:1.0:1746065075.651854:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3959 00000100:00100000:1.0:1746065075.651861:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+259:27765:x1830881261178240:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.653820:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+260:27765:x1830881261178240:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1959us (2190us total) trans 4294974962 rc 0/0 00000100:00100000:1.0:1746065075.653826:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3959 00000100:00100000:0.0:1746065075.657078:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.661150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.664668:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.668890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.668938:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.669446:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11517 00000100:00100000:1.0:1746065075.669453:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27763:x1830881261179520:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065075.669470:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.669481:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857c00/0xad6b7ddc145eb8d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x2fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b704 expref: 264 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.669498:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:1.0:1746065075.669501:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.669522:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.669537:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.669544:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065075.669678:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098671500 reply state ffff88009a902000 transno 4294974964 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.669686:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.669691:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:1.0:1746065075.669693:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.669695:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065075.669959:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27763:x1830881261179520:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 505us (1020us total) trans 4294974964 rc 0/0 00000100:00100000:1.0:1746065075.669965:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11517 00000100:00100000:0.0:1746065075.671373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.672076:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.675435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.675478:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.679409:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.682151:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682159:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682165:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682170:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.682173:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682179:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682191:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:0.0:1746065075.682194:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.682197:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682201:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145ebcc lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.682216:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.682221:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.682226:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.682229:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.682231:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.682236:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.682241:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x300:0x0].0x0 (ffff880098c34d00) 00010000:00010000:0.0:1746065075.682243:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.682244:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065075.682248:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc145ebd3 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x300:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065075.682723:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262562304:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.682768:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.682824:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262562304 00000100:00100000:0.0:1746065075.682829:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262562304 00000100:00100000:0.0:1746065075.682857:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8060 00000100:00100000:0.0:1746065075.682862:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+90:3760:x1830881262562304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.682969:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+91:3760:x1830881262562304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 106us (200us total) trans 21474839591 rc 0/0 00000100:00100000:0.0:1746065075.682974:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8060 00000004:00080000:0.0:1746065075.683001:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45a680/2, rc 0, transno 21474839591 00000100:00100000:0.0:1746065075.683005:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262562304:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065075.683931:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145ebef lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x300:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b727 expref: 260 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.683939:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x300:0x0].0x0 (ffff880098c34d00) 00010000:00010000:0.0:1746065075.683942:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065075.683952:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ebe8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x300:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b727 expref: 260 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065075.683964:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc145ebef lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x300:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b727 expref: 259 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.683987:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x300:0x0].0x0 (ffff880098c34d00) 00010000:00010000:0.0:1746065075.683989:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065075.683991:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fa000, rc 0) 00000100:00100000:0.0:1746065075.684038:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+259:26180:x1830881261180288:12345-192.168.202.27@tcp:101:bash.0 Request processed in 8450us (8558us total) trans 4294974967 rc 0/0 00000100:00100000:0.0:1746065075.684045:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11519 00000001:00080000:0.0:1746065075.687602:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294974968 is committed 00000004:00080000:0.0:1746065075.687613:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1519 committed 00000004:00080000:0.0:1746065075.687750:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1509 committed 00000004:00080000:0.0:1746065075.688860:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1508 committed 00000004:00080000:0.0:1746065075.688862:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1518 committed 00000100:00100000:0.0:1746065075.688885:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262562816:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065075.689264:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065075.689271:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262563072:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.689313:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.689343:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065075.689346:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262563200:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.689362:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.689380:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262563200 00000100:00100000:0.0:1746065075.689382:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262563200 00000100:00100000:0.0:1746065075.689398:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8065 00000100:00100000:0.0:1746065075.689401:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+127:3760:x1830881262562816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065075.689474:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8066 00000100:00100000:0.0:1746065075.689478:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+92:3760:x1830881262563200:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.689541:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+93:3760:x1830881262563200:12345-0@lo:2:osp-syn-0-1.0 Request processed in 63us (178us total) trans 21474839593 rc 0/0 00000100:00100000:0.0:1746065075.689547:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8066 00000004:00080000:0.0:1746065075.689572:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a92a00/2, rc 0, transno 21474839593 00000100:00100000:0.0:1746065075.689576:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262563200:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065075.689583:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dce00/2, rc 0, transno 17179872320 00000100:00100000:0.0:1746065075.689585:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262562816:0@lo:2:osp-syn-1-1.0 00000004:00010000:0.0:1746065075.689628:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b4111450 reply state ffff8800985b8400 transno 4294974968 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145ebe1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.689641:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145ebe1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x2fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.689691:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:0.0:1746065075.689693:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065075.689696:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065075.689701:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff880098c34e00) 00010000:00010000:0.0:1746065075.689703:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065075.689708:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eaec lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6d3 expref: 257 pid: 7204 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065075.689790:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065075.689844:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065075.689902:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.689917:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261180544 00000100:00100000:1.0:1746065075.689920:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261180544 00000100:00100000:1.0:1746065075.689937:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8068 00000100:00100000:1.0:1746065075.689941:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881261180544:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.689948:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.689958:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1c00/0xad6b7ddc145ebf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b72e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.689969:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.689981:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.689983:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.689987:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1c00/0xad6b7ddc145ebf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b72e expref: 47 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.690002:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1c00/0xad6b7ddc145ebf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b72e expref: 47 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.690009:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1c00, rc 0) 00000100:00100000:1.0:1746065075.690024:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+47:26180:x1830881261180544:12345-192.168.202.27@tcp:101:bash.0 Request processed in 83us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.690030:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8068 00000100:00100000:0.0:1746065075.690049:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+257:27763:x1830881261180032:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 14193us (14369us total) trans 4294974968 rc 0/0 00000100:00100000:0.0:1746065075.690056:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3960 00000100:00100000:0.0:1746065075.691493:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.691535:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.696881:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261181056 00000100:00100000:0.0:1746065075.696889:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261181056 00000100:00100000:0.0:1746065075.696921:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3961 00000100:00100000:0.0:1746065075.696928:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+257:27763:x1830881261181056:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065075.697123:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x2fe:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065075.697181:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2243, 64 off186448 00000040:00080000:0.0:1746065075.697203:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2239, 64 off186008 00000040:00080000:0.0:1746065075.697212:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2240, 64 off186072 00000040:00080000:0.0:1746065075.697221:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2244, 64 off186512 00010000:00010000:0.0:1746065075.697263:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:0.0:1746065075.697275:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.697287:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.697294:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.697299:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.697304:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065075.697314:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065075.697440:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+258:27763:x1830881261181056:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 512us (746us total) trans 4294974969 rc 0/0 00000100:00100000:0.0:1746065075.697446:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3961 00000100:00100000:0.0:1746065075.697468:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1202 00000100:00100000:0.0:1746065075.697473:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+55:2004:x1830881261181312:12345-192.168.202.27@tcp:10:bash.0 00010000:00010000:1.0:1746065075.697680:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.697686:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065075.697692:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.697702:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065075.697707:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065075.697717:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x2fe:0x0].0x0 (ffff88012ef2ab00) 00010000:00010000:1.0:1746065075.697720:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065075.697723:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 1/0,0 mode: --/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065075.697727:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145ec0b lrc: 0/0,0 mode: --/PW res: [0x240000403:0x2fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065075.697739:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.697740:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.697742:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1746065075.697942:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x323:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065075.697945:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x323:0x0] updating lvb mtime from disk: 0 -> 1746065075 00002000:00010000:0.0:1746065075.697946:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x323:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.697948:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x323:0x0] updating lvb ctime from disk: 0 -> 1746065075 00002000:00010000:0.0:1746065075.697949:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x323:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065075.697967:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881261181312:12345-192.168.202.27@tcp:10:bash.0 Request processed in 494us (1151us total) trans 17179872322 rc 0/0 00000100:00100000:0.0:1746065075.697973:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1202 00002000:00010000:0.0:1746065075.697975:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/803 (0->18446744073709551615) 00002000:00100000:0.0:1746065075.697977:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a64bb80 with x1830881261181312 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065075.697981:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a64bb80. 00000100:00100000:0.0:1746065075.705404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.705471:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261181568 00000100:00100000:1.0:1746065075.705479:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261181568 00000100:00100000:1.0:1746065075.705528:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3962 00000100:00100000:1.0:1746065075.705535:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+258:26180:x1830881261181568:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065075.705825:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+259:26180:x1830881261181568:12345-192.168.202.27@tcp:35:bash.0 Request processed in 289us (429us total) trans 4294974970 rc 0/0 00000100:00100000:1.0:1746065075.705831:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3962 00000100:00100000:0.0:1746065075.709270:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.713383:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.713434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.713523:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261182336 00000100:00100000:1.0:1746065075.713527:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261182336 00000100:00100000:1.0:1746065075.713556:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3963 00000100:00100000:1.0:1746065075.713563:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27766:x1830881261182336:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.714236:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+260:27766:x1830881261182336:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 672us (800us total) trans 4294974972 rc 0/0 00000100:00100000:1.0:1746065075.714243:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3963 00010000:00010000:0.0:1746065075.714997:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.715002:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145ec4a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x300:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.715007:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a528a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.715010:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145ec4a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x300:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.715015:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145ec4a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x300:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.715022:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x300:0x0].0x0 (ffff88012ef2ac00) 00010000:00010000:0.0:1746065075.715024:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065075.715026:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145ec4a lrc: 1/0,0 mode: --/PW res: [0x240000403:0x300:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.715030:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145ec4a lrc: 0/0,0 mode: --/PW res: [0x240000403:0x300:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.715045:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.715046:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.715047:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.726140:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.731920:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.736454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.736531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.740379:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.746340:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.755161:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.755827:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.755902:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261183744 00000100:00100000:1.0:1746065075.755910:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261183744 00000100:00100000:1.0:1746065075.755954:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184000 00000100:00100000:1.0:1746065075.755956:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184000 00000100:00100000:1.0:1746065075.755969:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11530 00000100:00100000:1.0:1746065075.755976:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27770:x1830881261183744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.755994:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.756007:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc145eceb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b77b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.756088:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc145ecf2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.756099:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc145ecf2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.756108:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc145ecf2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.756116:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x302:0x0]: returning size 0 00010000:00010000:1.0:1746065075.756187:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc145eceb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b77b expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.756205:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc145ecf2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b77b expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.756211:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x302:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:1.0:1746065075.756214:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.756216:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1000, rc 0) 00000100:00100000:1.0:1746065075.756251:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27770:x1830881261183744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 276us (1098us total) trans 4294974975 rc 0/0 00000100:00100000:1.0:1746065075.756257:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11530 00000100:00100000:1.0:1746065075.756270:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11531 00000100:00100000:1.0:1746065075.756274:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27768:x1830881261184000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.756279:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.756284:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc145ed00 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b782 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.758215:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.758564:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.758574:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145ecdd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b774 expref: 266 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.758584:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.758617:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145ecdd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b774 expref: 266 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.758627:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145ecdd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b774 expref: 266 pid: 7231 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.758637:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262563328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065075.758693:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065075.761460:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262563328:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.761478:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065075.762117:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.762739:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.762745:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.762765:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x302:0x0]: returning size 0 00000004:00080000:1.0:1746065075.763246:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x325:0x0], index 1: 0 00000004:00080000:1.0:1746065075.763251:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x324:0x0], index 0: 0 00000004:00080000:1.0:1746065075.763254:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x325:0x0], index 0: 0 00000004:00080000:1.0:1746065075.763257:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x326:0x0], index 1: 0 00010000:00010000:1.0:1746065075.763326:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763335:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763340:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763344:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090790600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.763347:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763351:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763358:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x302:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:1.0:1746065075.763360:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065075.763362:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763365:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc145ed07 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x302:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.763397:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc145ed00 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b782 expref: 266 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.763404:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc145ed00 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b782 expref: 266 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.763413:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:1.0:1746065075.763446:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27768:x1830881261184000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7171us (7620us total) trans 4294974976 rc 301/301 00000100:00100000:1.0:1746065075.763451:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11531 00000100:00100000:0.0:1746065075.766251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.766397:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184512 00000100:00100000:1.0:1746065075.766403:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184512 00000100:00100000:1.0:1746065075.766435:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3964 00000100:00100000:1.0:1746065075.766440:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27768:x1830881261184512:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.766626:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27768:x1830881261184512:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 185us (381us total) trans 4294974977 rc 0/0 00000100:00100000:1.0:1746065075.766631:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3964 00000100:00100000:0.0:1746065075.768504:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.769417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.769460:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261184896 00000100:00100000:1.0:1746065075.769464:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261184896 00000100:00100000:1.0:1746065075.769496:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11532 00000100:00100000:1.0:1746065075.769501:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27770:x1830881261184896:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.769511:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.769547:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145ed15 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b789 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.769638:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ed1c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.769649:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ed1c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.769658:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ed1c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065075.769677:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x302:0x0]: returning size 0 00000004:00200000:1.0:1746065075.769680:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065075.769690:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ed1c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.769707:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145ed15 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x302:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b789 expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.769719:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145ed1c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b789 expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.769726:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x302:0x0].0x0 (ffff88012f854900) 00010000:00010000:1.0:1746065075.769728:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.769731:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:1.0:1746065075.770515:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27770:x1830881261184896:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1011us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.770521:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11532 00000100:00100000:0.0:1746065075.775074:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.775484:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.776933:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.777000:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261185536 00000100:00100000:1.0:1746065075.777004:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261185536 00000100:00100000:1.0:1746065075.777038:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3966 00000100:00100000:1.0:1746065075.777044:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27770:x1830881261185536:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.777132:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27770:x1830881261185536:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 87us (200us total) trans 4294974980 rc 0/0 00000100:00100000:1.0:1746065075.777138:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3966 00000100:00100000:0.0:1746065075.777648:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.778232:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.778297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.780214:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.781915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.783338:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.786652:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.791161:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187328 00000100:00100000:0.0:1746065075.791167:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187328 00000100:00100000:0.0:1746065075.791207:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11539 00000100:00100000:0.0:1746065075.791212:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27770:x1830881261187328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.791227:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.791241:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145ed93 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b7ba expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.791297:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.791306:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.791314:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.791322:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.791327:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.791331:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.791940:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.791948:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.791954:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065075.791961:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x302:0x0]: returning size 2 00010000:00010000:0.0:1746065075.792013:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792018:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792023:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792028:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.792031:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792039:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792047:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x302:0x0].0x0 (ffff88012f854900) 00010000:00010000:0.0:1746065075.792050:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065075.792052:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792056:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145eda8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x302:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792365:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792371:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792376:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792380:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792383:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.792385:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792389:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792396:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065075.792398:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.792400:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792404:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ed9a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792412:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792417:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792421:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792424:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5ce600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.792426:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792430:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792435:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a200) 00010000:00010000:0.0:1746065075.792437:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.792439:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792443:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce600/0xad6b7ddc145eda1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.792470:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145ed93 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7ba expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.792476:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc145ed93 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7ba expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.792491:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fac00, rc 0) 00000100:00100000:0.0:1746065075.793194:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27770:x1830881261187328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1980us (2527us total) trans 4294974986 rc 301/301 00000100:00100000:0.0:1746065075.793200:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11539 00000100:00100000:1.0:1746065075.794102:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262564608:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.794227:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262563968 00000100:00100000:0.0:1746065075.794232:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262563968 00000100:00100000:0.0:1746065075.794254:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262563584 00000100:00100000:0.0:1746065075.794256:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262563584 00000100:00100000:0.0:1746065075.794265:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262564096 00000100:00100000:0.0:1746065075.794267:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262564096 00000100:00100000:0.0:1746065075.794274:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262564480 00000100:00100000:0.0:1746065075.794276:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262564480 00000100:00100000:0.0:1746065075.794287:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8071 00000100:00100000:0.0:1746065075.794293:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+130:3759:x1830881262563968:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065075.794310:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:804 count 1 00002000:00010000:0.0:1746065075.794330:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065075.794335:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc145edb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794344:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.794346:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.794350:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc145edb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794359:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc145edb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794365:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc145edb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794371:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc145edb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794388:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065075.794527:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3759:x1830881262563968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 235us (1457us total) trans 17179872323 rc 0/0 00000100:00100000:0.0:1746065075.794533:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8071 00000100:00100000:0.0:1746065075.794542:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8073 00000100:00100000:0.0:1746065075.794546:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+133:3759:x1830881262564096:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065075.794614:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x325:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065075.794616:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x325:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.794618:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x325:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.794620:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x325:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065075.794622:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x325:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065075.794639:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3759:x1830881262564096:12345-0@lo:2:osp-syn-1-1.0 Request processed in 93us (1498us total) trans 17179872324 rc 0/0 00000100:00100000:0.0:1746065075.794643:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8073 00000100:00100000:0.0:1746065075.794652:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8075 00000100:00100000:0.0:1746065075.794657:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+98:3759:x1830881262564992:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.794713:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+100:3759:x1830881262564992:12345-0@lo:2:osp-syn-0-1.0 Request processed in 56us (424us total) trans 21474839596 rc 0/0 00000100:00100000:0.0:1746065075.794718:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8075 00000100:00100000:0.0:1746065075.794726:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8076 00000100:00100000:0.0:1746065075.794730:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+133:3761:x1830881262563712:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065075.794739:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:802 count 1 00002000:00010000:0.0:1746065075.794748:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065075.794752:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc145edcb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794758:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.794759:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.794761:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc145edcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794767:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc145edcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794788:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc145edcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794793:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc145edcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794802:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1746065075.794856:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3761:x1830881262563712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 127us (536us total) trans 17179872326 rc 0/0 00000100:00100000:0.0:1746065075.794861:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8076 00000100:00100000:0.0:1746065075.794868:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8079 00000100:00100000:0.0:1746065075.794872:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+133:3761:x1830881262563840:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065075.794879:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:803 count 1 00010000:00010000:0.0:1746065075.794887:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794895:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794900:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065075.794901:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065075.794903:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794916:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.794922:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 56 pid: 9550 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.794929:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262565248:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.794957:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.794973:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8080 00000100:00100000:0.0:1746065075.794977:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+98:3761:x1830881262564352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065075.794985:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:800 count 1 00010000:00010000:0.0:1746065075.794994:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.795003:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c284a00/0xad6b7ddc145ea75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6b0 expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.795008:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065075.795010:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065075.795011:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.795026:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c284a00/0xad6b7ddc145ea75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6b0 expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.795033:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c284a00/0xad6b7ddc145ea75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b6b0 expref: 47 pid: 12258 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.795040:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262565376:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.795056:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065075.795464:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065075.795473:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065075.797447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.797903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.797956:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262565248:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065075.797974:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.798014:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262565376:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065075.798024:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.798063:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187712 00000100:00100000:1.0:1746065075.798068:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187712 00000100:00100000:0.0:1746065075.798069:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.798082:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261187840 00000100:00100000:0.0:1746065075.798084:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261187840 00000100:00100000:1.0:1746065075.798095:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8083 00010000:00010000:0.0:1746065075.798097:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 58 pid: 9550 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.798100:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+58:26180:x1830881261187712:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.798110:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065075.798116:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3424 00000100:00100000:0.0:1746065075.798120:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+58:2006:x1830881261187840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065075.798121:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc145edee lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b7c1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.798127:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.798131:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 59 pid: 9550 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.798138:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 59 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.798138:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 59 pid: 9550 timeout: 771 lvb_type: 0 00010000:00010000:1.0:1746065075.798144:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.798145:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.798148:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc145edee lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c1 expref: 59 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.798151:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145ec04 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b73c expref: 59 pid: 9550 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.798160:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.798161:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.798164:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.798165:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 58 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.798170:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.798173:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 58 pid: 9550 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746065075.798181:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262565632:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065075.798181:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065075.799296:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+58:2006:x1830881261187840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1173us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.799303:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3424 00000100:00100000:1.0:1746065075.799315:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065075.799323:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.799334:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.799342:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.799348:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.799361:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065075.799568:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3761:x1830881262563840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4694us (5188us total) trans 17179872327 rc 0/0 00000100:00100000:0.0:1746065075.799574:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8079 00000100:00100000:0.0:1746065075.799920:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.800021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.800061:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.800281:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800287:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800293:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800300:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800310:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065075.800391:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3427 00000100:00100000:1.0:1746065075.800397:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+58:2005:x1830881261188224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065075.800405:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.800409:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc145eb94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b70b expref: 58 pid: 12258 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746065075.800513:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+100:3761:x1830881262564352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5535us (6117us total) trans 21474839600 rc 0/0 00000100:00100000:0.0:1746065075.800519:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8080 00010000:00010000:0.0:1746065075.800532:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.800536:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800541:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.800543:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800549:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800557:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.800636:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc145eb94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b70b expref: 58 pid: 12258 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746065075.800652:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc145eb94 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b70b expref: 58 pid: 12258 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746065075.800663:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.800664:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.800667:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.800672:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.800684:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065075.800698:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881261188224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 302us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.800703:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3427 00010000:00010000:0.0:1746065075.800854:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718400/0xad6b7ddc145ede0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800866:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.800869:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800873:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.800876:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800881:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800888:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800894:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6600/0xad6b7ddc145edbd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.800902:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.800903:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.800905:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.800961:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065075.801157:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955cd180/2, rc 0, transno 21474839601 00000100:00100000:1.0:1746065075.801160:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262564608:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065075.802731:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.802842:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.802892:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261188480 00000100:00100000:1.0:1746065075.802895:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261188480 00010000:00010000:1.0:1746065075.802913:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 57 pid: 9550 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746065075.802928:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3428 00000100:00100000:1.0:1746065075.802931:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881261188480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065075.802938:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065075.802942:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 57 pid: 9550 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746065075.802949:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 57 pid: 9550 timeout: 771 lvb_type: 1 00010000:00010000:1.0:1746065075.802961:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.802962:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.802967:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc145edee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c1 expref: 57 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.802972:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc145edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c1 expref: 57 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.802992:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc145edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c1 expref: 57 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065075.803003:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009576c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881262565760:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065075.803036:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065075.803346:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145ed23 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b790 expref: 57 pid: 9550 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746065075.803357:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262565632:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.803370:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc145edee lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c1 expref: 56 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.803378:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1000, rc 0) 00000100:00100000:1.0:1746065075.803398:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+56:26180:x1830881261187712:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5298us (5496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.803403:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8083 00000100:00100000:0.0:1746065075.804923:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.805006:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009576c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881262565760:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065075.805018:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065075.805054:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+55:2007:x1830881261188480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2121us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.805062:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3428 00000100:00100000:0.0:1746065075.809607:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.809650:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.814504:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.816089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.816130:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.816202:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.816221:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261189120 00000100:00100000:0.0:1746065075.816225:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261189120 00000100:00100000:0.0:1746065075.816249:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261189632 00000100:00100000:0.0:1746065075.816251:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261189632 00000100:00100000:0.0:1746065075.816282:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 880 00000100:00100000:0.0:1746065075.816288:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261189632:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065075.816340:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261189632:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.816346:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 880 00000100:00080000:1.0:1746065075.816352:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065075.816360:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11540 00000100:00100000:0.0:1746065075.816369:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+260:27771:x1830881261189120:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.816380:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.816399:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edfc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b7cf expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.816461:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.816474:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816485:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816496:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.816501:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816505:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816576:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc145ee11 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x302:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.816587:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc145ee11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816603:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc145ee11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065075.816611:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x302:0x0]: returning size 5 00010000:00010000:0.0:1746065075.816646:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816652:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816657:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816662:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816666:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.816669:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816674:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816683:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fc00) 00010000:00010000:0.0:1746065075.816686:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.816689:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816693:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145ee03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816709:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816713:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816718:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816721:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.816722:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816726:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816730:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554f300) 00010000:00010000:0.0:1746065075.816731:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.816733:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.816736:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc145ee0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.817696:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145edfc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7cf expref: 263 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.817935:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc145ee11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x302:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7cf expref: 262 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.817943:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x302:0x0].0x0 (ffff88012f854900) 00010000:00010000:0.0:1746065075.817947:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065075.817950:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0200, rc 0) 00000100:00100000:0.0:1746065075.817993:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+262:27771:x1830881261189120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1627us (1862us total) trans 4294974989 rc 0/0 00000100:00100000:0.0:1746065075.818000:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11540 00000100:00100000:0.0:1746065075.822885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.827850:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065075.830542:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065075.830555:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145ee34 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x302:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.830564:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065075.830567:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145ee34 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x302:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.830577:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145ee34 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x302:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.830602:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x302:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:0.0:1746065075.830605:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065075.830608:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145ee34 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x302:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.830613:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145ee34 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x302:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.830649:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.830650:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.830652:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.841751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.847149:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.852135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.852185:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.858455:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.863584:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.863889:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191296 00000100:00100000:1.0:1746065075.863896:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191296 00000100:00100000:1.0:1746065075.863947:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11548 00000100:00100000:1.0:1746065075.863953:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27773:x1830881261191296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.863969:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.863972:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065075.863995:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145ee81 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7f2 expref: 263 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.864021:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:1.0:1746065075.864030:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.864041:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeb2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b800 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.864131:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.864140:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864151:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864159:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.864164:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864168:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864438:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145eec7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.864444:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145eec7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864450:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145eec7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065075.864457:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x304:0x0]: returning size 0 00010000:00010000:1.0:1746065075.864476:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864481:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864486:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864491:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864496:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.864499:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864505:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864512:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854300) 00010000:00010000:1.0:1746065075.864515:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.864517:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864522:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145eeb9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065075.864530:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed2680 reply state ffff88009a59a000 transno 4294974992 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864538:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.864542:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065075.864544:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.864547:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065075.864565:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeb2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b800 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.864576:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145eec7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b800 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.864582:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065075.864583:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.864585:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:1.0:1746065075.864651:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+265:27773:x1830881261191296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 698us (1075us total) trans 4294974992 rc 0/0 00000100:00100000:1.0:1746065075.864658:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11548 00000100:00100000:0.0:1746065075.866848:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.869557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.869725:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261191808 00000100:00100000:1.0:1746065075.869732:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261191808 00000100:00100000:1.0:1746065075.869790:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11550 00000100:00100000:1.0:1746065075.869797:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+267:27775:x1830881261191808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.869812:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.869824:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eee3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b80e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.869896:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 3/1,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.869906:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.869915:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065075.869924:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x304:0x0]: returning size 0 00010000:00010000:1.0:1746065075.869984:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.869990:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.869996:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.870001:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.870004:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.870014:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.870023:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065075.870026:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065075.870029:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 2/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.870033:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc145eeea lrc: 0/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.870082:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eee3 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b80e expref: 269 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.870089:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc145eee3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b80e expref: 269 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.870096:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:1.0:1746065075.870133:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+268:27775:x1830881261191808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 337us (583us total) trans 4294974993 rc 301/301 00000100:00100000:1.0:1746065075.870139:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11550 00000100:00100000:0.0:1746065075.870382:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.878690:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.878743:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.887524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.890205:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.892972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.893208:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.897659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.899640:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.900948:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.905274:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.906682:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194368 00000100:00100000:1.0:1746065075.906692:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194368 00000100:00100000:1.0:1746065075.906748:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3975 00000100:00100000:1.0:1746065075.906757:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27775:x1830881261194368:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065075.906954:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27775:x1830881261194368:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 197us (1687us total) trans 4294975002 rc 0/0 00000100:00100000:1.0:1746065075.906962:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3975 00000100:00100000:0.0:1746065075.907175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.907239:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194624 00000100:00100000:1.0:1746065075.907243:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194624 00000100:00100000:1.0:1746065075.907272:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11557 00000100:00100000:1.0:1746065075.907277:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261194624:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.907285:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.907288:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746065075.907307:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc145ef6f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b838 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.907320:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa7da00/0xad6b7ddc145ef61 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b831 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.907327:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:1.0:1746065075.907330:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065075.907338:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145ef76 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b83f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.907367:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145ef7d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.907378:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145ef7d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.907385:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145ef7d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:1.0:1746065075.907538:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2247, 88 off186592 00000004:00080000:1.0:1746065075.907543:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671925769308ns, next at 672137658713ns, rc = 0 00000040:00080000:1.0:1746065075.907569:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2251, 88 off187032 00000004:00080000:1.0:1746065075.907572:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671925798556ns, next at 672137633000ns, rc = 0 00000040:00080000:1.0:1746065075.907583:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2252, 88 off187120 00000004:00080000:1.0:1746065075.907587:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 671925813087ns, next at 672137633000ns, rc = 0 00000040:00080000:1.0:1746065075.907608:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2248, 88 off186680 00000004:00080000:1.0:1746065075.907612:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 671925838256ns, next at 672137658713ns, rc = 0 00000100:00100000:0.0:1746065075.910568:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261194880 00000100:00100000:0.0:1746065075.910576:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261194880 00000100:00100000:0.0:1746065075.910633:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11558 00000100:00100000:0.0:1746065075.910640:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27775:x1830881261194880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.910661:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.910680:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145ef84 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b846 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.910747:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.910757:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.910770:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.910816:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.910822:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.910826:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.910908:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065075.910915:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.910921:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065075.910929:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x304:0x0]: returning size 2 00010000:00010000:0.0:1746065075.910991:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.910998:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911004:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911009:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.911013:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911022:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911031:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:0.0:1746065075.911033:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065075.911036:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911041:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc145ef99 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911063:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911068:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911072:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911076:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911080:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.911082:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911086:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911092:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065075.911094:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.911096:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911101:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc145ef8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911108:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911112:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911115:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911118:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065075.911120:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911124:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911129:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:0.0:1746065075.911131:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065075.911133:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911136:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc145ef92 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065075.911163:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145ef84 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b846 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.911169:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145ef84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b846 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.911184:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67600, rc 0) 00000100:00100000:0.0:1746065075.911229:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27775:x1830881261194880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 588us (928us total) trans 4294975004 rc 301/301 00000100:00100000:0.0:1746065075.911235:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11558 00010000:00010000:1.0:1746065075.912665:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912672:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912676:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912680:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.912682:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912688:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912697:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065075.912699:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.912701:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912705:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145ee26 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.912716:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912723:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912726:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912729:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.912731:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912734:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912739:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065075.912741:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.912743:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912746:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc145eec0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.912758:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912762:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912766:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912770:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.912794:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912799:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912805:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:1.0:1746065075.912807:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.912809:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912814:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145ef45 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065075.912829:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.912834:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099cd3200/0xad6b7ddc145efae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912839:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.912842:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd3200/0xad6b7ddc145efae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912847:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd3200/0xad6b7ddc145efae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912855:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099cd3200/0xad6b7ddc145efae lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912859:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3200/0xad6b7ddc145efae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912870:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.912871:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.912873:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.912902:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145ef7d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x304:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b83f expref: 259 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912908:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:1.0:1746065075.912910:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065075.912918:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145ef76 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b83f expref: 259 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065075.912928:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145ef7d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x304:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b83f expref: 258 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.912944:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:1.0:1746065075.912946:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065075.912948:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:1.0:1746065075.912974:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+258:26180:x1830881261194624:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5696us (5799us total) trans 4294975003 rc 0/0 00000100:00100000:1.0:1746065075.912980:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11557 00000100:00100000:0.0:1746065075.921194:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195008 00000100:00100000:0.0:1746065075.921198:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195008 00000100:00100000:0.0:1746065075.921226:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8094 00000100:00100000:0.0:1746065075.921232:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+49:26180:x1830881261195008:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065075.921244:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.921256:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc145efc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b84d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.921277:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.921283:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.921285:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.921287:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc145efc3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b84d expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.921309:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065075.921317:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746065075.921331:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262567296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.921496:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065075.922198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.922417:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195520 00000100:00100000:0.0:1746065075.922420:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195520 00010000:00010000:0.0:1746065075.922439:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095668400/0xad6b7ddc145edf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c8 expref: 51 pid: 1880 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.922457:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3430 00000100:00100000:0.0:1746065075.922461:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261195520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.922469:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.922473:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095668400/0xad6b7ddc145edf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c8 expref: 51 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.922482:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095668400/0xad6b7ddc145edf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c8 expref: 51 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.922496:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095668400/0xad6b7ddc145edf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b7c8 expref: 51 pid: 1880 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746065075.922518:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.922519:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.922523:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.922529:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.922908:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.922914:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145efa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.922921:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.922925:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145efa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.922931:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145efa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.922941:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145efa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.922946:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145efa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.922957:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.922958:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.922959:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065075.923227:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065075.923243:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261195520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 781us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065075.923248:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3430 00010000:00010000:1.0:1746065075.923906:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065075.923912:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.923918:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065075.923920:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.923926:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.923936:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.923941:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb600/0xad6b7ddc145efbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.923953:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.923955:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065075.923957:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065075.926997:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195648 00000100:00100000:0.0:1746065075.927001:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195648 00010000:00010000:0.0:1746065075.927024:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 771 lvb_type: 1 00000100:00100000:0.0:1746065075.927042:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3432 00000100:00100000:0.0:1746065075.927048:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261195648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065075.927056:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065075.927060:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746065075.927069:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 771 lvb_type: 1 00010000:00010000:0.0:1746065075.927089:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.927091:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065075.927096:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc145efc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b84d expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.927103:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc145efc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b84d expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.927132:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc145efc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b84d expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065075.927142:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881262567424:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065075.927183:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3169c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065075.927502:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc145ef30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b823 expref: 50 pid: 12258 timeout: 771 lvb_type: 1 00000100:00100000:1.0:1746065075.927513:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262567296:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.927880:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc145efc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b84d expref: 49 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.927891:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:1.0:1746065075.928461:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+49:26180:x1830881261195008:12345-192.168.202.27@tcp:101:bash.0 Request processed in 7226us (7609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.928468:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8094 00000100:00100000:0.0:1746065075.933347:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.933414:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261195904 00000100:00100000:1.0:1746065075.933420:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261195904 00000100:00100000:1.0:1746065075.933461:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8095 00000100:00100000:1.0:1746065075.933467:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+55:26180:x1830881261195904:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065075.933481:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.933498:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc145efca lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b854 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065075.933518:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065075.933534:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.933536:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065075.933542:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc145efca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b854 expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.933554:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc145efca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b854 expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.933563:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856c00, rc 0) 00000100:00100000:1.0:1746065075.933585:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+56:26180:x1830881261195904:12345-192.168.202.27@tcp:101:bash.0 Request processed in 118us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065075.933601:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8095 00000100:00100000:1.0:1746065075.941598:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196032 00000100:00100000:1.0:1746065075.941606:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196032 00002000:00010000:1.0:1746065075.941638:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/806 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.941642:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53df80 with x1830881261196032 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.941651:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53df80. 00000100:00100000:1.0:1746065075.941666:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196160 00000100:00100000:1.0:1746065075.941668:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196160 00002000:00010000:1.0:1746065075.941676:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/807 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.941678:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53e680 with x1830881261196160 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.941683:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53e680. 00000100:00100000:1.0:1746065075.941694:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1205 00000100:00100000:1.0:1746065075.941700:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261196032:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065075.941865:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065075.941868:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb mtime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065075.941870:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065075.941872:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb ctime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065075.941873:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065075.942522:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261196032:12345-192.168.202.27@tcp:10:bash.0 Request processed in 820us (2185us total) trans 21474839607 rc 0/0 00000100:00100000:1.0:1746065075.942528:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1205 00002000:00010000:1.0:1746065075.942532:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/806 (0->18446744073709551615) 00002000:00100000:1.0:1746065075.942534:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53df80 with x1830881261196032 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065075.942539:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53df80. 00000100:00100000:0.0:1746065075.942884:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.943032:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261196416 00000100:00100000:1.0:1746065075.943035:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261196416 00000100:00100000:1.0:1746065075.943069:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11559 00000100:00100000:1.0:1746065075.943074:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+259:27776:x1830881261196416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.943085:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.943099:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857c00/0xad6b7ddc145efd1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b85b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.943157:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.943168:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943177:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943186:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.943191:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943196:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943266:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065075.943273:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943279:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065075.943288:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x304:0x0]: returning size 2 00010000:00010000:1.0:1746065075.943336:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943341:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943346:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943351:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943356:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.943359:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943364:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943372:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854400) 00010000:00010000:1.0:1746065075.943375:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.943378:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943383:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145efd8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943395:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943403:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943408:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943411:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.943413:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943418:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943423:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:1.0:1746065075.943425:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.943426:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943430:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145efdf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065075.943458:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857c00/0xad6b7ddc145efd1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b85b expref: 262 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.943469:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b85b expref: 261 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.943474:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:1.0:1746065075.943475:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065075.943477:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856000, rc 0) 00000100:00100000:1.0:1746065075.943499:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+261:27776:x1830881261196416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 424us (615us total) trans 4294975006 rc 0/0 00000100:00100000:1.0:1746065075.943504:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11559 00000100:00100000:0.0:1746065075.946581:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.946641:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.947014:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3979 00000100:00100000:0.0:1746065075.947021:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+262:26180:x1830881261196928:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065075.947541:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261196928:12345-192.168.202.27@tcp:35:bash.0 Request processed in 522us (900us total) trans 4294975008 rc 0/0 00000100:00100000:0.0:1746065075.947554:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3979 00000100:00100000:1.0:1746065075.951211:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11560 00000100:00100000:0.0:1746065075.951239:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27776:x1830881261197184:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.951260:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.951278:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145eff4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b862 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.951364:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145effb lrc: 3/0,1 mode: --/CW res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065075.951375:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b85b expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.951385:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145effb lrc: 4/0,1 mode: --/CW res: [0x240000403:0x304:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065075.951409:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b85b expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.951420:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145efe6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b85b expref: 264 pid: 7205 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.951430:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262567552:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.952763:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.957331:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.959017:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.965391:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.967309:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.972882:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198080 00000100:00100000:0.0:1746065075.972889:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198080 00000100:00100000:0.0:1746065075.972930:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11563 00000100:00100000:0.0:1746065075.972941:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27776:x1830881261198080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065075.972957:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065075.972971:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd000/0xad6b7ddc145f033 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b877 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.973055:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145f03a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.973066:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145f03a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x304:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.973077:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145f03a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x304:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065075.973086:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x304:0x0]: returning size 5 00010000:00010000:0.0:1746065075.973158:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd000/0xad6b7ddc145f033 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b877 expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.973175:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145f03a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x304:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b877 expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.973181:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:0.0:1746065075.973183:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065075.973186:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc200, rc 0) 00000100:00100000:0.0:1746065075.974852:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27776:x1830881261198080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1909us (2022us total) trans 4294975010 rc 0/0 00000100:00100000:0.0:1746065075.974860:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11563 00000100:00100000:1.0:1746065075.974998:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.975223:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198208 00000100:00100000:0.0:1746065075.975227:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198208 00000100:00100000:0.0:1746065075.975260:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11564 00000100:00100000:0.0:1746065075.975266:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27777:x1830881261198208:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065075.975296:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065075.975312:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc145ef7d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x304:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b83f expref: 267 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.975326:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc145f01e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b869 expref: 266 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.975336:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145ef3e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b82a expref: 265 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.975343:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:0.0:1746065075.975346:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065075.975361:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.975369:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.975375:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.975384:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc145f04f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.975389:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc145f04f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.975394:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc145f04f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.975448:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065075.975456:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145f02c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b870 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.975462:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065075.975485:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145f02c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b870 expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065075.976498:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145f02c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b870 expref: 264 pid: 7203 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746065075.976510:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262567808:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065075.976569:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065075.979401:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065075.981993:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065075.982723:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb600/0xad6b7ddc145f02c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x304:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b870 expref: 264 pid: 7203 timeout: 771 lvb_type: 0 00000100:00100000:1.0:1746065075.982742:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262567808:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065075.982754:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.982760:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.982764:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:1.0:1746065075.982964:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x304:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1746065075.983026:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983033:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983038:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983043:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f182e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.983046:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983054:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983061:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:1.0:1746065075.983063:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065075.983066:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983070:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc145f056 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983081:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983085:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983089:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983092:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983096:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065075.983098:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983102:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983108:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065075.983109:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065075.983111:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983115:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc145f048 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065075.983125:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009abc0700 reply state ffff88009a99b000 transno 4294975011 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc145f04f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983132:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc145f04f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.983136:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:1.0:1746065075.983138:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065075.983140:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065075.985396:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27777:x1830881261198208:12345-192.168.202.27@tcp:36:rm.0 Request processed in 10121us (10389us total) trans 4294975011 rc 0/0 00000100:00100000:1.0:1746065075.985405:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11564 00000100:00100000:1.0:1746065075.992426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065075.999798:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261198848 00000100:00100000:1.0:1746065075.999806:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261198848 00000100:00100000:1.0:1746065075.999844:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261199104 00000100:00100000:1.0:1746065075.999847:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261199104 00000100:00100000:1.0:1746065075.999869:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11565 00000100:00100000:1.0:1746065075.999875:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27778:x1830881261198848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065075.999898:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065075.999915:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857c00/0xad6b7ddc145f064 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b87e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065075.999946:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.999951:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.999959:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.999966:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065075.999970:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.999974:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065075.999999:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000003:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000012:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000017:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000021:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.000024:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000030:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000037:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854700) 00010000:00010000:1.0:1746065076.000039:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.000043:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000047:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145f072 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000059:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000064:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000068:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000071:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.000073:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000077:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000081:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:1.0:1746065076.000083:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.000084:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000088:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f079 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.000109:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857c00/0xad6b7ddc145f064 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b87e expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.000115:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857c00/0xad6b7ddc145f064 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b87e expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.000126:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857c00, rc 0) 00000100:00100000:1.0:1746065076.000161:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27778:x1830881261198848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 286us (467us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.000167:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11565 00000001:00080000:0.0:1746065076.001364:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975012 is committed 00000004:00080000:0.0:1746065076.001372:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1515 committed 00000004:00080000:0.0:1746065076.001386:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1525 committed 00000100:00080000:1.0:1746065076.002503:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065076.002513:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262568320 00000100:00100000:1.0:1746065076.002515:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262568320 00000100:00100000:1.0:1746065076.002532:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262568192 00000100:00100000:1.0:1746065076.002534:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262568192 00000100:00100000:1.0:1746065076.002544:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8098 00000100:00100000:1.0:1746065076.002548:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+139:3762:x1830881262568320:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065076.002732:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1524 committed 00000004:00080000:0.0:1746065076.002736:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1514 committed 00010000:00010000:0.0:1746065076.003822:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.003829:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.003833:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.003837:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.003840:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.003844:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.003851:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:0.0:1746065076.003853:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.003855:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.003859:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f06b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065076.003932:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+141:3762:x1830881262568320:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1383us (1483us total) trans 17179872336 rc 0/0 00000100:00100000:1.0:1746065076.003938:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8098 00000100:00080000:1.0:1746065076.003953:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746065076.003955:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065076.008324:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261199488 00000100:00100000:0.0:1746065076.008328:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261199488 00000100:00100000:0.0:1746065076.008348:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11569 00000100:00100000:0.0:1746065076.008353:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+257:27778:x1830881261199488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.008359:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.008367:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc145f09c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b893 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.008413:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145f0a3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065076.008420:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145f0a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.008451:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145f0a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065076.008486:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1746065076.008491:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1746065076.008515:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc145f09c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b893 expref: 259 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.008526:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc145f0a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b893 expref: 258 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.008532:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065076.008534:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1746065076.008536:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9600, rc 0) 00000100:00100000:0.0:1746065076.008566:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+258:27778:x1830881261199488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 213us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.008571:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11569 00000100:00100000:0.0:1746065076.010211:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.013676:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065076.014003:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065076.016350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.018926:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.021321:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.026648:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200640 00000100:00100000:0.0:1746065076.026656:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200640 00000100:00100000:1.0:1746065076.026745:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261200384 00000100:00100000:1.0:1746065076.026749:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261200384 00000100:00100000:1.0:1746065076.026795:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8103 00000100:00100000:1.0:1746065076.026802:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881261200384:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065076.026866:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11573 00000100:00100000:0.0:1746065076.026872:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+261:27778:x1830881261200640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.026885:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.026900:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f0f7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x306:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b8b6 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.026982:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 3/0,1 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065076.026993:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145f0e9 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8af expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.026998:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 4/0,1 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.027020:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145f0e9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8af expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065076.027026:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881261200384:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 224us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.027032:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8103 00010000:00010000:0.0:1746065076.027037:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc145f0e9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8af expref: 262 pid: 7231 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.027046:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262568576:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065076.027092:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.030538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065076.030842:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.030848:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065076.030866:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x306:0x0]: returning size 0 00000004:00080000:0.0:1746065076.031039:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x329:0x0], index 1: 0 00000004:00080000:0.0:1746065076.031044:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x328:0x0], index 0: 0 00000004:00080000:0.0:1746065076.031047:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x329:0x0], index 0: 0 00000004:00080000:0.0:1746065076.031050:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x32a:0x0], index 1: 0 00010000:00010000:0.0:1746065076.031130:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031136:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031140:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031145:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.031149:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031158:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031165:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff8800a65aa800) 00010000:00010000:0.0:1746065076.031167:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.031169:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 2/0,0 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031173:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc145f0fe lrc: 0/0,0 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.031207:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f0f7 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x306:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8b6 expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.031213:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f0f7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x306:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8b6 expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.031225:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:0.0:1746065076.031247:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+261:27778:x1830881261200640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4375us (4676us total) trans 4294975014 rc 301/301 00000100:00100000:0.0:1746065076.031253:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11573 00000100:00100000:0.0:1746065076.031672:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.035536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.035620:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.036056:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201408 00000100:00100000:1.0:1746065076.036063:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201408 00000100:00100000:1.0:1746065076.036112:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8104 00000100:00100000:1.0:1746065076.036120:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261201408:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065076.036241:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065076.036244:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.036246:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb atime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.036248:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.036250:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065076.036299:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261201408:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 180us (680us total) trans 21474839611 rc 0/0 00000100:00100000:1.0:1746065076.036305:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8104 00000100:00100000:0.0:1746065076.041658:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.041682:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261201664 00000100:00100000:0.0:1746065076.041689:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261201664 00000100:00100000:0.0:1746065076.041720:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3981 00000100:00100000:0.0:1746065076.041726:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27776:x1830881261201664:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065076.041789:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x304:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc145f03a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x304:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b877 expref: 263 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.041830:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065076.041840:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f095 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b88c expref: 263 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.041846:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.041873:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f095 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b88c expref: 263 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.041886:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f095 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b88c expref: 263 pid: 7205 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.041899:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262568704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.042735:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.045786:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.049229:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.051679:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261202304 00000100:00100000:0.0:1746065076.051686:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261202304 00000100:00100000:0.0:1746065076.051753:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11575 00000100:00100000:0.0:1746065076.051762:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+265:26180:x1830881261202304:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065076.051826:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.051848:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f11a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b8bd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.051965:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065076.051978:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.051987:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.051995:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065076.052001:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052006:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052048:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f12f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x306:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065076.052054:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f12f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052059:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f12f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065076.052067:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x306:0x0]: returning size 0 00010000:00010000:0.0:1746065076.052124:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052130:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052138:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052143:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052147:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.052150:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052155:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052163:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e1fcf00) 00010000:00010000:0.0:1746065076.052165:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.052169:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052173:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f121 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052209:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052215:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052220:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052223:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.052225:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052233:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052240:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008f379800) 00010000:00010000:0.0:1746065076.052242:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.052510:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052517:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f128 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065076.052610:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f11a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8bd expref: 268 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.052629:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f12f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8bd expref: 267 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.052636:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:0.0:1746065076.052637:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065076.052640:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:0.0:1746065076.052712:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261202304:12345-192.168.202.27@tcp:101:bash.0 Request processed in 949us (1555us total) trans 4294975019 rc 0/0 00000100:00100000:0.0:1746065076.052718:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11575 00000001:00080000:0.0:1746065076.053551:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975018 is committed 00000004:00080000:0.0:1746065076.053557:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1517 committed 00000004:00080000:0.0:1746065076.053768:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1527 committed 00000004:00080000:0.0:1746065076.053807:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1526 committed 00000004:00080000:0.0:1746065076.053809:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1516 committed 00000004:00080000:1.0:1746065076.054526:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098358380/2, rc 0, transno 21474839612 00000100:00100000:0.0:1746065076.054528:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262568960 00000100:00100000:1.0:1746065076.054532:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262569088:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.054532:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262568960 00000100:00100000:0.0:1746065076.054546:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262568832 00000100:00100000:0.0:1746065076.054547:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262568832 00000100:00100000:0.0:1746065076.054556:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8107 00000100:00100000:0.0:1746065076.054560:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+107:3760:x1830881262568960:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.054563:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8108 00000100:00100000:1.0:1746065076.054567:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+141:3761:x1830881262568832:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065076.054623:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065076.054626:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.054628:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb atime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.054630:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.054631:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x326:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:1.0:1746065076.054693:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x327:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065076.054696:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x327:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.054698:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x327:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.054699:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x327:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.054701:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x327:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065076.055144:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+108:3760:x1830881262568960:12345-0@lo:2:osp-syn-0-1.0 Request processed in 582us (655us total) trans 21474839613 rc 0/0 00000100:00100000:0.0:1746065076.055150:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8107 00000100:00100000:1.0:1746065076.055155:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+142:3761:x1830881262568832:12345-0@lo:2:osp-syn-1-1.0 Request processed in 588us (618us total) trans 17179872338 rc 0/0 00010000:00010000:0.0:1746065076.055166:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.055171:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.055177:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.055181:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.055183:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.055189:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.055196:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x304:0x0].0x0 (ffff88012ef2aa00) 00010000:00010000:0.0:1746065076.055198:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.055200:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.055205:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc145f113 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x304:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00000100:00100000:1.0:1746065076.055258:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8108 00000100:00100000:0.0:1746065076.055968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.056581:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.059681:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.061232:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.062823:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.062884:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203200 00000100:00100000:1.0:1746065076.062889:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203200 00000100:00100000:1.0:1746065076.063105:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11579 00000100:00100000:1.0:1746065076.063112:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261203200:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.063122:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.063131:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f160 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x306:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b8d2 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.063159:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f160 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8d2 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.063167:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f160 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8d2 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.063178:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:1.0:1746065076.063180:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065076.063182:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:1.0:1746065076.063823:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261203200:12345-192.168.202.27@tcp:101:bash.0 Request processed in 707us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.063830:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11579 00000100:00100000:0.0:1746065076.066451:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065076.070100:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975023 is committed 00000004:00080000:0.0:1746065076.070109:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1529 committed 00000004:00080000:0.0:1746065076.070121:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1519 committed 00000004:00080000:0.0:1746065076.070126:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1518 committed 00000004:00080000:0.0:1746065076.070127:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1528 committed 00010000:00010000:1.0:1746065076.072530:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.072537:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072544:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.072547:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072554:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072570:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f183 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072575:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f183 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072615:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.072619:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc145f18a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072624:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.072626:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc145f18a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072632:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc145f18a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072640:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc145f18a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072645:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc145f18a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.072654:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.072655:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.072657:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.072661:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065076.072719:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f100/2, rc 0, transno 17179872339 00000100:00100000:0.0:1746065076.072724:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262569728:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.075709:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.076175:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.076259:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.076275:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203584 00000100:00100000:1.0:1746065076.076279:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203584 00000100:00080000:0.0:1746065076.076296:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746065076.076304:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc145efca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b854 expref: 57 pid: 9550 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.076326:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261203712 00000100:00100000:1.0:1746065076.076328:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261203712 00010000:00010000:1.0:1746065076.076338:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b800/0xad6b7ddc145f0b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8a1 expref: 52 pid: 12258 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746065076.076350:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3440 00000100:00100000:1.0:1746065076.076355:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881261203712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.076360:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.076362:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84b800/0xad6b7ddc145f0b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8a1 expref: 52 pid: 12258 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.076369:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84b800/0xad6b7ddc145f0b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8a1 expref: 52 pid: 12258 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.076378:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b800/0xad6b7ddc145f0b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8a1 expref: 52 pid: 12258 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.076388:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.076390:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.076393:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076400:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076432:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.076447:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881261203712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.076455:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3440 00010000:00010000:1.0:1746065076.076565:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.076570:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076576:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.076579:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076585:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076605:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076610:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc145f17c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076623:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.076625:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145f175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076630:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.076633:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145f175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076638:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145f175 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076644:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145f175 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076649:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc145f175 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.076657:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.076658:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.076660:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.076989:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.078893:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.080035:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.080325:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.080585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.080636:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1207 00000100:00100000:1.0:1746065076.080643:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261204736:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065076.080745:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x328:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065076.080748:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x328:0x0] updating lvb mtime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.080750:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x328:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.080751:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x328:0x0] updating lvb ctime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.080753:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x328:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065076.080801:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261204736:12345-192.168.202.27@tcp:10:bash.0 Request processed in 158us (476us total) trans 21474839618 rc 0/0 00000100:00100000:1.0:1746065076.080807:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1207 00002000:00010000:1.0:1746065076.080809:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/808 (0->18446744073709551615) 00002000:00100000:1.0:1746065076.080812:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220e00 with x1830881261204736 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065076.080816:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135220e00. 00000100:00100000:0.0:1746065076.082525:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.085674:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.085873:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205120 00000100:00100000:1.0:1746065076.085880:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205120 00000100:00100000:0.0:1746065076.086042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.086144:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205376 00000100:00100000:1.0:1746065076.086148:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205376 00000100:00100000:1.0:1746065076.086165:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11583 00000100:00100000:0.0:1746065076.086170:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11584 00000100:00100000:1.0:1746065076.086171:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:27779:x1830881261205120:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065076.086175:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27780:x1830881261205376:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065076.086204:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.086215:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f1d7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x306:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b8fc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.086217:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1746065076.086230:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47400/0xad6b7ddc145f1c9 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x306:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8f5 expref: 265 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.086246:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc145f16e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x306:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8d9 expref: 264 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.086250:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f1d7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8fc expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.086259:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f1d7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x306:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8fc expref: 263 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.086259:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145f1a6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x306:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8e0 expref: 263 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.086267:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abac000/0xad6b7ddc145f144 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x306:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8c4 expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.086271:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:1.0:1746065076.086274:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065076.086276:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9600, rc 0) 00010000:00010000:0.0:1746065076.086276:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:0.0:1746065076.086278:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065076.086296:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065076.086301:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086307:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065076.086308:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+261:27779:x1830881261205120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 137us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.086313:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11583 00010000:00010000:0.0:1746065076.086315:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f1e5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065076.086320:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086328:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086385:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 3/0,1 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065076.086391:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086396:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:0.0:1746065076.086536:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x306:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1746065076.086575:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086579:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086582:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086585:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.086601:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086606:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086613:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:0.0:1746065076.086615:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065076.086617:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 2/0,0 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086625:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f1ec lrc: 0/0,0 mode: --/EX res: [0x240000403:0x306:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086635:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086639:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086643:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086647:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086651:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.086653:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086658:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086663:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c500) 00010000:00010000:0.0:1746065076.086665:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.086667:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086671:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f1de lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:0.0:1746065076.086680:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135223480 reply state ffff88009a99c000 transno 4294975027 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f1e5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086686:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc145f1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.086691:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:0.0:1746065076.086693:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065076.086695:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065076.086719:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+262:27780:x1830881261205376:12345-192.168.202.27@tcp:36:rm.0 Request processed in 544us (677us total) trans 4294975027 rc 0/0 00000100:00100000:0.0:1746065076.086724:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11584 00000100:00100000:0.0:1746065076.088410:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.092492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.094459:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.094508:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261205760 00000100:00100000:1.0:1746065076.094513:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261205760 00000100:00100000:1.0:1746065076.094553:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11585 00000100:00100000:1.0:1746065076.094559:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+262:27781:x1830881261205760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.094575:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.094601:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f1fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b903 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.094648:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.094691:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094700:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094709:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.094714:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094719:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094748:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094753:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094757:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094762:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094797:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d9000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.094801:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094807:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094817:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854900) 00010000:00010000:1.0:1746065076.094819:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.094822:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094826:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc145f201 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094844:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094848:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094852:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094856:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095778800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.094858:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094863:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094868:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065076.094870:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.094872:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094879:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f208 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.094905:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f1fa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b903 expref: 263 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.094912:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f1fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b903 expref: 263 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.094921:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00000100:00100000:1.0:1746065076.094953:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+262:27781:x1830881261205760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 395us (496us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.094959:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11585 00000100:00100000:0.0:1746065076.095308:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.096730:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.096796:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206016 00000100:00100000:1.0:1746065076.096801:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206016 00000100:00100000:0.0:1746065076.098944:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.098986:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.102091:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.102138:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.102155:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261206784 00000100:00100000:1.0:1746065076.102160:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261206784 00000100:00100000:1.0:1746065076.102192:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11589 00000100:00100000:1.0:1746065076.102199:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27781:x1830881261206784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.102213:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.102226:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145f232 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b918 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.102275:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.102287:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102506:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102517:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.102522:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102528:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102563:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102569:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102573:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102577:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102582:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.102584:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102597:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102604:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065076.102607:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.102610:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102614:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8c00/0xad6b7ddc145f239 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102622:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102626:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102630:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102633:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.102635:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102638:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102642:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065076.102644:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.102646:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102649:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc145f240 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.102666:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145f232 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b918 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.102676:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc145f232 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b918 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.102682:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779400, rc 0) 00000100:00100000:1.0:1746065076.102715:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27781:x1830881261206784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 517us (576us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.102720:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11589 00000100:00100000:0.0:1746065076.106985:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.108035:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.108110:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207040 00000100:00100000:1.0:1746065076.108113:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207040 00000100:00100000:0.0:1746065076.108178:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11590 00000100:00100000:0.0:1746065076.108184:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27781:x1830881261207040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.108191:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.108193:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065076.108212:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f22b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b911 expref: 264 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.108236:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065076.108246:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065076.108254:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f247 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b91f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.108330:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.108339:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.108346:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.108352:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f255 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.108357:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f255 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.108361:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f255 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.108569:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.108576:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.108580:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065076.108587:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x308:0x0]: returning size 0 00010000:00010000:0.0:1746065076.108620:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.108645:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.108650:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145f25c lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x306:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.108655:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.108658:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145f25c lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x306:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.108663:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145f25c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x306:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.108671:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x306:0x0].0x0 (ffff88009554f200) 00010000:00010000:1.0:1746065076.108677:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065076.108680:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145f25c lrc: 1/0,0 mode: --/PW res: [0x240000403:0x306:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.108684:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc145f25c lrc: 0/0,0 mode: --/PW res: [0x240000403:0x306:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.108695:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.108696:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.108698:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.109426:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109435:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109440:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109444:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.109447:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109452:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109458:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065076.109460:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.109463:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109467:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145f24e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065076.109476:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880137346a00 reply state ffff880095fd4000 transno 4294975030 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f255 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109483:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145f255 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.109488:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:0.0:1746065076.109489:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065076.109491:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065076.109512:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145f247 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b91f expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.109527:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b91f expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.109533:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012d56c600) 00010000:00010000:0.0:1746065076.109535:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065076.109536:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:0.0:1746065076.109569:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27781:x1830881261207040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1385us (2590us total) trans 4294975030 rc 0/0 00000100:00100000:0.0:1746065076.109574:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11590 00000100:00100000:0.0:1746065076.112691:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.117335:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.117336:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.117356:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207680 00000100:00100000:1.0:1746065076.117366:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207680 00010000:00010000:1.0:1746065076.117396:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b91f expref: 268 pid: 7204 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.117535:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3442 00000100:00100000:1.0:1746065076.117541:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+268:2004:x1830881261207680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.117551:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.117556:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b91f expref: 268 pid: 7204 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.117566:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b91f expref: 268 pid: 7204 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.117584:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145f263 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b91f expref: 268 pid: 7204 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.117616:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012d56c600) 00010000:00010000:1.0:1746065076.117623:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f278 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.117630:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f278 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.117636:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9c00/0xad6b7ddc145f278 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.117649:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.117696:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+267:2004:x1830881261207680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 154us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.117702:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3442 00000100:00100000:1.0:1746065076.117721:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261207936 00000100:00100000:1.0:1746065076.117724:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261207936 00000100:00100000:1.0:1746065076.117750:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11592 00000100:00100000:1.0:1746065076.117754:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27782:x1830881261207936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.117765:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.117788:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f27f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b92d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.117834:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.117841:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.117846:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.117852:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.117857:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.117862:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.117919:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.118465:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118576:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118634:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118639:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118643:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118647:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.118649:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118653:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118659:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012d56c600) 00010000:00010000:1.0:1746065076.118661:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065076.118663:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118666:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4400/0xad6b7ddc145f294 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118678:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118683:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118686:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118691:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118694:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.118721:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118726:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118870:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854900) 00010000:00010000:1.0:1746065076.118873:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.118876:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118880:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc145f286 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118888:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118893:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118897:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118901:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.118903:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118907:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118918:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065076.118920:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.118922:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118926:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f28d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.118949:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f27f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b92d expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.118955:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f27f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b92d expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.118969:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778800, rc 0) 00000100:00100000:1.0:1746065076.119000:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27782:x1830881261207936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1244us (1672us total) trans 4294975032 rc 301/301 00000100:00100000:1.0:1746065076.119005:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11592 00000100:00100000:0.0:1746065076.120035:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.121418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.121486:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.121551:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261208576 00000100:00100000:1.0:1746065076.121555:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261208576 00000100:00100000:1.0:1746065076.121641:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11593 00000100:00100000:1.0:1746065076.121647:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27782:x1830881261208576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.121657:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.121669:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145f2a9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b934 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.121728:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145f2b0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.121740:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145f2b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.121747:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145f2b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065076.121764:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x308:0x0]: returning size 0 00000004:00200000:1.0:1746065076.121767:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065076.121793:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145f2b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.121811:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc145f2a9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b934 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.121822:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc145f2b0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b934 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.121828:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065076.121830:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.121833:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:1.0:1746065076.121856:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27782:x1830881261208576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 210us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.121861:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11593 00000100:00100000:0.0:1746065076.123665:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.125075:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.126043:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.129642:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.129688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.129725:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261209472 00000100:00100000:1.0:1746065076.129731:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261209472 00000100:00100000:1.0:1746065076.130529:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 530 00000100:00100000:1.0:1746065076.130536:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261209472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.130546:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.130557:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc145f2d3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b942 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.130566:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065076.130569:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.130807:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+273:2004:x1830881261209472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 271us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.130813:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 530 00000100:00100000:0.0:1746065076.131431:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.133492:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.133530:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.133602:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11598 00000100:00100000:0.0:1746065076.133609:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27782:x1830881261210112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.133623:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.133641:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f30b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b957 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.133695:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.133703:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.133709:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065076.133720:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x308:0x0]: returning size 0 00000004:00200000:0.0:1746065076.133723:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065076.133732:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000020 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.133752:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f30b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.133791:0:7205:0:(ldlm_lockd.c:1458:ldlm_handle_enqueue()) ### save blocking bits a in granted lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.133801:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.133807:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.133852:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854800) 00010000:00010000:0.0:1746065076.133854:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065076.133857:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145f320 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x308:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.133862:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145f320 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x308:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.133867:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00000100:00100000:0.0:1746065076.133900:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27782:x1830881261210112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 292us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.133905:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11598 00000100:00100000:0.0:1746065076.136718:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.136845:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261210496 00000100:00100000:1.0:1746065076.136849:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261210496 00010000:00010000:1.0:1746065076.136873:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.137461:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.137501:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3443 00000100:00100000:1.0:1746065076.137513:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261210496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.137524:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.137530:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.137539:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.137559:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f319 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x308:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b957 expref: 279 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.137573:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065076.137577:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145f320 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x308:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.137584:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145f320 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.137599:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc145f320 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.137613:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.137646:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261210496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 138us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.137651:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3443 00000100:00100000:0.0:1746065076.140187:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065076.141000:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975041 is committed 00000004:00080000:0.0:1746065076.141005:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1521 committed 00000004:00080000:0.0:1746065076.141360:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1531 committed 00000004:00080000:0.0:1746065076.141364:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1530 committed 00000004:00080000:0.0:1746065076.141366:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1520 committed 00000100:00100000:0.0:1746065076.141433:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571520:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.141466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.141490:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571904:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.141505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.141516:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065076.141520:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.141532:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.141542:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.141554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.141577:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262571520 00000100:00100000:0.0:1746065076.141580:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262571520 00000100:00100000:0.0:1746065076.141608:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262571904 00000100:00100000:0.0:1746065076.141610:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262571904 00000100:00100000:0.0:1746065076.141620:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262571008 00000100:00100000:0.0:1746065076.141621:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262571008 00000100:00100000:0.0:1746065076.141627:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262571392 00000100:00100000:0.0:1746065076.141629:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262571392 00000100:00100000:0.0:1746065076.141637:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8121 00000100:00100000:0.0:1746065076.141642:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+146:3759:x1830881262571520:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065076.141657:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:810 count 1 00002000:00010000:0.0:1746065076.141676:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065076.141681:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.141690:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.141692:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.141695:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.141703:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.141709:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.141715:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.141725:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065076.141868:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+150:3759:x1830881262571520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 225us (401us total) trans 17179872345 rc 0/0 00000100:00100000:0.0:1746065076.141876:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8121 00000100:00100000:0.0:1746065076.141887:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8123 00000100:00100000:0.0:1746065076.141891:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+116:3759:x1830881262571008:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.141903:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8124 00000100:00100000:0.0:1746065076.141906:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+116:3759:x1830881262571392:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065076.141953:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.141955:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.141957:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.141958:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.141960:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065076.141977:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+116:3759:x1830881262571392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 70us (423us total) trans 21474839620 rc 0/0 00000100:00100000:0.0:1746065076.141983:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8124 00000100:00100000:0.0:1746065076.141992:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8126 00000100:00100000:0.0:1746065076.141996:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+149:3761:x1830881262571648:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.142045:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+151:3761:x1830881262571648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 48us (329us total) trans 17179872346 rc 0/0 00000100:00100000:0.0:1746065076.142049:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8126 00000100:00100000:0.0:1746065076.142058:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8127 00000100:00100000:0.0:1746065076.142062:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+115:3761:x1830881262571264:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065076.142071:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:809 count 1 00002000:00010000:0.0:1746065076.142080:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065076.142084:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142094:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.142095:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.142097:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142104:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142110:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142115:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142123:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1746065076.142204:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+116:3761:x1830881262571264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 141us (452us total) trans 21474839621 rc 0/0 00000100:00100000:0.0:1746065076.142209:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8127 00000004:00080000:0.0:1746065076.142241:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12300/2, rc 0, transno 21474839620 00000100:00100000:0.0:1746065076.142245:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571392:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065076.142253:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10380/2, rc 0, transno 21474839619 00000100:00100000:0.0:1746065076.142256:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571904:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065076.142262:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd1880/2, rc 0, transno 17179872345 00000100:00100000:0.0:1746065076.142265:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571520:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065076.142279:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:808 count 1 00010000:00010000:0.0:1746065076.142287:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc145f35f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142297:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc145f1bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8ee expref: 53 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142302:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065076.142304:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065076.142306:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc145f35f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142324:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc145f1bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8ee expref: 53 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.142334:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc145f1bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b8ee expref: 53 pid: 1880 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.142343:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262572032:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065076.142392:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065076.142601:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1746065076.142606:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142612:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.142614:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142621:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142635:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142640:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f34a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142651:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.142653:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f72000/0xad6b7ddc145f351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142661:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.142663:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f72000/0xad6b7ddc145f351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142668:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f72000/0xad6b7ddc145f351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142674:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f72000/0xad6b7ddc145f351 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142679:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72000/0xad6b7ddc145f351 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142688:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.142690:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142695:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.142697:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142702:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142708:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142717:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc145f358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.142724:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.142725:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.142727:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.142731:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.144031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.144070:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261211264 00000100:00100000:0.0:1746065076.144070:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.144075:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261211264 00000100:00100000:1.0:1746065076.144101:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3991 00000100:00100000:1.0:1746065076.144106:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+259:27782:x1830881261211264:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.144216:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+260:27782:x1830881261211264:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 109us (189us total) trans 4294975043 rc 0/0 00000100:00100000:1.0:1746065076.144221:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3991 00000004:00080000:1.0:1746065076.145239:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e11500/2, rc 0, transno 21474839622 00000100:00100000:1.0:1746065076.145244:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262571008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.146629:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.146663:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.151748:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262572160:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065076.151788:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 55 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.151806:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:0.0:1746065076.151845:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+55:26180:x1830881261211648:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5049us (5181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.151853:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8129 00000100:00100000:0.0:1746065076.156331:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.157520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.157626:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212160 00000100:00100000:1.0:1746065076.157631:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212160 00000100:00100000:1.0:1746065076.157672:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8130 00000100:00100000:1.0:1746065076.157678:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+59:26180:x1830881261212160:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.157689:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.157700:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b97a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065076.157717:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065076.157729:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.157731:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.157737:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b97a expref: 60 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.157746:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b97a expref: 60 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.157753:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:1.0:1746065076.157789:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+60:26180:x1830881261212160:12345-192.168.202.27@tcp:101:bash.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.157795:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8130 00000100:00100000:0.0:1746065076.160013:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.160297:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212416 00000100:00100000:1.0:1746065076.160303:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212416 00000100:00100000:0.0:1746065076.160496:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.160535:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3993 00000100:00100000:0.0:1746065076.160535:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.160542:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27783:x1830881261212416:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.160900:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27783:x1830881261212416:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 358us (894us total) trans 4294975045 rc 0/0 00000100:00100000:1.0:1746065076.160905:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3993 00000100:00100000:1.0:1746065076.160925:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1210 00000100:00100000:1.0:1746065076.160930:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261212544:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065076.161009:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065076.161012:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb mtime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.161013:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.161015:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb ctime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.161016:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065076.161034:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261212544:12345-192.168.202.27@tcp:10:bash.0 Request processed in 103us (499us total) trans 21474839623 rc 0/0 00000100:00100000:1.0:1746065076.161039:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1210 00002000:00010000:1.0:1746065076.161041:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/810 (0->18446744073709551615) 00002000:00100000:1.0:1746065076.161043:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cebb80 with x1830881261212544 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065076.161046:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cebb80. 00000100:00100000:0.0:1746065076.166605:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.166684:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261212928 00000100:00100000:1.0:1746065076.166691:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261212928 00000100:00100000:1.0:1746065076.166733:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3994 00000100:00100000:1.0:1746065076.166739:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261212928:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065076.169355:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261212928:12345-192.168.202.27@tcp:35:bash.0 Request processed in 2608us (2757us total) trans 4294975046 rc 0/0 00000100:00100000:1.0:1746065076.169366:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3994 00000100:00100000:0.0:1746065076.169729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.177179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.185329:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.185406:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.185981:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261213696 00000100:00100000:1.0:1746065076.185987:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261213696 00000100:00100000:1.0:1746065076.186035:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3995 00000100:00100000:1.0:1746065076.186043:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27785:x1830881261213696:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:1.0:1746065076.186476:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27785:x1830881261213696:12345-192.168.202.27@tcp:35:rm.0 Request processed in 432us (1149us total) trans 4294975048 rc 0/0 00000100:00100000:1.0:1746065076.186482:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3995 00000100:00100000:0.0:1746065076.197114:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214208 00000100:00100000:0.0:1746065076.197122:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214208 00010000:00010000:0.0:1746065076.197154:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3b3 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x308:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b988 expref: 266 pid: 7204 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.197192:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3447 00000100:00100000:0.0:1746065076.197200:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+266:2004:x1830881261214208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.197212:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.197217:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3b3 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x308:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b988 expref: 266 pid: 7204 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.197228:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3b3 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x308:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b988 expref: 266 pid: 7204 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.197247:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854800) 00010000:00010000:0.0:1746065076.197252:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f3cf lrc: 3/0,1 mode: --/EX res: [0x240000403:0x308:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.197259:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f3cf lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.197265:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f3cf lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.197279:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065076.197316:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+266:2004:x1830881261214208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.197323:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3447 00000100:00100000:0.0:1746065076.205823:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.212397:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.212455:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.212519:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214592 00000100:00100000:0.0:1746065076.212527:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214592 00000100:00100000:0.0:1746065076.212559:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214720 00000100:00100000:0.0:1746065076.212561:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214720 00000100:00100000:0.0:1746065076.212575:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11606 00000100:00100000:0.0:1746065076.212582:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+268:27784:x1830881261214592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.212608:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.212625:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f3e4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b996 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.212717:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3eb lrc: 3/0,1 mode: --/PW res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.212728:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x308:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.212737:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x308:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065076.212751:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x308:0x0]: returning size 5 00010000:00010000:0.0:1746065076.212861:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f3e4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b996 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.212878:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f3eb lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x308:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b996 expref: 270 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.212885:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065076.212887:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065076.212890:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7000, rc 0) 00000100:00100000:1.0:1746065076.212993:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11607 00000100:00100000:1.0:1746065076.213000:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27786:x1830881261214720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.213007:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.213017:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f3f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b99d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.213056:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.213062:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213069:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213076:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.213082:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213086:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213113:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213118:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213122:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213127:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213131:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.213135:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213140:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213147:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065076.213149:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.213152:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213156:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc145f400 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213174:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213179:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213183:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213187:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.213189:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213193:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213199:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72800) 00010000:00010000:1.0:1746065076.213200:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.213202:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213207:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f407 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.213226:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f3f9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b99d expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.213232:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc145f3f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b99d expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.213241:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00000100:00100000:0.0:1746065076.214738:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27784:x1830881261214592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2150us (2343us total) trans 4294975051 rc 0/0 00000100:00100000:0.0:1746065076.214746:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11606 00000100:00100000:1.0:1746065076.215867:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27786:x1830881261214720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2863us (3406us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.215875:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11607 00000100:00100000:0.0:1746065076.219322:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.219661:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261214848 00000100:00100000:1.0:1746065076.219670:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261214848 00000100:00100000:0.0:1746065076.219823:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.221204:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8131 00000100:00100000:1.0:1746065076.221212:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261214848:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065076.221235:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.221247:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 54 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.221254:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065076.221255:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065076.221258:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.221282:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 54 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.221297:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 54 pid: 12260 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.221307:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098581180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262572672:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.221934:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.223882:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.223923:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.224001:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262572672:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.224020:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065076.229689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.231318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.231396:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261215488 00000100:00100000:1.0:1746065076.231404:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261215488 00010000:00010000:1.0:1746065076.231437:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 57 pid: 12260 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.231460:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3448 00000100:00100000:1.0:1746065076.231466:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261215488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.231477:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065076.231491:0:7192:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065076.231494:0:7192:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065076.231499:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 57 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.231515:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 57 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.231545:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc145f366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b96c expref: 57 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.231575:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.231577:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.231581:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231617:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231640:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.231676:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881261215488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 210us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.231682:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3448 00010000:00010000:1.0:1746065076.231703:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231709:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231722:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231728:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231738:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231743:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.231746:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231751:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231760:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.231765:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc145f423 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065076.231814:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+55:2004:x1830881261214848:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10603us (12500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.231821:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8131 00000100:00100000:0.0:1746065076.233416:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.242931:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065076.242944:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262572800:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.242986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.243030:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262572800 00000100:00100000:1.0:1746065076.243035:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262572800 00000100:00100000:1.0:1746065076.243062:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8132 00000100:00100000:1.0:1746065076.243067:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+116:3759:x1830881262572800:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.243173:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+117:3759:x1830881262572800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 105us (186us total) trans 21474839625 rc 0/0 00000100:00100000:1.0:1746065076.243177:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8132 00000004:00080000:1.0:1746065076.243205:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098581180/2, rc 0, transno 21474839625 00000100:00100000:1.0:1746065076.243209:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262572800:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065076.243259:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.243266:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.243272:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.243279:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.243283:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.243289:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.243298:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72800) 00010000:00010000:0.0:1746065076.243300:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.243303:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.243307:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6600/0xad6b7ddc145f3c8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065076.243468:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262572928 00000100:00100000:0.0:1746065076.243472:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262572928 00000100:00100000:0.0:1746065076.243499:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8133 00000100:00100000:0.0:1746065076.243504:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+117:3761:x1830881262572928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.243569:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+118:3761:x1830881262572928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (161us total) trans 21474839626 rc 0/0 00000100:00100000:0.0:1746065076.243575:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8133 00000100:00100000:1.0:1746065076.245143:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262573184:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.245168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.246898:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262573056 00000100:00100000:0.0:1746065076.246906:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262573056 00000100:00100000:0.0:1746065076.246932:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262573184 00000100:00100000:0.0:1746065076.246935:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262573184 00000100:00100000:0.0:1746065076.246948:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8134 00000100:00100000:0.0:1746065076.246953:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+151:3762:x1830881262573056:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065076.247055:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.247058:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.247061:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.247062:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.247064:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1746065076.247489:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3c000/2, rc 0, transno 17179872351 00000100:00100000:1.0:1746065076.247495:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262573184:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.247633:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+152:3762:x1830881262573056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 679us (3053us total) trans 17179872350 rc 0/0 00000100:00100000:0.0:1746065076.247639:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8134 00000100:00100000:0.0:1746065076.253074:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261216384 00000100:00100000:0.0:1746065076.253077:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261216384 00000100:00100000:0.0:1746065076.253130:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11613 00000100:00100000:0.0:1746065076.253137:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+260:27786:x1830881261216384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.253158:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.253173:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6c00/0xad6b7ddc145f477 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b9c7 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.253256:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.253268:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145f469 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9b9 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.253274:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.253299:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145f469 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9b9 expref: 261 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.253309:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc145f469 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9b9 expref: 261 pid: 7203 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.253323:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013189a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262573312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065076.253393:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065076.256064:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013189a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262573312:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.256082:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065076.256511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065076.257008:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257014:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065076.257034:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30a:0x0]: returning size 0 00000004:00080000:0.0:1746065076.257160:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x32d:0x0], index 1: 0 00000004:00080000:0.0:1746065076.257165:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x32c:0x0], index 0: 0 00000004:00080000:0.0:1746065076.257169:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x32d:0x0], index 0: 0 00000004:00080000:0.0:1746065076.257171:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x32e:0x0], index 1: 0 00010000:00010000:0.0:1746065076.257249:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257254:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257259:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257264:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.257268:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257273:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257283:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065076.257285:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.257288:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257291:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f47e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.257326:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6c00/0xad6b7ddc145f477 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9c7 expref: 262 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.257333:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6c00/0xad6b7ddc145f477 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9c7 expref: 262 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.257342:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:0.0:1746065076.257380:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+261:27786:x1830881261216384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4243us (4344us total) trans 4294975054 rc 301/301 00000100:00100000:0.0:1746065076.257385:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11613 00000100:00100000:0.0:1746065076.258731:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.260235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.263045:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.263648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.264428:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261217152 00000100:00100000:1.0:1746065076.264432:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261217152 00000100:00100000:1.0:1746065076.264461:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3997 00000100:00100000:1.0:1746065076.264466:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27786:x1830881261217152:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.264608:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27786:x1830881261217152:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 142us (1567us total) trans 4294975056 rc 0/0 00000100:00100000:1.0:1746065076.264614:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3997 00000100:00100000:0.0:1746065076.267630:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.269048:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8137 00000100:00100000:0.0:1746065076.269059:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+56:2006:x1830881261217408:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065076.269424:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+56:2006:x1830881261217408:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 367us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.269434:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8137 00000100:00100000:0.0:1746065076.270513:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.272722:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.274001:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.276098:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.276814:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.279110:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218688 00000100:00100000:1.0:1746065076.279114:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218688 00000100:00100000:1.0:1746065076.279140:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8139 00000100:00100000:1.0:1746065076.279145:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+56:2007:x1830881261218688:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:0.0:1746065076.279156:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261218560 00000100:00100000:0.0:1746065076.279159:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261218560 00000100:00100000:0.0:1746065076.279178:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11620 00000100:00100000:0.0:1746065076.279182:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261218560:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065076.279194:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.279204:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc145f4e7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b9ea expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065076.279232:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:0.0:1746065076.279233:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc145f4e7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9ea expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065076.279234:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.279236:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb atime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.279238:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.279240:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x32a:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:0.0:1746065076.279242:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc145f4e7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9ea expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.279253:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:0.0:1746065076.279256:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.279258:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6556800, rc 0) 00000100:00100000:1.0:1746065076.279266:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881261218688:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 121us (216us total) trans 21474839627 rc 0/0 00000100:00100000:1.0:1746065076.279271:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8139 00000100:00100000:0.0:1746065076.279271:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261218560:12345-192.168.202.27@tcp:101:bash.0 Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.279275:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11620 00000100:00100000:0.0:1746065076.280582:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.280723:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.280811:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219200 00000100:00100000:1.0:1746065076.280814:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219200 00000100:00100000:1.0:1746065076.280832:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11621 00000100:00100000:1.0:1746065076.280837:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261219200:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.280845:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.280846:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065076.280860:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc145f4e7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9ea expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.280918:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:1.0:1746065076.280921:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.280927:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f4f5 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b9f1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.280949:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f4fc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.280955:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f4fc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.280964:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f4fc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:1.0:1746065076.281171:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2267, 88 off188344 00000004:00080000:1.0:1746065076.281179:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672299404579ns, next at 672137633000ns, rc = 0 00000040:00080000:1.0:1746065076.281442:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2263, 88 off187904 00000004:00080000:1.0:1746065076.281447:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672299672911ns, next at 672137658713ns, rc = 0 00000040:00080000:1.0:1746065076.281470:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2264, 88 off187992 00000004:00080000:1.0:1746065076.281473:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672299699864ns, next at 672137658713ns, rc = 0 00000040:00080000:1.0:1746065076.281708:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2269, 88 off188504 00000004:00080000:1.0:1746065076.281712:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672299938682ns, next at 672137633000ns, rc = 0 00000100:00100000:1.0:1746065076.282916:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.283019:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219328 00000100:00100000:0.0:1746065076.283023:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219328 00010000:00010000:0.0:1746065076.283046:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f485 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9c0 expref: 274 pid: 7231 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.283076:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3450 00000100:00100000:0.0:1746065076.283082:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+274:2005:x1830881261219328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.283092:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.283096:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f485 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9c0 expref: 274 pid: 7231 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.283105:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc145f485 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9c0 expref: 274 pid: 7231 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.283119:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065076.283123:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 3/0,1 mode: --/EX res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.283129:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.283133:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.283144:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065076.283177:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+274:2005:x1830881261219328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.283183:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3450 00000001:00080000:1.0:1746065076.284414:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975061 is committed 00000004:00080000:1.0:1746065076.284419:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1535 committed 00000004:00080000:1.0:1746065076.284428:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1525 committed 00000004:00080000:1.0:1746065076.284431:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1524 committed 00000004:00080000:1.0:1746065076.284433:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1534 committed 00010000:00010000:1.0:1746065076.284683:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f4fc lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f1 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.284692:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:1.0:1746065076.284694:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065076.284706:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f4f5 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f1 expref: 265 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065076.284719:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f4fc lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f1 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.284743:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:1.0:1746065076.284746:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065076.284747:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6000, rc 0) 00000100:00100000:1.0:1746065076.286019:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261219200:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5175us (5290us total) trans 4294975061 rc 0/0 00000100:00100000:1.0:1746065076.286027:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11621 00000100:00100000:1.0:1746065076.286056:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065076.286067:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262573568:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.286110:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.286142:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262573568 00000100:00100000:1.0:1746065076.286146:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262573568 00000100:00100000:1.0:1746065076.286170:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8140 00000100:00100000:1.0:1746065076.286174:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+152:3759:x1830881262573568:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.286283:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+153:3759:x1830881262573568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (172us total) trans 17179872352 rc 0/0 00000100:00100000:1.0:1746065076.286288:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8140 00000004:00080000:1.0:1746065076.286315:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ea00/2, rc 0, transno 17179872352 00000100:00100000:1.0:1746065076.286319:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262573568:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.286766:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262573824 00000100:00100000:1.0:1746065076.286769:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262573824 00000100:00100000:0.0:1746065076.286933:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8142 00000100:00100000:0.0:1746065076.286939:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+120:3760:x1830881262573952:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.287367:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8143 00000100:00100000:1.0:1746065076.287371:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+153:3762:x1830881262573824:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.287496:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+120:3760:x1830881262573952:12345-0@lo:2:osp-syn-0-1.0 Request processed in 557us (708us total) trans 21474839629 rc 0/0 00000100:00100000:0.0:1746065076.287501:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8142 00000100:00100000:1.0:1746065076.288106:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+154:3762:x1830881262573824:12345-0@lo:2:osp-syn-1-1.0 Request processed in 733us (1693us total) trans 17179872353 rc 0/0 00000100:00100000:1.0:1746065076.288112:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8143 00000100:00100000:1.0:1746065076.289946:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:1.0:1746065076.290181:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975062 is committed 00000004:00080000:1.0:1746065076.290185:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1527 committed 00000004:00080000:1.0:1746065076.290191:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1537 committed 00000004:00080000:1.0:1746065076.290235:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1536 committed 00000004:00080000:1.0:1746065076.290237:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1526 committed 00000100:00100000:1.0:1746065076.290249:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065076.290256:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262574080:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.290290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.290530:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8146 00000100:00100000:0.0:1746065076.290535:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+155:3760:x1830881262574464:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.290610:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+156:3760:x1830881262574464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 75us (200us total) trans 17179872354 rc 0/0 00000100:00100000:0.0:1746065076.290616:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8146 00000100:00100000:0.0:1746065076.290626:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8147 00000100:00100000:0.0:1746065076.290630:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+155:3762:x1830881262574336:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065076.290667:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.290669:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.290671:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.290673:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.290674:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x32b:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1746065076.290703:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5c00/2, rc 0, transno 21474839630 00000100:00100000:1.0:1746065076.290706:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262574080:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.290856:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+156:3762:x1830881262574336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 225us (416us total) trans 17179872355 rc 0/0 00000100:00100000:0.0:1746065076.290861:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8147 00010000:00010000:1.0:1746065076.291028:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.291034:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.291040:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.291044:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.291051:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.291057:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.291065:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065076.291066:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065076.291069:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.291076:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3a00/0xad6b7ddc145f4ee lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00000100:00100000:0.0:1746065076.292917:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.293315:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261219584 00000100:00100000:1.0:1746065076.293322:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261219584 00000100:00100000:1.0:1746065076.293367:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11622 00000100:00100000:1.0:1746065076.293373:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+258:27784:x1830881261219584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.293394:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.293408:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145f50a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x308:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92b9ff expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065076.293439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.293558:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145f50a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9ff expref: 259 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.293565:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528800/0xad6b7ddc145f50a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x308:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9ff expref: 259 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.293576:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854300) 00010000:00010000:1.0:1746065076.293579:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065076.293581:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a528800, rc 0) 00000100:00100000:1.0:1746065076.293611:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+259:27784:x1830881261219584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 237us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.293616:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11622 00000100:00100000:1.0:1746065076.295834:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.296821:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.296826:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f518 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x308:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.296834:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6556e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.296837:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f518 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x308:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.296843:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f518 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x308:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.296852:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x308:0x0].0x0 (ffff88012f854300) 00010000:00010000:1.0:1746065076.296855:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065076.296858:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f518 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x308:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.296862:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc145f518 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x308:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.296870:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.296871:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.296873:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.299866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.305706:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.305801:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220736 00000100:00100000:1.0:1746065076.305809:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220736 00000100:00100000:1.0:1746065076.306103:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11623 00000100:00100000:1.0:1746065076.306110:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091326850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+261:27787:x1830881261220736:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.306128:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.306146:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f51f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ba0d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.306211:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.306221:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306230:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306241:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.306246:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306251:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306422:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145f534 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.306430:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145f534 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306435:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145f534 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065076.306443:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30a:0x0]: returning size 5 00010000:00010000:1.0:1746065076.306501:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306507:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306512:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306517:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306521:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095778e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.306525:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306530:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306540:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065076.306542:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.306545:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306550:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc145f526 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306637:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306642:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306646:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306650:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c55d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.306652:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306656:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306662:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854400) 00010000:00010000:1.0:1746065076.306664:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.306666:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306673:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc145f52d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.306706:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778800/0xad6b7ddc145f51f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba0d expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.306717:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145f534 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba0d expref: 263 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.306722:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:1.0:1746065076.306723:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.306726:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae1f200, rc 0) 00000100:00100000:1.0:1746065076.306912:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091326850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27787:x1830881261220736:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 801us (1213us total) trans 4294975065 rc 0/0 00000100:00100000:1.0:1746065076.306919:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11623 00000100:00100000:0.0:1746065076.310215:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.310600:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261220992 00000100:00100000:1.0:1746065076.310608:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261220992 00000100:00100000:1.0:1746065076.310655:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11624 00000100:00100000:1.0:1746065076.310662:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27788:x1830881261220992:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065076.310705:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065076.310726:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6000/0xad6b7ddc145f4fc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f1 expref: 263 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.310741:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145f534 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba0d expref: 262 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.310749:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145f4d2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x30a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9e3 expref: 261 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.310758:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:1.0:1746065076.310765:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.310807:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.310816:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.310823:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.310831:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.310836:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.310840:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.310907:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.310912:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.310917:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:1.0:1746065076.311093:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x30a:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1746065076.311149:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311159:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311164:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311169:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.311171:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311177:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065076.311179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.311183:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30a:0x0].0x0 (ffff88008f379800) 00010000:00010000:1.0:1746065076.311185:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065076.311188:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311192:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f550 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x30a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311207:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311211:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311215:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311219:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311223:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a528a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.311225:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311229:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311235:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065076.311237:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.311239:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311243:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f542 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065076.311253:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135221f80 reply state ffff880087e26000 transno 4294975066 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311260:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.311264:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:1.0:1746065076.311266:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065076.311269:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065076.311713:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:27788:x1830881261220992:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1051us (1506us total) trans 4294975066 rc 0/0 00000100:00100000:1.0:1746065076.311719:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11624 00000100:00100000:0.0:1746065076.314572:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.315396:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261221376 00000100:00100000:1.0:1746065076.315405:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261221376 00000100:00100000:1.0:1746065076.316097:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4001 00000100:00100000:1.0:1746065076.316106:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27787:x1830881261221376:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065076.316289:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x30a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065076.316338:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2274, 64 off188872 00000040:00080000:1.0:1746065076.316361:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2269, 64 off188360 00000040:00080000:1.0:1746065076.316549:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2271, 64 off188480 00000040:00080000:1.0:1746065076.316563:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2275, 64 off188936 00010000:00010000:1.0:1746065076.316611:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc145f565 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x30a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:1.0:1746065076.316624:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc145f565 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x30a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.316632:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc145f565 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x30a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.316639:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc145f565 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x30a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.316643:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc145f565 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x30a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.316648:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc145f565 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x30a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.316944:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065076.317605:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27787:x1830881261221376:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1497us (3035us total) trans 4294975067 rc 0/0 00000100:00100000:1.0:1746065076.317612:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4001 00000100:00100000:0.0:1746065076.318288:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.320632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.322914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.323618:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.327046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.332968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.337462:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.337515:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.337609:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222528 00000100:00100000:1.0:1746065076.337616:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222528 00000100:00100000:1.0:1746065076.337645:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261222784 00000100:00100000:1.0:1746065076.337646:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261222784 00000100:00100000:1.0:1746065076.337668:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11632 00000100:00100000:1.0:1746065076.337675:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27789:x1830881261222528:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.337693:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.337707:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a852b000/0xad6b7ddc145f5f1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ba45 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.338030:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.338040:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.338047:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145f5ff lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba4c expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.338052:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 5/0,1 mode: --/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.338072:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145f5ff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba4c expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.338256:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145f5ff lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba4c expref: 270 pid: 7231 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.338267:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098671500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262574592:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.338651:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.338659:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 270 pid: 7203 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.338666:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098672300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262574720:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.338698:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.339559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.340849:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223040 00000100:00100000:0.0:1746065076.340852:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223040 00010000:00010000:0.0:1746065076.340868:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 271 pid: 7203 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.340893:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3452 00000100:00100000:0.0:1746065076.340898:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+271:2005:x1830881261223040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.340903:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.340906:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 271 pid: 7203 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.340914:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 271 pid: 7203 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.340924:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30c:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065076.340928:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.340933:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.340937:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.340949:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065076.340972:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+271:2005:x1830881261223040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.340977:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3452 00010000:00010000:0.0:1746065076.341007:0:7204:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880098671500 x1830881262574592) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145f5ff lrc: 1/0,0 mode: --/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba4c expref: 270 pid: 7231 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.341015:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145f5ff lrc: 0/0,0 mode: --/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba4c expref: 270 pid: 7231 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.341029:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098671500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262574592:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065076.341038:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104600/0xad6b7ddc145f5e3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba3e expref: 269 pid: 7203 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.341046:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098672300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262574720:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065076.341060:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30c:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065076.341064:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341070:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341074:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065076.341093:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30c:0x0]: returning size 0 00000004:00080000:0.0:1746065076.341225:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x32e:0x0], index 0: 0 00000004:00080000:0.0:1746065076.341231:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x32f:0x0], index 1: 0 00000004:00080000:0.0:1746065076.341234:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x330:0x0], index 1: 0 00000004:00080000:0.0:1746065076.341237:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x32f:0x0], index 0: 0 00010000:00010000:0.0:1746065076.341314:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341320:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341324:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341329:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a528a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.341333:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341337:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341344:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30c:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065076.341345:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.341348:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341351:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f60d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.341386:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a852b000/0xad6b7ddc145f5f1 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba45 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.341392:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a852b000/0xad6b7ddc145f5f1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba45 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.341405:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852b000, rc 0) 00000100:00100000:0.0:1746065076.341425:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27789:x1830881261222528:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3751us (3971us total) trans 4294975070 rc 301/301 00000100:00100000:0.0:1746065076.341431:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11632 00000100:00100000:0.0:1746065076.343382:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.343473:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261223296 00000100:00100000:1.0:1746065076.343479:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261223296 00000100:00100000:1.0:1746065076.343528:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4002 00000100:00100000:1.0:1746065076.343535:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27789:x1830881261223296:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.343710:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27789:x1830881261223296:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 176us (333us total) trans 4294975071 rc 0/0 00000100:00100000:1.0:1746065076.343717:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4002 00000100:00100000:0.0:1746065076.345199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.345244:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.347846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.348932:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.349765:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.352426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.354161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.354236:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.354604:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261224704 00000100:00100000:1.0:1746065076.354609:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261224704 00000100:00100000:1.0:1746065076.354636:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4004 00000100:00100000:1.0:1746065076.354642:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27790:x1830881261224704:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.354769:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27790:x1830881261224704:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 127us (608us total) trans 4294975074 rc 0/0 00000100:00100000:1.0:1746065076.354791:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4004 00000100:00100000:1.0:1746065076.356813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.358004:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261225216 00000100:00100000:0.0:1746065076.358009:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261225216 00000100:00100000:0.0:1746065076.358033:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11638 00000100:00100000:0.0:1746065076.358039:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27790:x1830881261225216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.358049:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.358061:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145f66f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ba76 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.358106:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.358113:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358121:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358129:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.358133:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358137:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358205:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145f684 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.358211:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145f684 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358216:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145f684 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065076.358223:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30c:0x0]: returning size 0 00010000:00010000:0.0:1746065076.358263:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358269:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358274:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358280:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358285:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.358289:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358295:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358302:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34400) 00010000:00010000:0.0:1746065076.358304:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.358306:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.358311:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72000/0xad6b7ddc145f676 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359562:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359571:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359576:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359579:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.359582:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359596:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359605:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:0.0:1746065076.359607:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.359609:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359617:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145f67d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.359657:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72a00/0xad6b7ddc145f66f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba76 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.359671:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145f684 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba76 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.359676:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30c:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065076.359677:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065076.359680:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:0.0:1746065076.359730:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27790:x1830881261225216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1691us (2181us total) trans 4294975077 rc 0/0 00000100:00100000:0.0:1746065076.359737:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11638 00000100:00100000:0.0:1746065076.360570:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.362534:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.364137:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.365981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065076.367892:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975079 is committed 00000004:00080000:0.0:1746065076.367897:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1530 committed 00000004:00080000:0.0:1746065076.367913:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1540 committed 00000004:00080000:0.0:1746065076.367924:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1539 committed 00000004:00080000:0.0:1746065076.367926:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1529 committed 00000004:00080000:0.0:1746065076.367948:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1538 committed 00000004:00080000:0.0:1746065076.367950:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1528 committed 00010000:00010000:1.0:1746065076.369401:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369408:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369412:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369416:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.369418:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369425:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369433:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:1.0:1746065076.369435:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.369437:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369441:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f549 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.369467:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369472:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369475:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369478:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130105000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.369480:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369484:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369489:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:1.0:1746065076.369491:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.369492:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369496:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc145f5dc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.369508:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369513:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369516:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369519:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.369521:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369525:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369530:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30c:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:1.0:1746065076.369532:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.369534:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369538:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc145f668 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.369548:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.369821:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065076.369845:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8a80/2, rc 0, transno 17179872360 00000100:00100000:1.0:1746065076.369851:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262574976:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.369860:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957daa00/2, rc 0, transno 17179872359 00000100:00100000:1.0:1746065076.369862:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262575488:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.369869:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098580000/2, rc 0, transno 21474839635 00000100:00100000:1.0:1746065076.369872:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262576000:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065076.371362:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd6d80/2, rc 0, transno 21474839636 00000100:00100000:1.0:1746065076.371366:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262576128:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.372525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.372554:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.372571:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226496 00000100:00100000:0.0:1746065076.372575:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226496 00010000:00010000:0.0:1746065076.372603:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b97a expref: 64 pid: 12260 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.372630:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3453 00000100:00100000:0.0:1746065076.372636:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+64:2005:x1830881261226496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.372646:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.372649:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b97a expref: 64 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.372658:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b97a expref: 64 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.372673:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc145f390 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b97a expref: 64 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.372687:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.372689:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.372692:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065076.372755:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226368 00000100:00100000:1.0:1746065076.372759:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226368 00000100:00100000:1.0:1746065076.372809:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4006 00000100:00100000:1.0:1746065076.372815:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+261:27790:x1830881261226368:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.373193:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27790:x1830881261226368:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 377us (669us total) trans 4294975081 rc 0/0 00000100:00100000:1.0:1746065076.373199:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4006 00010000:00010000:0.0:1746065076.373421:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.374115:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065076.374140:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+63:2005:x1830881261226496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1504us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.374146:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3453 00000100:00100000:0.0:1746065076.374158:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3454 00000100:00100000:0.0:1746065076.374162:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+60:2004:x1830881261226624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.374170:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.374173:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdba00/0xad6b7ddc145f511 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba06 expref: 60 pid: 1880 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.374181:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdba00/0xad6b7ddc145f511 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba06 expref: 60 pid: 1880 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.374194:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdba00/0xad6b7ddc145f511 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba06 expref: 60 pid: 1880 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.374202:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.374203:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.374206:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.374211:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065076.374258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065076.374869:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065076.374892:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881261226624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 729us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.374899:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3454 00000100:00100000:1.0:1746065076.375627:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.375640:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261226752 00000100:00100000:1.0:1746065076.375643:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261226752 00010000:00010000:1.0:1746065076.375656:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc145f503 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f8 expref: 63 pid: 12260 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.375672:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3456 00000100:00100000:1.0:1746065076.375676:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+63:2004:x1830881261226752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.375683:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.375686:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc145f503 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f8 expref: 63 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.375693:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc145f503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f8 expref: 63 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.375709:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc145f503 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92b9f8 expref: 63 pid: 12260 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.375717:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.375719:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.375722:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375727:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375739:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.375754:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+62:2004:x1830881261226752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.375759:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3456 00010000:00010000:1.0:1746065076.375796:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375802:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375808:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375813:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375826:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1746065076.375909:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+162:3761:x1830881262575104:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6876us (7458us total) trans 17179872362 rc 0/0 00000100:00100000:1.0:1746065076.375915:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8161 00010000:00010000:1.0:1746065076.375928:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1746065076.375933:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375938:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.375941:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375947:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375956:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375961:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc145f6ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375972:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.375975:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131bee400/0xad6b7ddc145f6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375980:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.375982:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131bee400/0xad6b7ddc145f6fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375987:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131bee400/0xad6b7ddc145f6fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375992:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131bee400/0xad6b7ddc145f6fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.375997:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131bee400/0xad6b7ddc145f6fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.376006:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.376008:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.376012:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.376014:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.376018:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.376024:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.376028:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc145f6f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.376040:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.376041:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.376042:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.376046:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065076.376063:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8700/2, rc 0, transno 17179872362 00000100:00100000:1.0:1746065076.376066:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262575104:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.376075:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098583100/2, rc 0, transno 21474839637 00000100:00100000:1.0:1746065076.376078:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262575616:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065076.376598:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065076.376602:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.376612:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065076.376614:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.376620:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.376629:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.376633:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc145f6d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.376643:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.376644:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.376651:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.377504:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.377557:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261227136 00000100:00100000:1.0:1746065076.377562:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261227136 00000100:00100000:1.0:1746065076.377641:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4007 00000100:00100000:1.0:1746065076.377647:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27790:x1830881261227136:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065076.378310:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27790:x1830881261227136:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 660us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.378316:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4007 00000100:00100000:0.0:1746065076.380165:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.380506:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.387372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.387431:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261227776 00000100:00100000:1.0:1746065076.387439:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261227776 00000100:00100000:1.0:1746065076.387493:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4008 00000100:00100000:1.0:1746065076.387500:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+262:26180:x1830881261227776:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065076.387730:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261227776:12345-192.168.202.27@tcp:35:bash.0 Request processed in 229us (364us total) trans 4294975082 rc 0/0 00000100:00100000:1.0:1746065076.387736:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4008 00000100:00100000:0.0:1746065076.388538:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.394087:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.394143:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261228288 00000100:00100000:1.0:1746065076.394152:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261228288 00000100:00100000:1.0:1746065076.394195:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4009 00000100:00100000:1.0:1746065076.394201:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27791:x1830881261228288:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.394744:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27791:x1830881261228288:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 541us (663us total) trans 4294975084 rc 0/0 00000100:00100000:1.0:1746065076.394751:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4009 00000100:00100000:0.0:1746065076.397712:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.399720:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.399726:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145f748 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x30c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.399730:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.399733:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145f748 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x30c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.399737:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145f748 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x30c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.399744:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30c:0x0].0x0 (ffff880097b72800) 00010000:00010000:1.0:1746065076.399746:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065076.399748:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145f748 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x30c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.399752:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145f748 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x30c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.399762:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.399763:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.399764:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.401962:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.412639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.415245:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.417580:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.426146:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.427180:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.431827:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.441940:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.441979:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.445500:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.447839:0:11456:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:11456:1830881262577024:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1746065076.447873:0:11456:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.447891:0:11456:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.449010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.449092:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261230848 00000100:00100000:1.0:1746065076.449097:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261230848 00000100:00100000:1.0:1746065076.449123:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4010 00000100:00100000:1.0:1746065076.449130:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27794:x1830881261230848:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.449264:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27794:x1830881261230848:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 134us (255us total) trans 4294975089 rc 0/0 00000100:00100000:1.0:1746065076.449270:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4010 00000100:00100000:0.0:1746065076.451085:0:11456:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:11456:1830881262577024:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1746065076.451096:0:11456:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x332:0x0]-[0x2c0000400:0x361:0x0] 00000100:00100000:1.0:1746065076.455671:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.455723:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.459521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.460661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.463483:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.464928:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.465303:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261232000 00000100:00100000:1.0:1746065076.465308:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261232000 00000100:00100000:1.0:1746065076.465347:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 532 00000100:00100000:1.0:1746065076.465353:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+275:2006:x1830881261232000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.465362:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.465381:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a000/0xad6b7ddc145f852 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bafb expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.465405:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.465409:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.465431:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+274:2006:x1830881261232000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.465437:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 532 00000100:00100000:0.0:1746065076.465857:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.470125:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.470323:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261232384 00000100:00100000:1.0:1746065076.470331:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261232384 00000100:00100000:1.0:1746065076.470381:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11657 00000100:00100000:1.0:1746065076.470387:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27797:x1830881261232384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.470404:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.470417:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145f86e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb09 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.470495:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd600/0xad6b7ddc145f875 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.470505:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd600/0xad6b7ddc145f875 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.470513:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd600/0xad6b7ddc145f875 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065076.470520:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30e:0x0]: returning size 0 00010000:00010000:1.0:1746065076.470617:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145f86e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb09 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.470631:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd600/0xad6b7ddc145f875 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb09 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.470637:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.470639:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065076.470641:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccd600, rc 0) 00000100:00100000:1.0:1746065076.470711:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27797:x1830881261232384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 323us (592us total) trans 4294975093 rc 0/0 00000100:00100000:1.0:1746065076.470717:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11657 00000100:00100000:0.0:1746065076.472453:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.475995:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.476915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.480623:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.481991:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233280 00000100:00100000:1.0:1746065076.482005:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233280 00000100:00100000:1.0:1746065076.482079:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4013 00000100:00100000:1.0:1746065076.482088:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27797:x1830881261233280:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.482313:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27797:x1830881261233280:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 224us (1698us total) trans 4294975096 rc 0/0 00000100:00100000:1.0:1746065076.482323:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4013 00000100:00100000:0.0:1746065076.484054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065076.488121:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975097 is committed 00000004:00080000:0.0:1746065076.488131:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1542 committed 00000004:00080000:0.0:1746065076.488136:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1532 committed 00000004:00080000:0.0:1746065076.488140:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1531 committed 00000004:00080000:0.0:1746065076.488142:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1541 committed 00010000:00010000:1.0:1746065076.488270:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145f89f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb17 expref: 264 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.488281:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.488284:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065076.488296:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5e00/0xad6b7ddc145f898 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb17 expref: 264 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065076.488321:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145f89f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb17 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.488349:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.488351:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065076.488353:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:1.0:1746065076.488407:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261233024:12345-192.168.202.27@tcp:101:bash.0 Request processed in 10447us (11491us total) trans 4294975097 rc 0/0 00000100:00100000:1.0:1746065076.488414:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11660 00000100:00100000:0.0:1746065076.488864:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.488887:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8169 00000100:00100000:0.0:1746065076.488893:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+166:3760:x1830881262577664:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.489021:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+167:3760:x1830881262577664:12345-0@lo:2:osp-syn-1-1.0 Request processed in 128us (345us total) trans 17179872365 rc 0/0 00000100:00100000:0.0:1746065076.489026:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8169 00000100:00100000:0.0:1746065076.489037:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8171 00000100:00100000:0.0:1746065076.489041:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+167:3762:x1830881262577408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065076.489051:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:816 count 1 00010000:00010000:0.0:1746065076.489059:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.489070:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f645 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba61 expref: 64 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065076.489076:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.489077:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.489079:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.489094:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba61 expref: 64 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065076.489101:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba61 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746065076.489109:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c53c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262577920:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065076.489129:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065076.489281:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233664 00000100:00100000:1.0:1746065076.489285:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233664 00000100:00100000:1.0:1746065076.489307:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11661 00000100:00100000:1.0:1746065076.489312:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27797:x1830881261233664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.489322:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.489332:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc400/0xad6b7ddc145f8b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb1e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.489381:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.489389:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.489396:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.489403:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.489408:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.489413:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065076.489977:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262578432:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.490003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.490074:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262578176:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065076.490155:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.490163:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490169:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065076.490177:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30e:0x0]: returning size 2 00010000:00010000:1.0:1746065076.490227:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490233:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490238:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490242:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490246:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccc800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.490248:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490252:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490258:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065076.490260:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.490262:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490266:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490273:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490277:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490281:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490285:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.490286:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490290:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490299:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72d00) 00010000:00010000:1.0:1746065076.490300:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.490302:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490306:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd000/0xad6b7ddc145f8c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.490341:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc400/0xad6b7ddc145f8b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb1e expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.490358:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb1e expref: 262 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.490363:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.490365:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.490366:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccd400, rc 0) 00000100:00100000:1.0:1746065076.490406:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27797:x1830881261233664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1093us (1542us total) trans 4294975098 rc 0/0 00000100:00100000:1.0:1746065076.490411:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11661 00000100:00100000:0.0:1746065076.490469:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065076.490474:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262578048:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.490491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.491088:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262578304 00000100:00100000:0.0:1746065076.491091:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262578304 00000100:00100000:0.0:1746065076.491120:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8174 00000100:00100000:0.0:1746065076.491125:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+130:3762:x1830881262578304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.491186:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+131:3762:x1830881262578304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 61us (282us total) trans 21474839641 rc 0/0 00000100:00100000:0.0:1746065076.491190:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8174 00000004:00080000:0.0:1746065076.491214:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4380/2, rc 0, transno 21474839640 00000100:00100000:0.0:1746065076.491218:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262578432:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.491318:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.493656:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3461 00000100:00100000:1.0:1746065076.493664:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+60:2007:x1830881261234304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.493672:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.493676:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009af08c00/0xad6b7ddc145f702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba92 expref: 60 pid: 12258 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.493689:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009af08c00/0xad6b7ddc145f702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba92 expref: 60 pid: 12258 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.493701:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009af08c00/0xad6b7ddc145f702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba92 expref: 60 pid: 12258 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.493710:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.493712:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.493714:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493720:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493731:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.493751:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+59:2007:x1830881261234304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.493756:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3461 00010000:00010000:1.0:1746065076.493801:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a528a00/0xad6b7ddc145f645 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ba61 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746065076.493809:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c53c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262577920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.493819:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493825:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493831:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493838:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493844:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.493856:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065076.494165:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.494324:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+168:3762:x1830881262577408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5281us (5594us total) trans 17179872367 rc 0/0 00000100:00100000:1.0:1746065076.494333:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8171 00000100:00100000:1.0:1746065076.494345:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234432 00000100:00100000:1.0:1746065076.494347:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234432 00000100:00100000:1.0:1746065076.494363:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8176 00000100:00100000:1.0:1746065076.494367:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+63:26180:x1830881261234432:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.494377:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.494386:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb25 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494401:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065076.494406:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.494407:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.494410:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 64 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494425:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065076.494433:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746065076.494442:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009576f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262578816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.494480:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065076.494489:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.494494:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494501:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.494505:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494511:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494521:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494526:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f8ad lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494542:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.494544:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc145f8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494548:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.494550:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc145f8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494556:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc145f8a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494563:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc145f8a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494568:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc145f8a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.494577:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.494579:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.494580:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065076.494609:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077c700/2, rc 0, transno 17179872367 00000100:00100000:1.0:1746065076.494613:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262577408:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065076.494817:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065076.494879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.495032:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261233920 00000100:00100000:0.0:1746065076.495036:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261233920 00000100:00100000:0.0:1746065076.495066:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4014 00000100:00100000:0.0:1746065076.495071:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+262:27797:x1830881261233920:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065076.495194:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27797:x1830881261233920:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 122us (314us total) trans 4294975099 rc 0/0 00000100:00100000:0.0:1746065076.495199:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4014 00010000:00010000:1.0:1746065076.495829:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.495834:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.495843:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.495846:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.495852:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.495863:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.495868:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc145f8d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.495881:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.495882:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.495884:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065076.496039:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd5180/2, rc 0, transno 21474839642 00000100:00100000:0.0:1746065076.496044:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262578048:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.496283:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.496900:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.496905:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9600/0xad6b7ddc145f8de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.496910:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d9600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.496913:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9600/0xad6b7ddc145f8de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.496920:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9600/0xad6b7ddc145f8de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.496933:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9600/0xad6b7ddc145f8de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.496938:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9600/0xad6b7ddc145f8de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.496950:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.496951:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.496953:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065076.497047:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4a80/2, rc 0, transno 21474839643 00000100:00100000:0.0:1746065076.497051:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262578176:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.497195:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009576f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262578816:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.497210:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 64 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.497219:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2600, rc 0) 00000100:00100000:1.0:1746065076.497239:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+64:26180:x1830881261234432:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2871us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.497245:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8176 00000100:00100000:0.0:1746065076.497291:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234688 00000100:00100000:0.0:1746065076.497294:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234688 00010000:00010000:0.0:1746065076.497307:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746065076.497334:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3463 00000100:00100000:0.0:1746065076.497339:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+64:2004:x1830881261234688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.497346:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.497349:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746065076.497357:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746065076.497369:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f836 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92baf4 expref: 64 pid: 1880 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746065076.497378:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.497379:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.497383:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 63 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.497388:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 63 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.497416:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 63 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065076.497425:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881262578944:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065076.497473:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.498722:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.498978:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234816 00000100:00100000:1.0:1746065076.498983:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234816 00000100:00100000:1.0:1746065076.499020:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4015 00000100:00100000:1.0:1746065076.499026:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27797:x1830881261234816:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065076.499141:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27797:x1830881261234816:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 115us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.499146:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4015 00000100:00100000:0.0:1746065076.500262:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.500346:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261234944 00000100:00100000:1.0:1746065076.500351:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261234944 00000100:00100000:1.0:1746065076.500597:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8177 00000100:00100000:1.0:1746065076.500604:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+58:26180:x1830881261234944:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.500613:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.500626:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb2c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065076.500643:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065076.500657:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.500658:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.500664:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb2c expref: 59 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.500674:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb2c expref: 59 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.500680:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065076.500695:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+59:26180:x1830881261234944:12345-192.168.202.27@tcp:101:bash.0 Request processed in 92us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.500700:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8177 00000100:00100000:0.0:1746065076.503947:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235200 00000100:00100000:0.0:1746065076.503954:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235200 00002000:00010000:0.0:1746065076.503989:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/816 (0->18446744073709551615) 00002000:00100000:0.0:1746065076.503993:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881261235200 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065076.504002:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0700. 00000100:00100000:0.0:1746065076.504017:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235072 00000100:00100000:0.0:1746065076.504019:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235072 00002000:00010000:0.0:1746065076.504030:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/817 (0->18446744073709551615) 00002000:00100000:0.0:1746065076.504033:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3480 with x1830881261235072 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065076.504038:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3480. 00000100:00100000:0.0:1746065076.504062:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1215 00000100:00100000:0.0:1746065076.504069:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881261235200:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065076.504203:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.504205:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb mtime from disk: 0 -> 1746065076 00002000:00010000:0.0:1746065076.504207:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.504209:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb ctime from disk: 0 -> 1746065076 00002000:00010000:0.0:1746065076.504211:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065076.504250:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+60:2005:x1830881261235200:12345-192.168.202.27@tcp:10:bash.0 Request processed in 181us (977us total) trans 21474839644 rc 0/0 00000100:00100000:0.0:1746065076.504255:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1215 00002000:00010000:0.0:1746065076.504258:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/816 (0->18446744073709551615) 00002000:00100000:0.0:1746065076.504260:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881261235200 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065076.504263:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0700. 00000100:00100000:0.0:1746065076.504276:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1216 00000100:00100000:0.0:1746065076.504281:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+63:2005:x1830881261235072:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065076.504347:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.504349:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb mtime from disk: 0 -> 1746065076 00002000:00010000:0.0:1746065076.504350:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.504352:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb ctime from disk: 0 -> 1746065076 00002000:00010000:0.0:1746065076.504353:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065076.504369:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+64:2005:x1830881261235072:12345-192.168.202.27@tcp:10:bash.0 Request processed in 88us (482us total) trans 17179872369 rc 0/0 00000100:00100000:0.0:1746065076.504374:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1216 00002000:00010000:0.0:1746065076.504376:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/817 (0->18446744073709551615) 00002000:00100000:0.0:1746065076.504378:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3480 with x1830881261235072 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065076.504381:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3480. 00000100:00100000:0.0:1746065076.510447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.510484:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.510505:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235712 00000100:00100000:0.0:1746065076.510512:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235712 00000100:00100000:0.0:1746065076.510546:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4016 00000100:00100000:0.0:1746065076.510552:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+263:26180:x1830881261235712:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065076.510789:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261235712:12345-192.168.202.27@tcp:35:bash.0 Request processed in 220us (288us total) trans 4294975100 rc 0/0 00000100:00100000:0.0:1746065076.510796:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4016 00000100:00100000:1.0:1746065076.511116:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235456 00000100:00100000:1.0:1746065076.511121:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235456 00000100:00100000:1.0:1746065076.511377:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11662 00000100:00100000:1.0:1746065076.511384:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27798:x1830881261235456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.511394:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.511408:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af08c00/0xad6b7ddc145f8f3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb33 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.511568:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8fa lrc: 3/1,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.511578:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.511599:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065076.511609:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30e:0x0]: returning size 5 00010000:00010000:1.0:1746065076.511663:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af08c00/0xad6b7ddc145f8f3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb33 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.512040:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc145f8fa lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb33 expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.512048:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.512051:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065076.512053:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc800, rc 0) 00000100:00100000:1.0:1746065076.512526:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27798:x1830881261235456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1140us (2086us total) trans 4294975101 rc 0/0 00000100:00100000:1.0:1746065076.512532:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11662 00000100:00100000:0.0:1746065076.518686:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.518832:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261235968 00000100:00100000:1.0:1746065076.518840:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261235968 00000100:00100000:1.0:1746065076.518884:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11663 00000100:00100000:1.0:1746065076.518893:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27798:x1830881261235968:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.518914:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.518931:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f908 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb3a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.519018:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f90f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.519030:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb1e expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.519037:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f90f lrc: 4/0,1 mode: --/CW res: [0x240000403:0x30e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.519062:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb1e expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.519073:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145f8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb1e expref: 267 pid: 7204 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.519083:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009576f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262579072:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.520196:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065076.522671:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009576f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262579072:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.522695:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f90f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x30e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065076.525715:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065076.527031:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f90f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x30e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.527039:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f90f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x30e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065076.527062:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30e:0x0]: returning size 5 00010000:00010000:0.0:1746065076.527169:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145f908 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb3a expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.527185:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f90f lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x30e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb3a expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.527191:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065076.527194:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065076.527196:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3c00, rc 0) 00000100:00100000:0.0:1746065076.527223:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27798:x1830881261235968:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8332us (8546us total) trans 4294975102 rc 0/0 00000100:00100000:0.0:1746065076.527228:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11663 00000100:00100000:0.0:1746065076.529644:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.533026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.537999:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.538057:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261236736 00000100:00100000:1.0:1746065076.538065:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261236736 00000100:00100000:1.0:1746065076.538114:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4017 00000100:00100000:1.0:1746065076.538122:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27799:x1830881261236736:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:1.0:1746065076.538343:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27799:x1830881261236736:12345-192.168.202.27@tcp:35:rm.0 Request processed in 221us (350us total) trans 4294975103 rc 0/0 00000100:00100000:1.0:1746065076.538351:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4017 00000100:00100000:1.0:1746065076.539218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.545267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.550353:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.555863:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237632 00000100:00100000:0.0:1746065076.555870:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237632 00002000:00100000:0.0:1746065076.555903:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x331:0x0] (0->4) req@ffff88009c5f2d80 x1830881261237632/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:747/0 lens 496/0 e 0 to 0 dl 1746065087 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065076.555911:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881261237632 ext(0->4) 00010000:00010000:0.0:1746065076.555918:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 65 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.555928:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 65 pid: 10219 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746065076.555934:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f2d80 00000100:00100000:0.0:1746065076.555954:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 207 00000100:00100000:0.0:1746065076.555961:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+65:2004:x1830881261237632:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:0.0:1746065076.557004:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+67:2004:x1830881261237632:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1037us (1522us total) trans 17179872370 rc 0/0 00000100:00100000:0.0:1746065076.557011:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 207 00002000:00100000:0.0:1746065076.557018:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x331:0x0] (0->4) req@ffff88009c5f2d80 x1830881261237632/t17179872370(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:747/0 lens 496/448 e 0 to 0 dl 1746065087 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065076.557025:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881261237632 ext(0->4) 00010000:00010000:0.0:1746065076.557030:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 67 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.557040:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 67 pid: 10219 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746065076.557045:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f2d80 00000100:00100000:0.0:1746065076.562184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.562228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.562308:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261237888 00000100:00100000:1.0:1746065076.562312:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261237888 00010000:00010000:1.0:1746065076.562334:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 67 pid: 10219 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.562371:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3466 00000100:00100000:1.0:1746065076.562378:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+67:2005:x1830881261237888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.562389:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065076.562403:0:10893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065076.562406:0:10893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065076.562411:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 67 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.562423:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 67 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.562443:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f8e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb25 expref: 67 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.562459:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.562461:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.562465:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.562473:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.562503:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.562540:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261237888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 162us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.562546:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3466 00010000:00010000:0.0:1746065076.563116:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563124:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563138:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563143:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563149:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563154:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065076.563156:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563161:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563169:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.563174:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc145f978 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065076.563215:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+65:2004:x1830881261237504:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10734us (12868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.563221:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8178 00010000:00010000:1.0:1746065076.571911:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.571925:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.571931:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.571935:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.571939:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.571945:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.571957:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72400) 00010000:00010000:1.0:1746065076.571960:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.571962:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.571966:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc145f963 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000001:00080000:0.0:1746065076.572029:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975106 is committed 00000004:00080000:0.0:1746065076.572036:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1544 committed 00000004:00080000:0.0:1746065076.572047:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1534 committed 00000004:00080000:0.0:1746065076.572052:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1533 committed 00000004:00080000:0.0:1746065076.572054:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1543 committed 00000100:00100000:0.0:1746065076.572098:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262579456:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.572139:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.572180:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065076.572185:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c53c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262579840:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.572209:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.572228:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262579584:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.572231:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262579456 00000100:00100000:0.0:1746065076.572235:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262579456 00000100:00100000:1.0:1746065076.572251:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.572270:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262579840 00000100:00100000:0.0:1746065076.572272:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262579840 00000100:00100000:1.0:1746065076.572280:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065076.572283:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262579584 00000100:00100000:1.0:1746065076.572284:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262579712:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.572285:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262579584 00000100:00100000:0.0:1746065076.572295:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8179 00000100:00100000:0.0:1746065076.572301:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+167:3760:x1830881262579456:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.572386:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.572413:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238400 00000100:00100000:0.0:1746065076.572413:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+168:3760:x1830881262579456:12345-0@lo:2:osp-syn-1-1.0 Request processed in 113us (274us total) trans 17179872371 rc 0/0 00000100:00100000:1.0:1746065076.572415:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238400 00000100:00100000:0.0:1746065076.572419:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8179 00000100:00100000:0.0:1746065076.572430:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262579712 00000100:00100000:0.0:1746065076.572432:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262579712 00000100:00100000:1.0:1746065076.572435:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11672 00000100:00100000:1.0:1746065076.572439:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+260:27800:x1830881261238400:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065076.572443:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8180 00000100:00100000:0.0:1746065076.572446:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+133:3760:x1830881262579840:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065076.572449:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.572459:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f9b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb6b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.572494:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc145f9b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065076.572502:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc145f9b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.572509:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc145f9b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065076.572509:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3760:x1830881262579840:12345-0@lo:2:osp-syn-0-1.0 Request processed in 62us (303us total) trans 21474839645 rc 0/0 00000100:00100000:0.0:1746065076.572514:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8180 00000100:00100000:0.0:1746065076.572522:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8181 00000100:00100000:0.0:1746065076.572525:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+133:3761:x1830881262579584:12345-0@lo:2:osp-syn-0-1.0 00000004:00200000:1.0:1746065076.572531:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065076.572534:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065076.572556:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145f9b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb6b expref: 262 pid: 7231 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065076.572562:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.572564:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00010000:00010000:1.0:1746065076.572566:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc145f9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb6b expref: 261 pid: 7231 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065076.572566:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.572568:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.572570:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x330:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065076.572571:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:1.0:1746065076.572573:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065076.572575:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:0.0:1746065076.572604:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+134:3761:x1830881262579584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (352us total) trans 21474839646 rc 0/0 00000100:00100000:0.0:1746065076.572609:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8181 00000100:00100000:1.0:1746065076.572614:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+261:27800:x1830881261238400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 174us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.572618:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8182 00000100:00100000:1.0:1746065076.572619:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11672 00000100:00100000:0.0:1746065076.572622:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+168:3761:x1830881262579712:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.572646:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955cfb80/2, rc 0, transno 21474839646 00000100:00100000:1.0:1746065076.572651:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262579584:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.572672:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+169:3761:x1830881262579712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 50us (286us total) trans 17179872372 rc 0/0 00000100:00100000:0.0:1746065076.572677:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8182 00000004:00080000:1.0:1746065076.572682:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f57100/2, rc 0, transno 17179872372 00000100:00100000:1.0:1746065076.572685:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262579712:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065076.572697:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c53c380/2, rc 0, transno 21474839645 00000100:00100000:0.0:1746065076.572700:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c53c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262579840:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065076.572941:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f55c00/2, rc 0, transno 17179872371 00000100:00100000:0.0:1746065076.572945:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262579456:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.574740:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.579912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.580000:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.580067:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238656 00000100:00100000:1.0:1746065076.580075:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238656 00000100:00100000:1.0:1746065076.580109:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261238784 00000100:00100000:1.0:1746065076.580111:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261238784 00000100:00100000:1.0:1746065076.580135:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11674 00000100:00100000:1.0:1746065076.580142:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+262:27798:x1830881261238656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.580157:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.580173:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145f9c5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb79 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.580228:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f9cc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.580239:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f9cc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.580248:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f9cc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065076.580284:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x30e:0x0]: returning size 5 00000004:00200000:1.0:1746065076.580288:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065076.580312:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f9cc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.580333:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145f9c5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb79 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.580345:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145f9cc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x30e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb79 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.580351:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff880097b72600) 00010000:00010000:1.0:1746065076.580354:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065076.580356:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3c00, rc 0) 00000100:00100000:1.0:1746065076.580395:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:27798:x1830881261238656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 254us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.580400:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11674 00000100:00100000:0.0:1746065076.581705:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.581746:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.586876:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.586927:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.589157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.589417:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.590326:0:10212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262580096:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1746065076.590353:0:10212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.590379:0:10212:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.592261:0:10212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262580096:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1746065076.592271:0:10212:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x333:0x0]-[0x280000400:0x361:0x0] 00000100:00100000:0.0:1746065076.592520:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240320 00000100:00100000:0.0:1746065076.592524:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240320 00000100:00100000:0.0:1746065076.592559:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4018 00000100:00100000:0.0:1746065076.592565:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27800:x1830881261240320:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065076.592731:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27800:x1830881261240320:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 165us (262us total) trans 4294975109 rc 0/0 00000100:00100000:0.0:1746065076.592736:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4018 00000100:00100000:1.0:1746065076.595082:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.595198:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.595256:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240704 00000100:00100000:0.0:1746065076.595262:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240704 00000100:00100000:0.0:1746065076.595289:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4019 00000100:00100000:0.0:1746065076.595294:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27800:x1830881261240704:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065076.595409:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27800:x1830881261240704:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 115us (212us total) trans 4294975111 rc 0/0 00000100:00100000:0.0:1746065076.595417:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4019 00000100:00100000:1.0:1746065076.600405:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.601042:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261240960 00000100:00100000:0.0:1746065076.601049:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261240960 00000100:00100000:0.0:1746065076.601084:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4020 00000100:00100000:0.0:1746065076.601090:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27798:x1830881261240960:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065076.601134:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x30e:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9600/0xad6b7ddc145f94e lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x30e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb4f expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.601171:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef600/0xad6b7ddc145fa2e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065076.601180:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145f9be lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb72 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.601186:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef600/0xad6b7ddc145fa2e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065076.601208:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145f9be lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb72 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.601217:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61600/0xad6b7ddc145f9be lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb72 expref: 267 pid: 7204 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.601228:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262580224:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.601405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.601421:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241216 00000100:00100000:1.0:1746065076.601423:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241216 00000100:00100000:1.0:1746065076.601443:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11679 00000100:00100000:1.0:1746065076.601449:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261241216:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.601456:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.601466:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145fa35 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bb9c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.601547:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065076.601554:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601562:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601568:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065076.601573:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601577:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601624:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fa4a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065076.601629:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fa4a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601635:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fa4a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065076.601641:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x310:0x0]: returning size 0 00010000:00010000:1.0:1746065076.601692:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601697:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601702:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601707:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601711:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.601715:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601720:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601727:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:1.0:1746065076.601729:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.601731:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601735:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fa3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601759:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601764:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601768:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601783:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.601786:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601790:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.601796:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72d00) 00010000:00010000:1.0:1746065076.601798:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065076.602242:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065076.602318:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.602327:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc145fa43 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.602356:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc145fa35 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb9c expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.602367:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fa4a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb9c expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.602373:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065076.602375:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.602377:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:1.0:1746065076.602404:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261241216:12345-192.168.202.27@tcp:101:bash.0 Request processed in 954us (998us total) trans 4294975112 rc 0/0 00000100:00100000:1.0:1746065076.602409:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11679 00000100:00100000:0.0:1746065076.603268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.606454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.606480:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241472 00000100:00100000:1.0:1746065076.606487:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241472 00000100:00100000:1.0:1746065076.606537:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11680 00000100:00100000:1.0:1746065076.606544:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261241472:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.606560:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.606579:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fa58 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bba3 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.606620:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fa5f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065076.606630:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fa5f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.606639:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fa5f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.606720:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fa58 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x310:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bba3 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.606737:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fa5f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bba3 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.606742:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065076.606744:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065076.606746:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccdc00, rc 0) 00000100:00100000:1.0:1746065076.606813:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261241472:12345-192.168.202.27@tcp:101:bash.0 Request processed in 268us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.606819:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11680 00000001:00080000:0.0:1746065076.609475:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975113 is committed 00000004:00080000:0.0:1746065076.609487:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1546 committed 00000004:00080000:0.0:1746065076.609502:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1536 committed 00000004:00080000:0.0:1746065076.609515:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1535 committed 00000004:00080000:0.0:1746065076.609517:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1545 committed 00000100:00100000:1.0:1746065076.609714:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065076.609727:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262580352:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.609786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.609814:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262580480:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.610045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.610073:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262580608:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.610092:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.610105:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065076.610109:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262580736:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.610126:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.610148:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262580480 00000100:00100000:1.0:1746065076.610152:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262580480 00000100:00100000:1.0:1746065076.610168:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262580608 00000100:00100000:1.0:1746065076.610170:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262580608 00000100:00100000:1.0:1746065076.610181:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262580736 00000100:00100000:1.0:1746065076.610182:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262580736 00000100:00100000:1.0:1746065076.610193:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8189 00000100:00100000:1.0:1746065076.610197:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+170:3759:x1830881262580480:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065076.610257:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065076.610259:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.610261:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb atime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.610262:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:1.0:1746065076.610264:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x331:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065076.610287:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+171:3759:x1830881262580480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 90us (241us total) trans 17179872374 rc 0/0 00000100:00100000:1.0:1746065076.610294:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8189 00000100:00100000:1.0:1746065076.610308:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8190 00000100:00100000:1.0:1746065076.610313:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+137:3761:x1830881262580608:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.610365:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+138:3761:x1830881262580608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 52us (273us total) trans 21474839649 rc 0/0 00000100:00100000:1.0:1746065076.610369:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8190 00000100:00100000:1.0:1746065076.610377:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8191 00000100:00100000:1.0:1746065076.610381:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+170:3761:x1830881262580736:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.610423:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+171:3761:x1830881262580736:12345-0@lo:2:osp-syn-1-1.0 Request processed in 42us (296us total) trans 17179872375 rc 0/0 00000100:00100000:1.0:1746065076.610427:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8191 00000004:00080000:1.0:1746065076.610453:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6680/2, rc 0, transno 17179872375 00000100:00100000:1.0:1746065076.610458:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262580736:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.610465:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c525500/2, rc 0, transno 21474839649 00000100:00100000:1.0:1746065076.610467:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262580608:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065076.610476:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6300/2, rc 0, transno 17179872374 00000100:00100000:1.0:1746065076.610479:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262580480:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.611311:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bdf80/2, rc 0, transno 21474839648 00000100:00100000:1.0:1746065076.611316:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262580352:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.613384:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.615715:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.615791:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261241856 00000100:00100000:0.0:1746065076.615796:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261241856 00000100:00100000:0.0:1746065076.615817:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11682 00000100:00100000:0.0:1746065076.615822:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+262:27798:x1830881261241856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.615833:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.615844:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145fa6d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bbaa expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.615873:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145fa6d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbaa expref: 263 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.615883:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee400/0xad6b7ddc145fa6d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x30e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbaa expref: 263 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.615894:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff88009554f400) 00010000:00010000:0.0:1746065076.615896:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065076.615899:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee400, rc 0) 00000100:00100000:0.0:1746065076.615932:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+263:27798:x1830881261241856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.615936:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11682 00000100:00100000:0.0:1746065076.617567:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.619553:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.620267:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.620273:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc145fa7b lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x30e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.620279:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.620282:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc145fa7b lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x30e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.620288:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc145fa7b lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x30e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.620298:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x30e:0x0].0x0 (ffff88009554f400) 00010000:00010000:1.0:1746065076.620301:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065076.620303:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc145fa7b lrc: 1/0,0 mode: --/PW res: [0x240000403:0x30e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.620308:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc145fa7b lrc: 0/0,0 mode: --/PW res: [0x240000403:0x30e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065076.620335:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.620336:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.620338:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.623149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065076.627153:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975117 is committed 00000004:00080000:0.0:1746065076.627163:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1538 committed 00000004:00080000:0.0:1746065076.627178:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1548 committed 00000004:00080000:0.0:1746065076.627191:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1547 committed 00000004:00080000:0.0:1746065076.627193:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1537 committed 00000100:00100000:1.0:1746065076.627300:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581120:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.627357:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.627407:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065076.627413:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581248:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.627428:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262580864:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.627455:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262580992:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.627479:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262581120 00000100:00100000:0.0:1746065076.627484:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262581120 00000100:00100000:0.0:1746065076.627513:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8192 00000100:00100000:0.0:1746065076.627518:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+137:3761:x1830881262581120:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.627659:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+138:3761:x1830881262581120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 140us (302us total) trans 21474839650 rc 0/0 00000100:00100000:0.0:1746065076.627665:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8192 00000100:00100000:1.0:1746065076.627860:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065076.627891:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570e680/2, rc 0, transno 21474839650 00000100:00100000:0.0:1746065076.627893:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262581248 00000100:00100000:1.0:1746065076.627896:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581120:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.627897:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262581248 00000100:00100000:1.0:1746065076.627904:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581632:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.627913:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8193 00000100:00100000:0.0:1746065076.627917:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+138:3761:x1830881262581248:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.627923:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065076.628601:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570ca80/2, rc 0, transno 21474839651 00000100:00100000:0.0:1746065076.628602:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+139:3761:x1830881262581248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 682us (1170us total) trans 21474839651 rc 0/0 00000100:00100000:1.0:1746065076.628605:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581248:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.628608:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8193 00000100:00100000:0.0:1746065076.628625:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.628641:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262581504:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.628656:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.628668:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065076.628672:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262581376:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.628685:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.628701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.628719:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262580992 00000100:00100000:0.0:1746065076.628722:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262580992 00000100:00100000:0.0:1746065076.628736:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262581504 00000100:00100000:0.0:1746065076.628738:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262581504 00000100:00100000:0.0:1746065076.628757:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262581376 00000100:00100000:0.0:1746065076.628758:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262581376 00000100:00100000:0.0:1746065076.628767:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262580864 00000100:00100000:0.0:1746065076.628768:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262580864 00000100:00100000:0.0:1746065076.628792:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8195 00000100:00100000:0.0:1746065076.628797:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+140:3760:x1830881262580992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065076.628810:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:817 count 1 00000100:00100000:1.0:1746065076.628812:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065076.628817:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581760:0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065076.628829:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065076.628834:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065076.628836:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.628854:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262581760 00000100:00100000:1.0:1746065076.628857:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262581760 00000100:00100000:1.0:1746065076.628869:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8196 00000100:00100000:1.0:1746065076.628873:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+175:3760:x1830881262581504:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065076.628882:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:818 count 1 00002000:00010000:1.0:1746065076.628894:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065076.628898:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629075:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.629077:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.629081:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629091:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629098:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629103:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629115:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065076.629242:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+141:3760:x1830881262580992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 445us (616us total) trans 21474839652 rc 0/0 00000100:00100000:0.0:1746065076.629248:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8195 00000004:00080000:0.0:1746065076.629269:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570ea00/2, rc 0, transno 21474839652 00000100:00100000:0.0:1746065076.629273:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262580992:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065076.629408:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.629409:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.629412:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.629426:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.629432:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.629437:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.629447:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065076.629535:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+175:3760:x1830881262581504:12345-0@lo:6:osp-syn-1-1.0 Request processed in 661us (877us total) trans 17179872378 rc 0/0 00000100:00100000:1.0:1746065076.629541:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8196 00010000:00010000:0.0:1746065076.629553:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.629555:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.629559:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629559:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.629564:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065076.629565:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6e400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.629567:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629567:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.629572:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629573:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629583:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629599:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc145fa90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.629610:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.629611:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.629613:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065076.629631:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957dbb80/2, rc 0, transno 17179872378 00000100:00100000:0.0:1746065076.629635:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262581504:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065076.630524:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.630534:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc145fa97 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.630547:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.630548:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.630550:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065076.630573:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221c00/2, rc 0, transno 17179872377 00000100:00100000:1.0:1746065076.630577:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581760:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065076.630597:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957db100/2, rc 0, transno 17179872376 00000100:00100000:1.0:1746065076.630599:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262581632:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.633658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.633692:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.634019:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261242880 00000100:00100000:1.0:1746065076.634024:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261242880 00010000:00010000:1.0:1746065076.634051:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145f9e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb87 expref: 67 pid: 10219 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746065076.634070:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243008 00000100:00100000:1.0:1746065076.634071:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243008 00010000:00010000:1.0:1746065076.634079:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb2c expref: 60 pid: 10219 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.634094:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3469 00000100:00100000:1.0:1746065076.634104:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+67:2005:x1830881261242880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.634116:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.634120:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145f9e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb87 expref: 67 pid: 10219 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.634135:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145f9e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb87 expref: 67 pid: 10219 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.634156:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145f9e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x331:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb87 expref: 67 pid: 10219 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.634169:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.634171:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.634174:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fa9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.634184:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fa9e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x331:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.634208:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.634250:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261242880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 150us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.634258:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3469 00000100:00100000:0.0:1746065076.634264:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3470 00000100:00100000:0.0:1746065076.634273:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+60:2005:x1830881261243008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.634282:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.634287:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb2c expref: 60 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.634296:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb2c expref: 60 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.634308:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc145f8ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bb2c expref: 60 pid: 10219 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746065076.634315:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.634317:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.634319:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc145faa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.634325:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc145faa5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.634336:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.634341:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.634351:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881261243008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.634356:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3470 00000100:00100000:1.0:1746065076.634362:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243136 00000100:00100000:1.0:1746065076.634365:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243136 00000100:00100000:1.0:1746065076.634968:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8200 00000100:00100000:1.0:1746065076.634973:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+59:26180:x1830881261243136:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.634984:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.634993:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bbc6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065076.635012:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065076.635269:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.635271:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.635276:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbc6 expref: 60 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.635286:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbc6 expref: 60 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.635293:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2600, rc 0) 00000100:00100000:1.0:1746065076.635311:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+60:26180:x1830881261243136:12345-192.168.202.27@tcp:101:bash.0 Request processed in 338us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.635316:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8200 00000004:00080000:0.0:1746065076.635450:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570d500/2, rc 0, transno 21474839653 00000100:00100000:0.0:1746065076.635456:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262580864:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1746065076.635479:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e7800/2, rc 0, transno 17179872379 00000100:00100000:0.0:1746065076.635482:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262581376:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065076.635490:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065076.639456:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.639767:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261243264 00000100:00100000:0.0:1746065076.639789:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261243264 00000100:00100000:0.0:1746065076.639829:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8201 00000100:00100000:0.0:1746065076.639836:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+66:26180:x1830881261243264:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065076.639852:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.639868:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc145fab3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bbcd expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065076.639888:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065076.639906:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.639908:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.639914:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc145fab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbcd expref: 67 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.639926:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc145fab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbcd expref: 67 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.639935:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef400, rc 0) 00000100:00100000:0.0:1746065076.639981:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+67:26180:x1830881261243264:12345-192.168.202.27@tcp:101:bash.0 Request processed in 145us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.639986:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8201 00000100:00100000:1.0:1746065076.644843:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.645361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.645434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.649193:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.649193:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.653988:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.660023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.663248:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.663301:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261244672 00000100:00100000:1.0:1746065076.663306:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261244672 00010000:00010000:1.0:1746065076.663330:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc145fae4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x310:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbd4 expref: 268 pid: 7231 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.663350:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3472 00000100:00100000:1.0:1746065076.663356:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+268:2005:x1830881261244672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.663366:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.663372:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc145fae4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x310:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbd4 expref: 268 pid: 7231 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.663385:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc145fae4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x310:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbd4 expref: 268 pid: 7231 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.663404:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc145fae4 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x310:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbd4 expref: 268 pid: 7231 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.663437:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065076.663441:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145faf9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x310:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.663448:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145faf9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.663454:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145faf9 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x310:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065076.663467:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.663526:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+267:2005:x1830881261244672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 170us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.663531:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3472 00000100:00100000:0.0:1746065076.663917:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.666767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.667262:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.667311:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245184 00000100:00100000:1.0:1746065076.667315:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245184 00000100:00100000:1.0:1746065076.667350:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11690 00000100:00100000:1.0:1746065076.667356:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27801:x1830881261245184:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.667364:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.667372:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145fb31 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bbe9 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.667404:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145fb31 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbe9 expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.667413:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145fb31 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbe9 expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.667930:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065076.667933:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065076.667935:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:1.0:1746065076.667962:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27801:x1830881261245184:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 606us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.667967:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11690 00000100:00100000:0.0:1746065076.672497:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.672551:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245440 00000100:00100000:1.0:1746065076.672559:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245440 00000100:00100000:1.0:1746065076.672623:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11691 00000100:00100000:1.0:1746065076.672630:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27801:x1830881261245440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.672649:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.672662:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fb38 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bbf0 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.672751:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fb3f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.672761:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fb3f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x310:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.674039:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fb3f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x310:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065076.674063:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x310:0x0]: returning size 5 00010000:00010000:1.0:1746065076.674167:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fb38 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x310:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbf0 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.674186:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3800/0xad6b7ddc145fb3f lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x310:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbf0 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.674192:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065076.674195:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065076.674198:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:1.0:1746065076.674254:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27801:x1830881261245440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1623us (1763us total) trans 4294975123 rc 0/0 00000100:00100000:1.0:1746065076.674261:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11691 00000100:00100000:0.0:1746065076.676259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.677873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.681575:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.682598:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261245824 00000100:00100000:1.0:1746065076.682604:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261245824 00000100:00100000:1.0:1746065076.682653:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11693 00000100:00100000:1.0:1746065076.682659:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27803:x1830881261245824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.682676:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.682691:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fb69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bbfe expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.682742:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.682752:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682760:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682768:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.682788:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682793:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682827:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682832:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682837:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682842:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682847:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.682850:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682855:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682863:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561200) 00010000:00010000:1.0:1746065076.682866:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.682868:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682872:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fb70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682894:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682898:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682902:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682906:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccdc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.682908:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682912:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682918:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065076.682919:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.682921:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.682925:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fb77 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.683121:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fb69 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbfe expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.683128:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc145fb69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbfe expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.683140:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2800, rc 0) 00000100:00100000:1.0:1746065076.683380:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27803:x1830881261245824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 719us (1810us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.683386:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11693 00000100:00100000:0.0:1746065076.688632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.688797:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246080 00000100:00100000:1.0:1746065076.688801:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246080 00000100:00100000:1.0:1746065076.688837:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11694 00000100:00100000:1.0:1746065076.688843:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27803:x1830881261246080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.688854:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.688871:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145fb7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc05 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.688917:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fb85 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.688927:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fb85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.688936:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fb85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065076.688969:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065076.688973:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065076.688996:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3600/0xad6b7ddc145fb7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc05 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.689008:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fb85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc05 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.689015:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.689017:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065076.689020:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a24c00, rc 0) 00000100:00100000:1.0:1746065076.689058:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27803:x1830881261246080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 215us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.689064:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11694 00000100:00100000:0.0:1746065076.692210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.693841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.693943:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246336 00000100:00100000:1.0:1746065076.693947:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246336 00010000:00010000:1.0:1746065076.693967:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbc6 expref: 64 pid: 12258 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.693995:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3473 00000100:00100000:1.0:1746065076.694000:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+64:2007:x1830881261246336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.694008:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065076.694020:0:9565:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x332:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065076.694023:0:9565:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x332:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065076.694027:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbc6 expref: 64 pid: 12258 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.694036:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbc6 expref: 64 pid: 12258 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.694051:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc145faac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x332:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbc6 expref: 64 pid: 12258 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.694061:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.694063:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.694066:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2b8600/0xad6b7ddc145fb62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.694073:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2b8600/0xad6b7ddc145fb62 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.694089:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.694108:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+63:2007:x1830881261246336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.694113:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3473 00000100:00100000:0.0:1746065076.694591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.694648:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246592 00000100:00100000:1.0:1746065076.694652:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246592 00000100:00100000:1.0:1746065076.694673:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11696 00000100:00100000:1.0:1746065076.694678:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27803:x1830881261246592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.694688:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.694689:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065076.694699:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fb85 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc05 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.694708:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.694714:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.694721:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fba1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc13 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.694794:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.694800:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.694806:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.694813:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fbaf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.694819:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fbaf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.694823:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fbaf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695219:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145fbb6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.695226:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145fbb6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695232:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145fbb6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065076.695240:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x312:0x0]: returning size 0 00010000:00010000:1.0:1746065076.695261:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695266:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695270:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695275:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695279:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c5c5400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.695282:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695286:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695295:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561600) 00010000:00010000:1.0:1746065076.695297:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.695299:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695303:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5400/0xad6b7ddc145fba8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065076.695311:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed6680 reply state ffff88009a8b8000 transno 4294975124 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fbaf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695317:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fbaf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.695322:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065076.695323:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065076.695325:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065076.695342:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fba1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc13 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.695353:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc145fbb6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc13 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.695358:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561500) 00010000:00010000:1.0:1746065076.695360:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.695362:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019d800, rc 0) 00000100:00100000:1.0:1746065076.695400:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27803:x1830881261246592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 722us (818us total) trans 4294975124 rc 0/0 00000100:00100000:1.0:1746065076.695405:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11696 00000100:00100000:0.0:1746065076.697619:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.697686:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261246848 00000100:00100000:1.0:1746065076.697692:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261246848 00000100:00100000:1.0:1746065076.697735:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11697 00000100:00100000:1.0:1746065076.697741:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27801:x1830881261246848:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065076.697801:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.697820:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc145fb31 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bbe9 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.697832:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065076.697836:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.697854:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fbc4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.697862:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fbc4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.697869:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fbc4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:1.0:1746065076.698016:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2286, 88 off189704 00000004:00080000:1.0:1746065076.698021:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672716247471ns, next at 673314574413ns, rc = 0 00000040:00080000:1.0:1746065076.698054:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2290, 88 off190160 00000004:00080000:1.0:1746065076.698057:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672716283513ns, next at 673314596215ns, rc = 0 00000040:00080000:1.0:1746065076.698082:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2291, 88 off190248 00000004:00080000:1.0:1746065076.698085:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672716311292ns, next at 673314596215ns, rc = 0 00000040:00080000:1.0:1746065076.698093:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2287, 88 off189792 00000004:00080000:1.0:1746065076.698096:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672716322167ns, next at 673314574413ns, rc = 0 00000100:00100000:1.0:1746065076.698520:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065076.700412:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975125 is committed 00000004:00080000:0.0:1746065076.700421:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1540 committed 00000004:00080000:0.0:1746065076.700439:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1550 committed 00000004:00080000:0.0:1746065076.700444:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1549 committed 00000004:00080000:0.0:1746065076.700445:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1539 committed 00000004:00010000:1.0:1746065076.700532:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed5c00 reply state ffff880130147800 transno 4294975125 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fbc4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.700549:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fbc4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.700556:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065076.700558:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065076.700561:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065076.700644:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065076.700656:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27801:x1830881261246848:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 2912us (3040us total) trans 4294975125 rc 0/0 00000100:00100000:1.0:1746065076.700662:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11697 00000100:00100000:0.0:1746065076.700768:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262582656:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.700818:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.700839:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065076.700843:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262582784:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.700856:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065076.700875:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262583040 00000100:00100000:0.0:1746065076.700877:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262583040 00000100:00100000:0.0:1746065076.700897:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8203 00000100:00100000:0.0:1746065076.700901:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+142:3759:x1830881262582656:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.700995:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+143:3759:x1830881262582656:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (177us total) trans 21474839656 rc 0/0 00000100:00100000:0.0:1746065076.701002:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8203 00000100:00100000:0.0:1746065076.701087:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262582912 00000100:00100000:0.0:1746065076.701089:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262582912 00000100:00100000:0.0:1746065076.701101:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8206 00000100:00100000:0.0:1746065076.701104:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+176:3762:x1830881262582912:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065076.701147:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x333:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065076.701150:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x333:0x0] updating lvb mtime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.701152:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x333:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065076.701154:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x333:0x0] updating lvb ctime from disk: 1746065076 -> 1746065076 00002000:00010000:0.0:1746065076.701155:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x333:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065076.701188:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+177:3762:x1830881262582912:12345-0@lo:2:osp-syn-1-1.0 Request processed in 82us (109us total) trans 17179872382 rc 0/0 00000100:00100000:0.0:1746065076.701193:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8206 00000004:00080000:0.0:1746065076.701212:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc3800/2, rc 0, transno 21474839657 00000100:00100000:0.0:1746065076.701216:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262582784:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065076.701222:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4e00/2, rc 0, transno 21474839656 00000100:00100000:0.0:1746065076.701224:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262582656:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.701658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.702864:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.704547:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.706744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.707197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.707212:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248000 00000100:00100000:0.0:1746065076.707215:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248000 00000100:00100000:0.0:1746065076.707234:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4025 00000100:00100000:0.0:1746065076.707239:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+265:27803:x1830881261248000:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065076.707354:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27803:x1830881261248000:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 115us (156us total) trans 4294975128 rc 0/0 00000100:00100000:0.0:1746065076.707360:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4025 00000100:00100000:0.0:1746065076.712339:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.712375:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248384 00000100:00100000:1.0:1746065076.712384:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248384 00000100:00100000:1.0:1746065076.712427:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11701 00000100:00100000:1.0:1746065076.712433:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:26180:x1830881261248384:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.712452:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.712466:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856c00/0xad6b7ddc145fbf5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc36 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.712573:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.712592:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712601:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712611:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.712616:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712622:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712666:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145fc11 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.712672:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145fc11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712676:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145fc11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065076.712683:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x312:0x0]: returning size 0 00010000:00010000:1.0:1746065076.712740:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712747:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712752:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712757:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712762:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.712765:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712770:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712802:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561500) 00010000:00010000:1.0:1746065076.712804:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.712807:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712811:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc145fc03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712822:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712827:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712831:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712838:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.712840:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712844:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712849:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:1.0:1746065076.712851:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.712852:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712856:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc145fc0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.712893:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856c00/0xad6b7ddc145fbf5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc36 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.712904:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145fc11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc36 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.712910:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.712912:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.712914:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857000, rc 0) 00000100:00100000:1.0:1746065076.712934:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261248384:12345-192.168.202.27@tcp:101:bash.0 Request processed in 501us (603us total) trans 4294975129 rc 0/0 00000100:00100000:1.0:1746065076.712939:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11701 00000100:00100000:0.0:1746065076.714197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.715592:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.715648:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261248512 00000100:00100000:1.0:1746065076.715654:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261248512 00000100:00100000:1.0:1746065076.715879:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11702 00000100:00100000:1.0:1746065076.715885:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261248512:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.715898:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.715911:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fc1f lrc: 2/0,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc3d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.715936:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145fc26 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.715947:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145fc26 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.715955:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145fc26 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.716037:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc145fc1f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc3d expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.716049:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145fc26 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc3d expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.716059:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.716061:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065076.716064:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857e00, rc 0) 00000100:00100000:1.0:1746065076.716082:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261248512:12345-192.168.202.27@tcp:101:bash.0 Request processed in 198us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.716087:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11702 00000100:00100000:0.0:1746065076.718288:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.718333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.718347:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261249024 00000100:00100000:1.0:1746065076.718354:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261249024 00000100:00100000:1.0:1746065076.718402:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11703 00000100:00100000:1.0:1746065076.718409:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261249024:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065076.718444:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.718463:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc145fc11 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc36 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.718476:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.718480:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.718624:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.718633:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.718640:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:1.0:1746065076.718680:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975130 00000004:00010000:1.0:1746065076.718698:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009835ad80 reply state ffff880092911000 transno 4294975131 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.718709:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.718713:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.718716:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065076.718718:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065076.718758:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261249024:12345-192.168.202.27@tcp:36:bash.0 Request processed in 350us (474us total) trans 4294975131 rc 0/0 00000100:00100000:1.0:1746065076.718763:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11703 00000020:00080000:1.0:1746065076.718766:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065076.721732:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.722335:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.726243:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.726863:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.727109:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.727146:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261249792 00000100:00100000:1.0:1746065076.727150:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261249792 00000100:00100000:1.0:1746065076.727176:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11706 00000100:00100000:1.0:1746065076.727182:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261249792:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065076.727195:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.727197:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065076.727217:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc34 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x312:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc44 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.727243:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.727247:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.727255:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc145fc42 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc4b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.727294:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fc49 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.727303:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fc49 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.727310:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fc49 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:1.0:1746065076.727479:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2292, 88 off190336 00000004:00080000:1.0:1746065076.727485:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672745710581ns, next at 673314596215ns, rc = 0 00000040:00080000:1.0:1746065076.727505:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2288, 88 off189880 00000004:00080000:1.0:1746065076.727508:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672745734550ns, next at 673314574413ns, rc = 0 00000040:00080000:1.0:1746065076.727543:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2289, 88 off189968 00000004:00080000:1.0:1746065076.727546:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672745772561ns, next at 673314574413ns, rc = 0 00000040:00080000:1.0:1746065076.727660:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2293, 88 off190424 00000004:00080000:1.0:1746065076.727665:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672745891391ns, next at 673314596215ns, rc = 0 00010000:00010000:0.0:1746065076.729669:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729679:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729684:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729688:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccdc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.729692:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729698:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729709:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:0.0:1746065076.729711:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.729715:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729719:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc145fc2d lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x312:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.729964:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.729970:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.729974:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.729978:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.729980:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.729984:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.729991:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065076.729993:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.729996:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065076.729999:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fc3b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x310:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065076.730059:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.730500:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262583424:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.730522:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.730595:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262583552:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.730613:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065076.730650:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fc49 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x312:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc4b expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.730656:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.730658:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065076.730666:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc145fc42 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x312:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc4b expref: 265 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065076.730677:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fc49 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x312:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc4b expref: 264 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.730698:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.730700:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065076.730702:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:1.0:1746065076.730722:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:26180:x1830881261249792:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3540us (3612us total) trans 4294975133 rc 0/0 00000100:00100000:1.0:1746065076.730728:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11706 00000100:00100000:0.0:1746065076.731169:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8213 00000100:00100000:0.0:1746065076.731176:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+178:3759:x1830881262583296:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.731225:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+179:3759:x1830881262583296:12345-0@lo:2:osp-syn-1-1.0 Request processed in 51us (271us total) trans 17179872384 rc 0/0 00000100:00100000:0.0:1746065076.731231:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8213 00000004:00080000:1.0:1746065076.731273:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abb8700/2, rc 0, transno 21474839659 00000100:00100000:1.0:1746065076.731277:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262583552:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.731283:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065076.731287:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262583680:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.731304:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065076.731326:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc2300/2, rc 0, transno 17179872383 00000100:00100000:1.0:1746065076.731329:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262583424:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.731338:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262583680 00000100:00100000:1.0:1746065076.731340:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262583680 00000100:00100000:1.0:1746065076.731354:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8214 00000100:00100000:1.0:1746065076.731357:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+145:3761:x1830881262583680:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.731413:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+146:3761:x1830881262583680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 54us (107us total) trans 21474839660 rc 0/0 00000100:00100000:1.0:1746065076.731417:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8214 00000004:00080000:1.0:1746065076.731436:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abbbb80/2, rc 0, transno 21474839660 00000100:00100000:1.0:1746065076.731439:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262583680:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.734977:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261250176 00000100:00100000:1.0:1746065076.734982:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261250176 00010000:00010000:1.0:1746065076.735009:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fbe0 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc21 expref: 264 pid: 7203 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.735038:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3475 00000100:00100000:1.0:1746065076.735044:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+264:2005:x1830881261250176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.735054:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.735059:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fbe0 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc21 expref: 264 pid: 7203 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.735227:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fbe0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc21 expref: 264 pid: 7203 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.735246:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fbe0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc21 expref: 264 pid: 7203 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.735258:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097b72500) 00010000:00010000:1.0:1746065076.735262:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc145fc50 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.735269:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc145fc50 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065076.735274:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc145fc50 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065076.735274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065076.735454:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.735690:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+263:2005:x1830881261250176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 645us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.735696:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3475 00000100:00100000:0.0:1746065076.740532:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.740574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.741175:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1220 00000100:00100000:1.0:1746065076.741182:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+65:2005:x1830881261250688:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065076.741320:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x334:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065076.741323:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x334:0x0] updating lvb mtime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.741325:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x334:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.741327:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x334:0x0] updating lvb ctime from disk: 0 -> 1746065076 00002000:00010000:1.0:1746065076.741329:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x334:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065076.741372:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261250688:12345-192.168.202.27@tcp:10:bash.0 Request processed in 191us (798us total) trans 21474839661 rc 0/0 00000100:00100000:1.0:1746065076.741381:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1220 00002000:00010000:1.0:1746065076.741383:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/820 (0->18446744073709551615) 00002000:00100000:1.0:1746065076.741385:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529f80 with x1830881261250688 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065076.741388:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c529f80. 00000001:00080000:0.0:1746065076.745455:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975134 is committed 00000004:00080000:0.0:1746065076.745468:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1544 committed 00000004:00080000:0.0:1746065076.745498:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1554 committed 00000004:00080000:0.0:1746065076.745522:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1553 committed 00000004:00080000:0.0:1746065076.745525:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1543 committed 00000100:00100000:1.0:1746065076.745841:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ed08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262583808:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.745890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.745951:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065076.745959:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ed09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262583936:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065076.745986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065076.746883:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed09180/2, rc 0, transno 21474839663 00000100:00100000:1.0:1746065076.746889:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262583936:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065076.746900:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed08700/2, rc 0, transno 21474839662 00000100:00100000:1.0:1746065076.746903:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262583808:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.755030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.757963:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251072 00000100:00100000:1.0:1746065076.757976:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251072 00000100:00100000:1.0:1746065076.758052:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11707 00000100:00100000:1.0:1746065076.758062:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+262:27801:x1830881261251072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.758088:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.758108:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145fc65 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x310:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc60 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.758170:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145fc65 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc60 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.758184:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7000/0xad6b7ddc145fc65 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x310:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc60 expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.758201:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x310:0x0].0x0 (ffff880097e34000) 00010000:00010000:1.0:1746065076.758205:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065076.758208:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7000, rc 0) 00000100:00100000:1.0:1746065076.758286:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+263:27801:x1830881261251072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 223us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.758292:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11707 00000100:00100000:1.0:1746065076.758623:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.759163:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251200 00000100:00100000:0.0:1746065076.759170:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251200 00000100:00100000:0.0:1746065076.759215:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11708 00000100:00100000:0.0:1746065076.759223:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+263:27804:x1830881261251200:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1746065076.759238:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.759252:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fc6c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc67 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.759309:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.759319:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759327:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759340:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.759350:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759355:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759433:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065076.759442:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759448:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065076.759484:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x312:0x0]: returning size 5 00000004:00200000:0.0:1746065076.759488:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065076.759505:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759514:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759522:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759527:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759532:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759537:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759545:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6e400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.759549:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759554:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759565:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccd00) 00010000:00010000:0.0:1746065076.759567:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.759570:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759575:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759728:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759734:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759738:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759742:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.759745:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759749:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759757:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bccc00) 00010000:00010000:0.0:1746065076.759759:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.759762:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759765:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.759809:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145fc6c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc67 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.759825:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc67 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.759831:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:0.0:1746065076.759832:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065076.759835:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a529400, rc 0) 00000100:00100000:0.0:1746065076.759876:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+264:27804:x1830881261251200:12345-192.168.202.27@tcp:101:rm.0 Request processed in 653us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.759883:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11708 00000100:00100000:0.0:1746065076.765633:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.765708:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261251712 00000100:00100000:1.0:1746065076.765718:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261251712 00000100:00100000:1.0:1746065076.765801:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11709 00000100:00100000:1.0:1746065076.765811:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27804:x1830881261251712:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065076.765865:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065076.765894:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fc49 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x312:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc4b expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.765946:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc145fc81 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc67 expref: 264 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.765961:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc145fc26 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x312:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc3d expref: 263 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.765973:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065076.765984:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065076.766010:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.766022:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766030:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766041:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc96 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.766046:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766052:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766133:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.766142:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766149:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:1.0:1746065076.766375:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2298, 64 off190792 00000040:00080000:1.0:1746065076.766400:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2294, 64 off190336 00000040:00080000:1.0:1746065076.766412:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2295, 64 off190400 00000040:00080000:1.0:1746065076.766422:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2299, 64 off190856 00010000:00010000:1.0:1746065076.766472:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x312:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.766482:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766488:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766494:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766498:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766502:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766517:0:7204:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065076.766536:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766540:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766545:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766550:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.766553:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766558:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766567:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880097e34f00) 00010000:00010000:1.0:1746065076.766569:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065076.766572:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766576:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc145fc9d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x312:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766695:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766702:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766706:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766710:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766714:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.766717:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766721:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766729:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:1.0:1746065076.766732:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.766734:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766738:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc145fc8f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065076.766750:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834d180 reply state ffff88009ae65000 transno 4294975137 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766758:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6e400/0xad6b7ddc145fc96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.766762:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:1.0:1746065076.766764:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065076.766766:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065076.766881:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27804:x1830881261251712:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1069us (1252us total) trans 4294975137 rc 0/0 00000100:00100000:1.0:1746065076.766887:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11709 00010000:00010000:0.0:1746065076.767012:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065076.767018:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.767024:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065076.767026:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.767031:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.767039:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x312:0x0].0x0 (ffff880097e34f00) 00010000:00010000:0.0:1746065076.767041:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065076.767043:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.767047:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fca4 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x312:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.767062:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.767064:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.767065:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.771417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.778850:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.787290:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.791348:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.791920:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261252352 00000100:00100000:1.0:1746065076.791929:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261252352 00000100:00100000:1.0:1746065076.791987:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11713 00000100:00100000:1.0:1746065076.791994:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27806:x1830881261252352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.792012:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.792031:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fcea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc83 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.792088:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.792098:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792107:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792117:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065076.792122:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792128:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792166:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792171:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792175:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792180:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792184:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.792187:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792192:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792202:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34f00) 00010000:00010000:1.0:1746065076.792204:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.792207:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792211:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc145fcf1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792241:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792245:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792250:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792254:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.792256:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792261:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792266:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:1.0:1746065076.792268:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.792270:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792274:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc145fcf8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.792297:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fcea lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc83 expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.792303:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc145fcea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc83 expref: 265 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.792313:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:1.0:1746065076.792372:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27806:x1830881261252352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 377us (1031us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.792378:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11713 00000100:00100000:0.0:1746065076.798312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.800896:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261252736 00000100:00100000:1.0:1746065076.800906:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261252736 00000100:00100000:0.0:1746065076.801529:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11715 00000100:00100000:0.0:1746065076.801538:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27807:x1830881261252736:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.801553:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.801569:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145fd0d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc91 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.801644:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.801655:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801664:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801673:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.801678:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801684:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801710:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801715:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801719:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801723:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801728:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abaca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.801731:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801736:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801743:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72300) 00010000:00010000:0.0:1746065076.801745:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.801749:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801753:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145fd14 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801799:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801805:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801811:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801815:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.801817:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801822:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801828:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:0.0:1746065076.801830:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.801832:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801836:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fd1b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.801857:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145fd0d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc91 expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.801863:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc145fd0d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc91 expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.801869:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abace00, rc 0) 00000100:00100000:0.0:1746065076.801937:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27807:x1830881261252736:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 401us (2542us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065076.801943:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11715 00000100:00100000:0.0:1746065076.813910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.814285:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11717 00000100:00100000:0.0:1746065076.814295:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27806:x1830881261253248:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.814314:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.814965:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc145fd45 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bc9f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.815057:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.815069:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 268 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.815075:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.815103:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 268 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.815113:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 268 pid: 7205 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.815125:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f2ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262584320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065076.816318:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d3169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.818475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.819763:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f2ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262584320:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.819796:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065076.822432:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261253632 00000100:00100000:1.0:1746065076.822439:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261253632 00010000:00010000:1.0:1746065076.822470:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 270 pid: 7205 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.822502:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3476 00000100:00100000:1.0:1746065076.822509:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+270:2005:x1830881261253632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.822522:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.822527:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 270 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.822537:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 270 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.822556:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc145fd37 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc98 expref: 270 pid: 7205 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746065076.826426:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34a00) 00010000:00010000:1.0:1746065076.826435:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.826445:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.826451:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065076.826483:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065076.826557:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+269:2005:x1830881261253632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4044us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.826565:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3476 00010000:00010000:0.0:1746065076.826631:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.826637:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145fd4c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065076.826659:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x314:0x0]: returning size 0 00000100:00100000:0.0:1746065076.838749:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.839339:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.845090:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.850175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.851257:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261254912 00000100:00100000:1.0:1746065076.851265:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261254912 00000100:00100000:1.0:1746065076.851299:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4031 00000100:00100000:1.0:1746065076.851305:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27808:x1830881261254912:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.853412:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27808:x1830881261254912:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2105us (2793us total) trans 4294975143 rc 0/0 00000100:00100000:1.0:1746065076.853419:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4031 00000100:00100000:0.0:1746065076.858880:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.858966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.859006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.862511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.863038:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.863612:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11724 00000100:00100000:1.0:1746065076.863618:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27808:x1830881261255808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.863628:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.863636:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145fdd1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bcd0 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.863676:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc145fdd8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065076.863683:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc145fdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.863689:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc145fdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065076.863706:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x314:0x0]: returning size 0 00000004:00200000:1.0:1746065076.863710:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065076.863719:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc145fdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065076.863733:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc145fdd1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x314:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcd0 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.863746:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc145fdd8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcd0 expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.863751:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34f00) 00010000:00010000:1.0:1746065076.863753:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065076.863755:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065076.863796:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27808:x1830881261255808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 178us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.863802:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11724 00000100:00100000:0.0:1746065076.866877:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.869987:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256320 00000100:00100000:0.0:1746065076.869993:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256320 00000100:00100000:0.0:1746065076.870478:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4032 00000100:00100000:0.0:1746065076.870486:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27808:x1830881261256320:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065076.871839:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27808:x1830881261256320:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1354us (2261us total) trans 4294975149 rc 0/0 00000100:00100000:0.0:1746065076.871845:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4032 00000100:00100000:1.0:1746065076.875201:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256576 00000100:00100000:1.0:1746065076.875207:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256576 00000100:00100000:1.0:1746065076.875241:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261256832 00000100:00100000:1.0:1746065076.875242:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261256832 00000100:00100000:1.0:1746065076.875253:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4033 00000100:00100000:1.0:1746065076.875258:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27808:x1830881261256576:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065076.875417:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4034 00000100:00100000:0.0:1746065076.875423:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261256832:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065076.875807:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27808:x1830881261256576:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 547us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.875813:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4033 00000100:00100000:0.0:1746065076.875870:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261256832:12345-192.168.202.27@tcp:35:bash.0 Request processed in 447us (747us total) trans 4294975150 rc 0/0 00000100:00100000:0.0:1746065076.875875:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4034 00000100:00100000:0.0:1746065076.879441:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.887158:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.887199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065076.888840:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc145fdd8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcd0 expref: 284 pid: 7203 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.888965:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262584448:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065076.888980:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.888987:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.888992:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:0.0:1746065076.889146:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2296, 88 off190488 00000004:00080000:0.0:1746065076.889151:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672907376612ns, next at 673314574413ns, rc = 0 00000040:00080000:0.0:1746065076.889171:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2300, 88 off190944 00000004:00080000:0.0:1746065076.889174:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672907400432ns, next at 673314596215ns, rc = 0 00000040:00080000:0.0:1746065076.889185:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2301, 88 off191032 00000004:00080000:0.0:1746065076.889188:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 672907414612ns, next at 673314596215ns, rc = 0 00000040:00080000:0.0:1746065076.889195:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2297, 88 off190576 00000004:00080000:0.0:1746065076.889198:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 672907424475ns, next at 673314574413ns, rc = 0 00000100:00100000:1.0:1746065076.891631:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.891741:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261257600 00000100:00100000:0.0:1746065076.891749:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261257600 00000100:00100000:0.0:1746065076.891813:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11728 00000100:00100000:0.0:1746065076.891820:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27809:x1830881261257600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.891835:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.891850:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fe33 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bcec expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.891915:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.891925:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.891929:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 4/1,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.891942:0:7204:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.891949:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.898305:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcde expref: 268 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.898313:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34f00) 00010000:00010000:0.0:1746065076.898316:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065076.898318:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.898326:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.898330:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.898353:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc145fe02 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcde expref: 268 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065076.898364:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358600/0xad6b7ddc145fe09 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x314:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcde expref: 267 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.898388:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.898392:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065076.898422:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x314:0x0]: returning size 2 00000004:00200000:0.0:1746065076.898425:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065076.898437:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.898457:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5200/0xad6b7ddc145fe33 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x314:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcec expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.898466:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc145fe3a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcec expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.898471:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34f00) 00010000:00010000:0.0:1746065076.898473:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065076.898475:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61800, rc 0) 00000100:00100000:0.0:1746065076.898497:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27809:x1830881261257600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6678us (6872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.898503:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11728 00010000:00010000:0.0:1746065076.898521:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358600, rc 0) 00000100:00100000:0.0:1746065076.898537:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+266:26180:x1830881261257088:12345-192.168.202.27@tcp:101:bash.0 Request processed in 17660us (19104us total) trans 4294975152 rc 0/0 00000100:00100000:0.0:1746065076.898542:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11726 00010000:00010000:1.0:1746065076.903935:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.903940:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.903947:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.903949:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.903955:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145fe5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.903967:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145fe5d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.903973:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc145fe5d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.903991:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.903992:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.903993:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065076.904133:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85c000/2, rc 0, transno 21474839665 00000100:00100000:0.0:1746065076.904139:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262584704:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.904146:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c53c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262585216:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.904171:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065076.904953:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c53c700/2, rc 0, transno 21474839666 00000100:00100000:0.0:1746065076.904957:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c53c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262585216:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065076.904962:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262585728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065076.904978:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065076.905016:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262585728 00000100:00100000:1.0:1746065076.905019:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262585728 00000100:00100000:1.0:1746065076.905163:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8231 00000100:00100000:1.0:1746065076.905169:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+185:3760:x1830881262585728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065076.905178:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:822 count 1 00002000:00010000:1.0:1746065076.905189:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065076.905194:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.905205:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.905207:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.905209:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.905216:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.905222:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.905228:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.905237:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065076.905322:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+186:3760:x1830881262585728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 153us (342us total) trans 17179872391 rc 0/0 00000100:00100000:1.0:1746065076.905327:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8231 00000100:00100000:0.0:1746065076.906876:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065076.906896:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc145fc5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x334:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc59 expref: 66 pid: 12260 timeout: 772 lvb_type: 0 00000100:00100000:0.0:1746065076.906908:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098671c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262586112:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065076.906921:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.906929:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.906934:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.906941:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.906946:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.906961:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065076.907091:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+152:3761:x1830881262584832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9182us (9719us total) trans 21474839667 rc 0/0 00000100:00100000:0.0:1746065076.907098:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8224 00010000:00010000:1.0:1746065076.907263:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065076.907270:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907276:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.907280:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907287:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907299:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907305:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc145fe6b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907316:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065076.907318:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907323:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dca00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065076.907325:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907331:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907338:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907343:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dca00/0xad6b7ddc145fe4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907352:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.907354:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065076.907355:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065076.907373:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098359f80/2, rc 0, transno 17179872391 00000100:00100000:1.0:1746065076.907377:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262585728:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065076.907390:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262585088 00000100:00100000:1.0:1746065076.907628:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262585088 00000100:00100000:1.0:1746065076.907725:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8232 00000100:00100000:1.0:1746065076.907730:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+152:3759:x1830881262585088:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065076.907811:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x336:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065076.907814:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x336:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.907816:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x336:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.907818:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x336:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065076.907819:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x336:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065076.907839:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+153:3759:x1830881262585088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 108us (478us total) trans 21474839669 rc 0/0 00000100:00100000:1.0:1746065076.907844:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8232 00000100:00100000:1.0:1746065076.907856:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8233 00000100:00100000:1.0:1746065076.907860:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+186:3759:x1830881262585600:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065076.907872:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:821 count 1 00010000:00010000:1.0:1746065076.907882:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f46a00/0xad6b7ddc145fe79 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907893:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46200/0xad6b7ddc145fc57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc52 expref: 69 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907900:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065076.907902:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065076.907904:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46a00/0xad6b7ddc145fe79 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907923:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f46200/0xad6b7ddc145fc57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc52 expref: 69 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.907932:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f46200/0xad6b7ddc145fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc52 expref: 69 pid: 12258 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.907941:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262586496:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065076.907979:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.911155:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258112 00000100:00100000:0.0:1746065076.911159:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258112 00000100:00100000:0.0:1746065076.911180:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8234 00000100:00100000:0.0:1746065076.911185:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+65:26180:x1830881261258112:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065076.911197:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.911208:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc145fe80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x336:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bcfa expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.911229:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47800/0xad6b7ddc145fd7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x336:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcb4 expref: 66 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065076.911235:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.911236:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065076.911239:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc145fe80 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x336:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcfa expref: 66 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.911260:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47800/0xad6b7ddc145fd7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x336:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcb4 expref: 66 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065076.911268:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f47800/0xad6b7ddc145fd7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x336:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcb4 expref: 66 pid: 9550 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746065076.911282:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262586624:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065076.911744:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065076.912066:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258496 00000100:00100000:1.0:1746065076.912069:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258496 00000100:00100000:1.0:1746065076.912095:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4035 00000100:00100000:1.0:1746065076.912099:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27809:x1830881261258496:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.912201:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27809:x1830881261258496:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 101us (702us total) trans 4294975153 rc 0/0 00000100:00100000:1.0:1746065076.912207:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4035 00010000:00010000:0.0:1746065076.912464:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065076.912470:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fe64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.912476:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065076.912480:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fe64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.912486:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fe64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.912496:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fe64 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.912502:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ccd400/0xad6b7ddc145fe64 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.912513:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.912515:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065076.912516:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065076.913184:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258624 00000100:00100000:0.0:1746065076.913188:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258624 00000100:00100000:0.0:1746065076.913210:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 535 00000100:00100000:0.0:1746065076.913215:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+265:2007:x1830881261258624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065076.913222:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065076.913233:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fe72 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x314:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcf3 expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.913244:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34f00) 00010000:00010000:0.0:1746065076.913247:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065076.913277:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+264:2007:x1830881261258624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 61us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.913282:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 535 00000100:00100000:1.0:1746065076.913749:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262586496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065076.913765:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f46a00/0xad6b7ddc145fe79 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065076.915922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.915992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.916243:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258880 00000100:00100000:1.0:1746065076.916250:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258880 00010000:00010000:1.0:1746065076.916278:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47800/0xad6b7ddc145fd7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x336:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcb4 expref: 67 pid: 9550 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746065076.916298:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261258752 00000100:00100000:1.0:1746065076.916301:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261258752 00010000:00010000:1.0:1746065076.916310:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46200/0xad6b7ddc145fc57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bc52 expref: 69 pid: 12258 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746065076.916329:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3481 00000100:00100000:1.0:1746065076.916335:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+67:2005:x1830881261258880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065076.916345:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065076.916349:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f47800/0xad6b7ddc145fd7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcb4 expref: 67 pid: 9550 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.916357:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f47800/0xad6b7ddc145fd7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcb4 expref: 67 pid: 9550 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746065076.916380:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.916382:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065076.916388:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc145fe80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcfa expref: 67 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.916395:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc145fe80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcfa expref: 67 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.916423:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc145fe80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x336:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bcfa expref: 67 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065076.916434:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881262586752:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065076.917617:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065076.918429:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259136 00000100:00100000:0.0:1746065076.918434:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259136 00000100:00100000:0.0:1746065076.918468:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11730 00000100:00100000:0.0:1746065076.918473:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+264:27809:x1830881261259136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065076.918489:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065076.918502:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc145fe87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bd01 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.918561:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.918570:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918577:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918597:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.918603:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918608:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918683:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fe9c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065076.918690:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fe9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918695:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fe9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065076.918703:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x314:0x0]: returning size 2 00010000:00010000:0.0:1746065076.918750:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918756:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918759:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918763:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918767:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.918770:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918800:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918811:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:0.0:1746065076.918813:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.918816:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918821:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc145fe8e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918829:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918834:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918838:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918841:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.918843:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918847:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918851:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bccd00) 00010000:00010000:0.0:1746065076.918853:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.918854:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918859:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145fe95 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065076.918887:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc145fe87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd01 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.918898:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145fe9c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x314:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd01 expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065076.918904:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34f00) 00010000:00010000:0.0:1746065076.918906:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065076.918908:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2600, rc 0) 00000100:00100000:0.0:1746065076.918947:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27809:x1830881261259136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 472us (685us total) trans 4294975154 rc 0/0 00000100:00100000:0.0:1746065076.918952:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11730 00000100:00100000:0.0:1746065076.923427:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.923755:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.923831:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259520 00000100:00100000:1.0:1746065076.923836:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259520 00000100:00100000:1.0:1746065076.923856:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4036 00000100:00100000:1.0:1746065076.923861:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+266:27809:x1830881261259520:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065076.923998:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+267:27809:x1830881261259520:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 135us (241us total) trans 4294975155 rc 0/0 00000100:00100000:1.0:1746065076.924003:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4036 00000100:00100000:1.0:1746065076.933179:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.933218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.933259:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.933945:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261259648 00000100:00100000:0.0:1746065076.933949:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261259648 00000100:00100000:0.0:1746065076.933971:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4037 00000100:00100000:0.0:1746065076.933976:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27809:x1830881261259648:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065076.934051:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27809:x1830881261259648:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 75us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065076.934057:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4037 00000100:00100000:0.0:1746065076.941960:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.942014:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261260160 00000100:00100000:1.0:1746065076.942021:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261260160 00000100:00100000:1.0:1746065076.942069:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4038 00000100:00100000:1.0:1746065076.942077:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261260160:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065076.942314:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261260160:12345-192.168.202.27@tcp:35:bash.0 Request processed in 237us (361us total) trans 4294975156 rc 0/0 00000100:00100000:1.0:1746065076.943037:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4038 00000100:00100000:0.0:1746065076.950076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.951409:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.955305:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065076.956862:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.956868:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:0.0:1746065076.957067:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x314:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1746065076.957130:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957137:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957142:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957146:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.957149:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957153:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957160:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x314:0x0].0x0 (ffff880098c34f00) 00010000:00010000:0.0:1746065076.957162:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065076.957165:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957169:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145fed4 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x314:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957187:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957191:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957195:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957202:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957206:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065076.957208:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957213:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957219:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34800) 00010000:00010000:0.0:1746065076.957221:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065076.957223:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957226:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166000/0xad6b7ddc145fec6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065076.957236:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098670700 reply state ffff880099baa000 transno 4294975158 ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957243:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065076.957248:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34000) 00010000:00010000:0.0:1746065076.957249:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065076.957252:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065076.957291:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+267:27811:x1830881261260672:12345-192.168.202.27@tcp:36:rm.0 Request processed in 5734us (5882us total) trans 4294975158 rc 0/0 00000100:00100000:0.0:1746065076.957297:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11732 00000100:00100000:0.0:1746065076.960189:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.965477:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.965503:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261184 00000100:00100000:1.0:1746065076.965511:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261184 00000100:00100000:1.0:1746065076.965546:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4039 00000100:00100000:1.0:1746065076.965552:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+268:27810:x1830881261261184:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065076.965734:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x314:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065076.965803:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2298, 64 off190640 00000040:00080000:1.0:1746065076.965822:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2302, 64 off191096 00000040:00080000:1.0:1746065076.965830:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2303, 64 off191160 00000040:00080000:1.0:1746065076.965837:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2299, 64 off190704 00010000:00010000:1.0:1746065076.965878:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fee9 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x314:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065076.965889:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fee9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x314:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065076.965898:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fee9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x314:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065076.965905:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fee9 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x314:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065076.965910:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fee9 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x314:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065076.965915:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc145fee9 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x314:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065076.965927:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065076.966066:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+269:27810:x1830881261261184:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 512us (595us total) trans 4294975159 rc 0/0 00000100:00100000:1.0:1746065076.966072:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4039 00000100:00100000:1.0:1746065076.972153:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.976594:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.984237:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065076.990005:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065076.993828:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261696 00000100:00100000:1.0:1746065076.993838:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261696 00000100:00100000:1.0:1746065076.993880:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261261952 00000100:00100000:1.0:1746065076.993882:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261261952 00000100:00100000:1.0:1746065076.993900:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11737 00000100:00100000:1.0:1746065076.993905:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27812:x1830881261261696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.993921:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.993938:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145ff2f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bd32 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.993985:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145ff36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.993998:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145ff36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994007:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145ff36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065076.994044:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065076.994048:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065076.994072:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc145ff2f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd32 expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.994090:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc145ff36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd32 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.994096:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065076.994098:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065076.994101:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a24c00, rc 0) 00000100:00100000:1.0:1746065076.994144:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27812:x1830881261261696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 239us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065076.994149:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11737 00000100:00100000:1.0:1746065076.994164:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11738 00000100:00100000:1.0:1746065076.994169:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27813:x1830881261261952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065076.994175:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065076.994180:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145ff3d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bd39 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.994213:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.994222:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994228:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994236:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065076.994240:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994244:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994271:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994276:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994281:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994286:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994291:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c285e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.994294:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994301:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994308:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065076.994311:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.994313:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994316:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145ff44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994325:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994328:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994332:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994336:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c284a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065076.994338:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994342:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994347:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34000) 00010000:00010000:1.0:1746065076.994349:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065076.994351:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994354:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c284a00/0xad6b7ddc145ff4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065076.994371:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145ff3d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd39 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.994379:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc145ff3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd39 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065076.994385:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00000100:00100000:1.0:1746065076.994401:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27813:x1830881261261952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 232us (2907us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065076.994406:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11738 00000100:00100000:0.0:1746065076.999767:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.007378:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.011759:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.011822:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.016506:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.022022:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.022073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.031281:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.031332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.031355:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261263872 00000100:00100000:0.0:1746065077.031362:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261263872 00000100:00100000:0.0:1746065077.031417:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11743 00000100:00100000:0.0:1746065077.031424:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261263872:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.031444:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.033035:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145ffad lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bd63 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.033148:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.033158:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.033167:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.033176:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.033181:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.033189:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.033228:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145ffc2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.033235:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145ffc2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.033240:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145ffc2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065077.033248:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x316:0x0]: returning size 0 00010000:00010000:0.0:1746065077.035962:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.035973:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.035979:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.035985:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.035990:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.035994:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.035999:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036011:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:0.0:1746065077.036014:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.036018:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036022:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc145ffb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036050:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036055:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036060:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036064:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.036066:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036070:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036076:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34000) 00010000:00010000:0.0:1746065077.036078:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.036080:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036084:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc145ffbb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.036126:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2600/0xad6b7ddc145ffad lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd63 expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.036141:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145ffc2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd63 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.036147:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:0.0:1746065077.036149:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065077.036150:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae1f200, rc 0) 00000100:00100000:0.0:1746065077.036210:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261263872:12345-192.168.202.27@tcp:101:bash.0 Request processed in 4784us (4875us total) trans 4294975165 rc 0/0 00000100:00100000:0.0:1746065077.036217:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11743 00000100:00100000:0.0:1746065077.042207:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.042289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.042611:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.042685:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264384 00000100:00100000:1.0:1746065077.042692:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264384 00000100:00100000:1.0:1746065077.042747:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 536 00000100:00100000:1.0:1746065077.042755:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+278:2006:x1830881261264384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.042767:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.042813:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae1f200/0xad6b7ddc145ffc2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd63 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.042830:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.042834:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.042873:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+278:2006:x1830881261264384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.042879:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 536 00000100:00100000:0.0:1746065077.045321:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.046217:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261264896 00000100:00100000:1.0:1746065077.046221:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261264896 00000100:00100000:1.0:1746065077.046249:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11746 00000100:00100000:1.0:1746065077.046255:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261264896:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065077.046274:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.046285:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc145ffa6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd55 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.046293:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.046296:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.046383:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,1 mode: --/PW res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.046390:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.046396:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:1.0:1746065077.046424:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975168 00000004:00010000:1.0:1746065077.046438:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a5df800 reply state ffff88009ae64000 transno 4294975169 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.046445:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.046450:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.046451:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.046453:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065077.046489:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261264896:12345-192.168.202.27@tcp:36:bash.0 Request processed in 234us (401us total) trans 4294975169 rc 0/0 00000100:00100000:1.0:1746065077.046494:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11746 00000020:00080000:1.0:1746065077.046497:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065077.047667:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.049874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.055875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.055991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.056094:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261265536 00000100:00100000:1.0:1746065077.056104:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261265536 00000100:00100000:1.0:1746065077.056150:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4043 00000100:00100000:1.0:1746065077.056157:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27814:x1830881261265536:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065077.056304:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27814:x1830881261265536:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 147us (436us total) trans 4294975170 rc 0/0 00000100:00100000:1.0:1746065077.056310:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4043 00010000:00010000:0.0:1746065077.063903:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063910:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063915:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063920:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.063923:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063928:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063939:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34000) 00010000:00010000:0.0:1746065077.063942:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.063945:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063948:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc145fecd lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.063976:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.063981:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.063985:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.063989:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.063991:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.063995:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064001:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34000) 00010000:00010000:0.0:1746065077.064003:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.064004:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064008:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc145ff60 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064020:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064025:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064029:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064032:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c285e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.064034:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064038:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064043:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:0.0:1746065077.064045:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.064047:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.064050:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285e00/0xad6b7ddc145fffa lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.066701:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.066752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.069956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.069987:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.073191:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.074378:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.074467:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266560 00000100:00100000:1.0:1746065077.074472:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266560 00000100:00100000:1.0:1746065077.074496:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4044 00000100:00100000:1.0:1746065077.074501:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+265:27814:x1830881261266560:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065077.074911:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+266:27814:x1830881261266560:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 408us (532us total) trans 4294975173 rc 0/0 00000100:00100000:1.0:1746065077.074918:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4044 00000100:00100000:0.0:1746065077.076651:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.077481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.077499:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261266816 00000100:00100000:1.0:1746065077.077503:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261266816 00000100:00100000:1.0:1746065077.077537:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4045 00000100:00100000:1.0:1746065077.077543:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+266:27814:x1830881261266816:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065077.077640:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+266:27814:x1830881261266816:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 96us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.077645:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4045 00000100:00100000:0.0:1746065077.083006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.087550:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.089176:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.099019:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.109595:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.112401:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.114950:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.120708:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.121446:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.121461:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268352 00000100:00100000:0.0:1746065077.121464:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268352 00000100:00100000:0.0:1746065077.121489:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11753 00000100:00100000:0.0:1746065077.121494:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27815:x1830881261268352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.121502:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.121510:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14600b0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bdb0 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.121564:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14600b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.121571:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14600b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.121576:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14600b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065077.123894:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.124683:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261268480 00000100:00100000:1.0:1746065077.124689:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261268480 00010000:00010000:1.0:1746065077.124716:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460086 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x316:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bda2 expref: 274 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.124748:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3490 00000100:00100000:1.0:1746065077.124755:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261268480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.124766:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.124771:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460086 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x316:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bda2 expref: 274 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.124801:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460086 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x316:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bda2 expref: 274 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.124818:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460086 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x316:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bda2 expref: 274 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.124833:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.124837:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc14600a9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.124845:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc14600a9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.124850:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556e00/0xad6b7ddc14600a9 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.124856:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14600b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.124860:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14600b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.124864:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14600b7 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.124890:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.124928:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+273:2004:x1830881261268480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 172us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.124935:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3490 00000100:00100000:0.0:1746065077.129635:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.129721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.132043:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.138663:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.140574:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.145976:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.151542:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261269888 00000100:00100000:0.0:1746065077.151550:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261269888 00002000:00100000:0.0:1746065077.151594:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x339:0x0] (0->4) req@ffff880095f55180 x1830881261269888/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:748/0 lens 496/0 e 0 to 0 dl 1746065088 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065077.151603:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55180 with x1830881261269888 ext(0->4) 00010000:00010000:0.0:1746065077.151610:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc146005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd8d expref: 72 pid: 10219 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.151622:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc146005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd8d expref: 72 pid: 10219 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746065077.151628:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095f55180 00000100:00100000:0.0:1746065077.151656:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 209 00000100:00100000:0.0:1746065077.151663:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+72:2005:x1830881261269888:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:1.0:1746065077.152671:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.153145:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261269888:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1481us (1665us total) trans 17179872400 rc 0/0 00000100:00100000:0.0:1746065077.153151:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 209 00002000:00100000:0.0:1746065077.153158:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x339:0x0] (0->4) req@ffff880095f55180 x1830881261269888/t17179872400(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:748/0 lens 496/448 e 0 to 0 dl 1746065088 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065077.153165:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55180 with x1830881261269888 ext(0->4) 00010000:00010000:0.0:1746065077.153171:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc146005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd8d expref: 74 pid: 10219 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.153182:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc146005c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd8d expref: 74 pid: 10219 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746065077.153192:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095f55180 00000100:00100000:0.0:1746065077.157845:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.158686:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.160618:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.162044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.162091:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261270656 00000100:00100000:0.0:1746065077.162094:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261270656 00000100:00100000:0.0:1746065077.162116:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11761 00000100:00100000:0.0:1746065077.162121:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27817:x1830881261270656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.162129:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.162138:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc1460135 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bdda expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.162178:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.162185:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162191:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162198:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.162203:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162208:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162233:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162238:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162242:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162247:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162251:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.162255:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162260:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162267:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25b00) 00010000:00010000:0.0:1746065077.162269:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.162272:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162277:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146013c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162288:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162293:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162297:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162302:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.162304:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162308:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162312:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52600) 00010000:00010000:0.0:1746065077.162314:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.162316:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162320:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460143 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.162338:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc1460135 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdda expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.162345:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c285800/0xad6b7ddc1460135 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdda expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.162350:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285800, rc 0) 00000100:00100000:0.0:1746065077.162385:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27817:x1830881261270656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 264us (343us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065077.162391:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11761 00000100:00100000:0.0:1746065077.165047:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262589440 00000100:00100000:0.0:1746065077.165051:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262589440 00000100:00100000:0.0:1746065077.165073:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8249 00000100:00100000:0.0:1746065077.165078:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+192:3759:x1830881262589440:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.165137:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+193:3759:x1830881262589440:12345-0@lo:2:osp-syn-1-1.0 Request processed in 58us (133us total) trans 17179872402 rc 0/0 00000100:00100000:0.0:1746065077.165142:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8249 00000100:00100000:1.0:1746065077.165417:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262589568 00000100:00100000:1.0:1746065077.165420:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262589568 00000100:00100000:1.0:1746065077.165438:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262589696 00000100:00100000:1.0:1746065077.165440:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262589696 00000100:00100000:1.0:1746065077.165452:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8250 00000100:00100000:1.0:1746065077.165456:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+158:3759:x1830881262589568:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065077.165526:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065077.165529:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.165531:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.165533:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.165535:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065077.165556:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+159:3759:x1830881262589568:12345-0@lo:2:osp-syn-0-1.0 Request processed in 99us (217us total) trans 21474839676 rc 0/0 00000100:00100000:1.0:1746065077.165560:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8250 00000100:00100000:1.0:1746065077.165571:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8251 00000100:00100000:1.0:1746065077.165575:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+158:3762:x1830881262589696:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.165628:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+159:3762:x1830881262589696:12345-0@lo:2:osp-syn-0-1.0 Request processed in 53us (256us total) trans 21474839677 rc 0/0 00000100:00100000:1.0:1746065077.165633:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8251 00010000:00010000:1.0:1746065077.165891:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.165898:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.165908:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.166009:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b61800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.166012:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.166018:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.166026:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.166029:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.166031:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.166036:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc146012e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065077.166426:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.167632:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.167985:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11763 00000100:00100000:1.0:1746065077.167992:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27815:x1830881261271040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.168003:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.168011:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146016d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bde8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.168034:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146016d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde8 expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.168041:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146016d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde8 expref: 266 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.168057:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.168059:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.168061:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054200, rc 0) 00000100:00100000:1.0:1746065077.168143:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27815:x1830881261271040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 151us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.168149:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11763 00000100:00100000:0.0:1746065077.170553:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.170623:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271296 00000100:00100000:1.0:1746065077.170629:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271296 00000100:00100000:1.0:1746065077.170669:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11764 00000100:00100000:1.0:1746065077.170676:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27817:x1830881261271296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.170692:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.170704:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460174 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bdef expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.170820:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065077.170937:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.170949:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 268 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.170954:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 4/0,1 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.170975:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 268 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.170984:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 268 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.170997:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262589824:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065077.172233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.172573:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271552 00000100:00100000:1.0:1746065077.172577:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271552 00010000:00010000:1.0:1746065077.172601:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 6/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 269 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.172617:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3492 00000100:00100000:1.0:1746065077.172621:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+269:2004:x1830881261271552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.172628:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.172632:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 6/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 269 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.172639:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 269 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.172649:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff88012d56c500) 00010000:00010000:1.0:1746065077.172652:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172657:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172661:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172670:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.172687:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+269:2004:x1830881261271552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.172694:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3492 00000100:00100000:1.0:1746065077.172713:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065077.172730:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc146015f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bde1 expref: 268 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.172739:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262589824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.172750:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172756:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172761:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065077.172785:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x318:0x0]: returning size 0 00000004:00080000:1.0:1746065077.172900:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x33a:0x0], index 0: 0 00000004:00080000:1.0:1746065077.172905:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x33b:0x0], index 1: 0 00000004:00080000:1.0:1746065077.172908:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x33c:0x0], index 1: 0 00000004:00080000:1.0:1746065077.172911:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x33b:0x0], index 0: 0 00010000:00010000:1.0:1746065077.172975:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172981:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172985:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172990:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.172994:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.172999:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.173006:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff88012d56c500) 00010000:00010000:1.0:1746065077.173008:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.173010:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 2/0,0 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.173015:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc146017b lrc: 0/0,0 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.173040:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460174 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdef expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.173046:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460174 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdef expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.173057:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055000, rc 0) 00000100:00100000:1.0:1746065077.173072:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27817:x1830881261271296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2397us (2524us total) trans 4294975182 rc 301/301 00000100:00100000:1.0:1746065077.173077:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11764 00000100:00100000:0.0:1746065077.174991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.175033:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.175361:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261271936 00000100:00100000:1.0:1746065077.175364:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261271936 00000100:00100000:1.0:1746065077.175395:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8252 00000100:00100000:1.0:1746065077.175400:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+72:2005:x1830881261271936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.175408:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.175420:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc1460197 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bdfd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065077.175534:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x339:0x0] initial LVB size: 5, mtime: 0x6812d6b5, atime: 0x0, ctime: 0x6812d6b5, blocks: 0x8 00010000:00010000:1.0:1746065077.175547:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.175549:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.175555:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc1460197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdfd expref: 73 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065077.175567:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc1460197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdfd expref: 73 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065077.175575:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055200, rc 0) 00000100:00100000:1.0:1746065077.175606:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261271936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 205us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.175611:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8252 00000100:00100000:0.0:1746065077.177280:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.178162:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.178212:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272320 00000100:00100000:1.0:1746065077.178215:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272320 00000100:00100000:1.0:1746065077.178244:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8253 00000100:00100000:1.0:1746065077.178249:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261272320:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065077.178305:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261272320:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 55us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.178310:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8253 00000100:00100000:0.0:1746065077.181263:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.181301:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.181517:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272448 00000100:00100000:1.0:1746065077.181523:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272448 00000100:00100000:1.0:1746065077.181561:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8254 00000100:00100000:1.0:1746065077.181567:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261272448:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065077.181713:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261272448:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 144us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.181719:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8254 00000100:00100000:1.0:1746065077.181753:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272704 00000100:00100000:1.0:1746065077.181756:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272704 00000100:00100000:1.0:1746065077.181805:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11766 00000100:00100000:1.0:1746065077.181810:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+269:26180:x1830881261272704:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.181827:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.181842:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146019e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be04 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.181940:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.181950:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.181959:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.181969:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.181975:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.181980:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182021:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc14601b3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.182027:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc14601b3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182036:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc14601b3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065077.182043:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x318:0x0]: returning size 0 00010000:00010000:1.0:1746065077.182094:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182100:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182105:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182110:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182119:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.182123:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182128:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182137:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34800) 00010000:00010000:1.0:1746065077.182139:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.182142:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182146:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14601a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182155:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182163:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182166:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182170:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.182172:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182175:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182180:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880092a25a00) 00010000:00010000:1.0:1746065077.182182:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.182184:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182189:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055a00/0xad6b7ddc14601ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.182219:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146019e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be04 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.182231:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc14601b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be04 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.182236:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.182238:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.182240:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef400, rc 0) 00000100:00100000:1.0:1746065077.182271:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261272704:12345-192.168.202.27@tcp:101:bash.0 Request processed in 460us (969us total) trans 4294975185 rc 0/0 00000100:00100000:1.0:1746065077.182277:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11766 00000100:00100000:0.0:1746065077.185333:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.185389:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261272832 00000100:00100000:1.0:1746065077.185396:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261272832 00000100:00100000:1.0:1746065077.185466:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11767 00000100:00100000:1.0:1746065077.185474:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261272832:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.185493:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.185508:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14601c1 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be0b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.185531:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14601c8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.185540:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14601c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.185548:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14601c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.185639:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14601c1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be0b expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.185652:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14601c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be0b expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.185658:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.185661:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065077.185663:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:1.0:1746065077.185946:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261272832:12345-192.168.202.27@tcp:101:bash.0 Request processed in 473us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.185954:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11767 00000100:00100000:0.0:1746065077.187505:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.187733:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273088 00000100:00100000:1.0:1746065077.187739:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273088 00000100:00100000:1.0:1746065077.187796:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11768 00000100:00100000:1.0:1746065077.187802:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27815:x1830881261273088:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065077.187952:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.187970:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc1460189 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x316:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdf6 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.187980:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.187983:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.188002:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14601cf lrc: 3/0,1 mode: --/PW res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.188011:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14601cf lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.188018:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14601cf lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065077.188103:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129f43b80 reply state ffff88009ae63000 transno 4294975186 ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14601cf lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.188111:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14601cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.188115:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00000100:00100000:0.0:1746065077.188117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065077.188118:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.188120:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065077.188173:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27815:x1830881261273088:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 371us (671us total) trans 4294975186 rc 0/0 00000100:00100000:1.0:1746065077.188179:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11768 00000100:00100000:1.0:1746065077.188264:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273344 00000100:00100000:1.0:1746065077.188267:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273344 00000100:00100000:1.0:1746065077.188286:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11769 00000100:00100000:1.0:1746065077.188291:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261273344:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065077.188307:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.188316:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc14601b3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be04 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.188326:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.188328:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.188402:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc14601d6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.188409:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc14601d6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.188415:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc14601d6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:1.0:1746065077.188436:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975187 00000004:00010000:1.0:1746065077.188449:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129f41880 reply state ffff880131027000 transno 4294975188 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc14601d6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.188456:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc14601d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.188461:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.188462:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.188464:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065077.188508:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261273344:12345-192.168.202.27@tcp:36:bash.0 Request processed in 216us (390us total) trans 4294975188 rc 0/0 00000100:00100000:1.0:1746065077.188512:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11769 00000020:00080000:1.0:1746065077.188515:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065077.189726:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.189761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.189903:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261273472 00000100:00100000:1.0:1746065077.189907:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261273472 00000100:00100000:1.0:1746065077.190234:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8255 00000100:00100000:1.0:1746065077.190239:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261273472:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065077.190314:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x339:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065077.190317:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x339:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.190319:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x339:0x0] updating lvb atime from disk: 0 -> 1746065077 00002000:00010000:1.0:1746065077.190322:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x339:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.190323:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x339:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065077.190340:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+74:2004:x1830881261273472:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 100us (615us total) trans 17179872403 rc 0/0 00000100:00100000:1.0:1746065077.190346:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8255 00000100:00100000:0.0:1746065077.191685:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.191963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.192614:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274112 00000100:00100000:1.0:1746065077.192618:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274112 00000100:00100000:1.0:1746065077.192645:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11771 00000100:00100000:1.0:1746065077.192651:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261274112:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.192665:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.192667:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065077.192685:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097b61800/0xad6b7ddc14601dd lrc: 0/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be12 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.192697:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.192700:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.192710:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc14601e4 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be19 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.192749:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14601eb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.192761:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14601eb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.192768:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14601eb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:1.0:1746065077.192957:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2304, 88 off191144 00000004:00080000:1.0:1746065077.192963:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673211188634ns, next at 673314574413ns, rc = 0 00000040:00080000:1.0:1746065077.192992:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2308, 88 off191600 00000004:00080000:1.0:1746065077.192996:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673211222607ns, next at 673314596215ns, rc = 0 00000040:00080000:1.0:1746065077.193027:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2309, 88 off191688 00000004:00080000:1.0:1746065077.193030:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673211256649ns, next at 673314596215ns, rc = 0 00000040:00080000:1.0:1746065077.193043:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2305, 88 off191232 00000004:00080000:1.0:1746065077.193046:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673211272131ns, next at 673314574413ns, rc = 0 00000001:00080000:1.0:1746065077.195317:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975189 is committed 00000004:00080000:1.0:1746065077.195327:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1552 committed 00000004:00080000:1.0:1746065077.195337:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1562 committed 00000004:00080000:1.0:1746065077.195342:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1561 committed 00000004:00080000:1.0:1746065077.195343:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1551 committed 00010000:00010000:1.0:1746065077.195577:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14601eb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be19 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.195597:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.195599:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065077.195609:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc14601e4 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be19 expref: 270 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065077.195623:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14601eb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be19 expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.195644:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065077.195646:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065077.195649:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00000100:00100000:1.0:1746065077.195685:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:26180:x1830881261274112:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3033us (3721us total) trans 4294975189 rc 0/0 00000100:00100000:1.0:1746065077.195692:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11771 00000100:00100000:1.0:1746065077.195718:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590080 00000100:00100000:1.0:1746065077.195722:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590080 00000100:00100000:1.0:1746065077.195740:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590208 00000100:00100000:1.0:1746065077.195742:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590208 00000100:00100000:1.0:1746065077.195752:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8256 00000100:00100000:1.0:1746065077.195757:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+194:3762:x1830881262590080:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.196461:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+195:3762:x1830881262590080:12345-0@lo:2:osp-syn-1-1.0 Request processed in 703us (990us total) trans 17179872405 rc 0/0 00000100:00100000:1.0:1746065077.196466:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8256 00000100:00100000:1.0:1746065077.196474:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590336 00000100:00100000:1.0:1746065077.196476:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590336 00000100:00100000:1.0:1746065077.196489:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8259 00000100:00100000:1.0:1746065077.196492:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+161:3759:x1830881262590336:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.196566:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.196849:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+161:3759:x1830881262590336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 355us (465us total) trans 21474839679 rc 0/0 00000100:00100000:1.0:1746065077.196854:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8259 00000004:00080000:1.0:1746065077.196872:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f40700/2, rc 0, transno 21474839679 00000100:00100000:1.0:1746065077.197735:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262590336:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.199594:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.200364:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274368 00000100:00100000:1.0:1746065077.200372:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274368 00000100:00100000:1.0:1746065077.200414:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8260 00000100:00100000:1.0:1746065077.200420:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+67:26180:x1830881261274368:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.200434:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.200449:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be20 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065077.200468:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065077.200483:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.200485:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.200491:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 68 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.200502:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 68 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.200510:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e000, rc 0) 00000100:00100000:1.0:1746065077.200551:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+68:26180:x1830881261274368:12345-192.168.202.27@tcp:101:bash.0 Request processed in 130us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.200557:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8260 00000001:00080000:1.0:1746065077.204310:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975190 is committed 00000004:00080000:1.0:1746065077.204320:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1564 committed 00000004:00080000:1.0:1746065077.204344:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1554 committed 00000004:00080000:1.0:1746065077.204354:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1553 committed 00000004:00080000:1.0:1746065077.204356:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1563 committed 00000100:00100000:0.0:1746065077.204932:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065077.205151:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.205159:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.205165:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.205170:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d358800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.205173:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.205178:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.205186:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065077.205188:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.205191:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.205194:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc14601f2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:1.0:1746065077.205218:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262590848:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.205240:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.205254:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274496 00000100:00100000:0.0:1746065077.205260:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274496 00000100:00100000:1.0:1746065077.205269:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065077.205273:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262590720:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.205286:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590848 00000100:00100000:1.0:1746065077.205288:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.205288:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590848 00000100:00100000:0.0:1746065077.205300:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590720 00000100:00100000:0.0:1746065077.205302:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590720 00000100:00100000:0.0:1746065077.205316:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8261 00000100:00100000:0.0:1746065077.205321:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+74:26180:x1830881261274496:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.205332:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.205345:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be27 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065077.205364:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1746065077.205400:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590592 00000100:00100000:1.0:1746065077.205402:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590592 00000100:00100000:1.0:1746065077.205419:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8262 00000100:00100000:1.0:1746065077.205423:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+161:3760:x1830881262590848:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065077.205518:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065077.205521:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.205523:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.205524:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.205526:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x338:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065077.205540:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+163:3760:x1830881262590848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (300us total) trans 21474839680 rc 0/0 00000100:00100000:1.0:1746065077.205545:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8262 00000100:00100000:1.0:1746065077.205553:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8265 00000100:00100000:1.0:1746065077.205556:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+162:3762:x1830881262590976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.205612:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+163:3762:x1830881262590976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 55us (192us total) trans 21474839681 rc 0/0 00000100:00100000:1.0:1746065077.205616:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8265 00000004:00080000:1.0:1746065077.205643:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed1880/2, rc 0, transno 17179872406 00000100:00100000:1.0:1746065077.205647:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262590720:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065077.205655:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858fb80/2, rc 0, transno 21474839680 00000100:00100000:1.0:1746065077.205657:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262590848:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065077.205668:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858f800/2, rc 0, transno 21474839681 00000100:00100000:1.0:1746065077.205671:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262590976:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065077.205676:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed2d80/2, rc 0, transno 17179872407 00000100:00100000:1.0:1746065077.205679:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262590592:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065077.205766:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.205768:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.205797:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 75 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.205809:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 75 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.205817:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055400, rc 0) 00000100:00100000:0.0:1746065077.205845:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+75:26180:x1830881261274496:12345-192.168.202.27@tcp:101:bash.0 Request processed in 523us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.206379:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8261 00000100:00100000:1.0:1746065077.206934:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274624 00000100:00100000:1.0:1746065077.206939:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274624 00000100:00100000:1.0:1746065077.207079:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11772 00000100:00100000:1.0:1746065077.207086:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+263:27815:x1830881261274624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.207100:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.207111:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc1460207 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x316:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be2e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.207149:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc1460207 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be2e expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.207158:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9000/0xad6b7ddc1460207 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x316:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be2e expref: 264 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.207170:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065077.207173:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.207175:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9000, rc 0) 00000100:00100000:1.0:1746065077.207210:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+264:27815:x1830881261274624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.207214:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11772 00000100:00100000:0.0:1746065077.207808:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.207823:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261274752 00000100:00100000:0.0:1746065077.207826:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261274752 00002000:00010000:0.0:1746065077.207842:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/826 (0->18446744073709551615) 00002000:00100000:0.0:1746065077.207845:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009858ea00 with x1830881261274752 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065077.207853:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009858ea00. 00000100:00100000:0.0:1746065077.208102:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1225 00000100:00100000:0.0:1746065077.208108:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+68:2005:x1830881261274752:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065077.208223:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x33a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065077.208225:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x33a:0x0] updating lvb mtime from disk: 0 -> 1746065077 00002000:00010000:0.0:1746065077.208227:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x33a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065077.208228:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x33a:0x0] updating lvb ctime from disk: 0 -> 1746065077 00002000:00010000:0.0:1746065077.208230:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x33a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065077.208247:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261274752:12345-192.168.202.27@tcp:10:bash.0 Request processed in 139us (440us total) trans 21474839682 rc 0/0 00000100:00100000:0.0:1746065077.208252:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1225 00002000:00010000:0.0:1746065077.208254:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/826 (0->18446744073709551615) 00002000:00100000:0.0:1746065077.208256:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009858ea00 with x1830881261274752 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065077.208259:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009858ea00. 00000100:00100000:0.0:1746065077.212456:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.213086:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065077.213825:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065077.213830:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146020e lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.213836:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019d800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065077.213839:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146020e lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.213845:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146020e lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x316:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.213853:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x316:0x0].0x0 (ffff880095561700) 00010000:00010000:1.0:1746065077.213856:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065077.213859:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146020e lrc: 1/0,0 mode: --/PW res: [0x240000403:0x316:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.213864:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146020e lrc: 0/0,0 mode: --/PW res: [0x240000403:0x316:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.213872:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.213873:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.213874:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.216578:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.223350:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275520 00000100:00100000:0.0:1746065077.223359:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275520 00000100:00100000:0.0:1746065077.224748:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11773 00000100:00100000:0.0:1746065077.224761:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+266:27818:x1830881261275520:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1746065077.224797:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.224815:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460215 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be35 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.224868:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.224878:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.224887:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.224899:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.224904:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.224908:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.224969:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146022a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.224975:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146022a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.224980:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146022a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.225011:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x318:0x0]: returning size 5 00000004:00200000:0.0:1746065077.225015:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065077.225027:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146022a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225036:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146022a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225043:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225047:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225052:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225060:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225065:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.225068:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225073:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225082:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:0.0:1746065077.225084:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.225087:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225092:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc146021c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225345:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225350:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225354:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225358:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.225360:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225364:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225374:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bccd00) 00010000:00010000:0.0:1746065077.225376:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.225379:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225383:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc1460223 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.225410:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460215 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be35 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.225422:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146022a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be35 expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.225428:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x318:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065077.225430:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065077.225432:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019d800, rc 0) 00000100:00100000:0.0:1746065077.225986:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27818:x1830881261275520:12345-192.168.202.27@tcp:101:rm.0 Request processed in 1228us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.225992:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11773 00000100:00100000:0.0:1746065077.229968:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.230481:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261275776 00000100:00100000:0.0:1746065077.230488:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261275776 00000100:00100000:0.0:1746065077.230563:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276032 00000100:00100000:0.0:1746065077.230566:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276032 00000100:00100000:0.0:1746065077.230649:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11774 00000100:00100000:0.0:1746065077.230655:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27819:x1830881261275776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.230670:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.232412:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc146024d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be3c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.232499:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc146024d lrc: 1/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be3c expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.232506:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc146024d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be3c expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.232514:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358800, rc 0) 00000100:00100000:0.0:1746065077.232565:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27819:x1830881261275776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1910us (2605us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065077.232571:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11774 00000100:00100000:0.0:1746065077.235890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.241546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.249325:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276544 00000100:00100000:0.0:1746065077.251386:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11778 00000100:00100000:0.0:1746065077.251401:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27820:x1830881261276544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.251419:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.251438:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc146027e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be51 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.251494:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.251504:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251513:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251524:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.251530:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251535:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251568:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251573:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251607:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251614:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251619:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.251622:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251627:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251636:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c512500) 00010000:00010000:0.0:1746065077.251638:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.251641:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251646:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460285 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251674:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251679:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251684:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251687:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.251689:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251693:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251698:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:0.0:1746065077.251700:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.251702:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251706:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055c00/0xad6b7ddc146028c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.251728:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc146027e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be51 expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.251734:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc146027e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be51 expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.251744:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358800, rc 0) 00000100:00100000:0.0:1746065077.251807:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+266:27820:x1830881261276544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 411us (3344us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065077.251813:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11778 00000100:00100000:3.0:1746065077.255218:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276672 00000100:00100000:3.0:1746065077.255227:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276672 00000100:00100000:3.0:1746065077.255277:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11779 00000100:00100000:3.0:1746065077.255283:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+266:27820:x1830881261276672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.255299:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.255313:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc1460293 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be58 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.255360:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.255369:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255376:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255382:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.255386:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255388:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255419:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255422:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255424:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255432:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255435:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.255438:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255441:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255447:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c800) 00010000:00010000:3.0:1746065077.255449:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.255451:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255454:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146029a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255469:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255473:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255478:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255482:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.255484:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255488:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255498:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:3.0:1746065077.255500:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.255525:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255531:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14602a1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.255554:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc1460293 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be58 expref: 267 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.255560:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc1460293 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be58 expref: 267 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.255572:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:3.0:1746065077.255634:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+266:27820:x1830881261276672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 350us (505us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.255639:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11779 00000100:00100000:0.0:1746065077.257615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.257692:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261277056 00000100:00100000:3.0:1746065077.257699:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261277056 00000100:00100000:3.0:1746065077.257737:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11780 00000100:00100000:3.0:1746065077.257743:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+266:27820:x1830881261277056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.257759:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.257788:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524800/0xad6b7ddc14602a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be66 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.257833:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14602af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.257847:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14602af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.257854:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14602af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065077.258331:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261276928 00000100:00100000:0.0:1746065077.258335:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261276928 00000004:00200000:3.0:1746065077.258353:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000100:00100000:0.0:1746065077.258356:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11781 00000004:00200000:3.0:1746065077.258357:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1746065077.258360:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27821:x1830881261276928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.258367:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.258373:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc14602b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be5f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.258384:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524800/0xad6b7ddc14602a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be66 expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.258395:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14602af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be66 expref: 269 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.258401:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c500) 00010000:00010000:3.0:1746065077.258403:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065077.258406:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524200, rc 0) 00010000:00010000:0.0:1746065077.258407:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.258412:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.258418:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.258424:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.258429:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.258433:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065077.258438:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+269:27820:x1830881261277056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 696us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.258443:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11780 00010000:00010000:0.0:1746065077.258456:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.258461:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.258467:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.258472:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260131:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.260135:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260142:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260154:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c500) 00010000:00010000:0.0:1746065077.260156:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.260159:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260165:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14602bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260178:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260183:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260187:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260190:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.260192:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260199:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260204:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:0.0:1746065077.260206:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.260208:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260211:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14602c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.260241:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc14602b6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be5f expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.260247:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054200/0xad6b7ddc14602b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be5f expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.260254:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054200, rc 0) 00000100:00100000:0.0:1746065077.260309:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27821:x1830881261276928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1947us (2099us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065077.260315:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11781 00000100:00100000:0.0:1746065077.264709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.269402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.273079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.278262:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.283720:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.283842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.290539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.293270:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.294459:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.294696:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261278976 00000100:00100000:1.0:1746065077.294700:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261278976 00000100:00100000:1.0:1746065077.294727:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11786 00000100:00100000:1.0:1746065077.294732:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27821:x1830881261278976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.294739:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.294746:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc146033b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be90 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.294822:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1460342 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.294828:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1460342 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.294835:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1460342 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065077.294843:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 0 00010000:00010000:1.0:1746065077.294958:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc146033b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be90 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.294978:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1460342 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be90 expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.294987:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.294989:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065077.294990:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:1.0:1746065077.295012:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27821:x1830881261278976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 279us (553us total) trans 4294975199 rc 0/0 00000100:00100000:1.0:1746065077.295017:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11786 00000100:00100000:0.0:1746065077.297319:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.297424:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279360 00000100:00100000:3.0:1746065077.297430:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279360 00000100:00100000:3.0:1746065077.297473:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11787 00000100:00100000:3.0:1746065077.297480:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261279360:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065077.297524:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.297545:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc1460318 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be7b expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.297575:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:3.0:1746065077.297587:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.297725:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.297735:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.297742:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065077.297771:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975200 00000004:00010000:3.0:1746065077.297818:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925c8700 reply state ffff88012fc02000 transno 4294975201 ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.297826:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.297830:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:3.0:1746065077.297833:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065077.297834:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065077.297897:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261279360:12345-192.168.202.27@tcp:36:bash.0 Request processed in 417us (585us total) trans 4294975201 rc 0/0 00000100:00100000:3.0:1746065077.297902:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11787 00000020:00080000:3.0:1746065077.297906:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065077.299688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.299730:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.299843:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279104 00000100:00100000:1.0:1746065077.299849:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279104 00000100:00100000:1.0:1746065077.299892:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261279616 00000100:00100000:1.0:1746065077.299894:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261279616 00000100:00100000:1.0:1746065077.299909:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11788 00000100:00100000:1.0:1746065077.299915:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27821:x1830881261279104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.299929:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.299942:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc1460357 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be97 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300001:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.300009:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.300016:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065077.300033:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 0 00000004:00200000:1.0:1746065077.300036:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065077.300047:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.300064:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc1460357 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300077:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300082:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.300085:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.300086:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778e00, rc 0) 00000100:00100000:1.0:1746065077.300118:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27821:x1830881261279104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 203us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.300123:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11788 00000100:00100000:1.0:1746065077.300135:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11789 00000100:00100000:1.0:1746065077.300139:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261279616:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.300145:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.300146:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065077.300155:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1460342 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be90 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300161:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.300163:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.300167:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1460365 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92be9e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300185:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.300194:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300198:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.300220:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.300227:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 279 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.300236:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262591232:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.300286:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065077.302075:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262591232:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.302092:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065077.303472:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.304834:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.305017:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280000 00000100:00100000:1.0:1746065077.305025:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280000 00010000:00010000:1.0:1746065077.305059:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 280 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.305127:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3495 00000100:00100000:1.0:1746065077.305133:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+280:2004:x1830881261280000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.305144:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.305149:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 280 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.305159:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 280 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.305176:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146035e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be97 expref: 280 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.305188:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.305192:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.305199:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.305587:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.305605:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.305621:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+280:2004:x1830881261280000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 488us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.305626:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3495 00010000:00010000:0.0:1746065077.305790:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.305796:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:0.0:1746065077.305995:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2316, 88 off192208 00000004:00080000:0.0:1746065077.306000:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673324225988ns, next at 673314596215ns, rc = 0 00000040:00080000:0.0:1746065077.306033:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2312, 88 off191752 00000004:00080000:0.0:1746065077.306036:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673324262169ns, next at 673314574413ns, rc = 0 00000040:00080000:0.0:1746065077.306046:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2313, 88 off191840 00000004:00080000:0.0:1746065077.306049:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673324275361ns, next at 673314574413ns, rc = 0 00000040:00080000:0.0:1746065077.306056:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2317, 88 off192296 00000004:00080000:0.0:1746065077.306058:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673324284824ns, next at 673314596215ns, rc = 0 00000001:00080000:0.0:1746065077.309522:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975203 is committed 00000004:00080000:0.0:1746065077.309531:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1566 committed 00000004:00080000:0.0:1746065077.309544:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1556 committed 00000004:00080000:0.0:1746065077.309548:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1555 committed 00000004:00080000:0.0:1746065077.309550:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1565 committed 00010000:00010000:0.0:1746065077.309628:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be9e expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.309637:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:0.0:1746065077.309639:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065077.309652:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1460365 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be9e expref: 268 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065077.309667:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be9e expref: 267 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.309691:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:0.0:1746065077.309693:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065077.309695:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019d800, rc 0) 00000100:00100000:0.0:1746065077.309748:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261279616:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9606us (10016us total) trans 4294975203 rc 0/0 00000100:00100000:0.0:1746065077.309755:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11789 00000100:00100000:0.0:1746065077.309845:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.309917:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280256 00000100:00100000:0.0:1746065077.309922:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280256 00000100:00100000:0.0:1746065077.309950:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11790 00000100:00100000:0.0:1746065077.309956:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+267:27821:x1830881261280256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.309968:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.309980:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460373 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bea5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.310031:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.310039:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310045:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310057:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.310062:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310066:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310131:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.310139:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310144:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.310152:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 2 00010000:00010000:0.0:1746065077.310212:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310218:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310222:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310226:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310230:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.310233:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310242:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310248:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065077.310250:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.310253:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310257:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146037a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310263:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310267:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310271:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310274:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.310276:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310280:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310285:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:0.0:1746065077.310286:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.310288:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310291:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460381 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.310314:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460373 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.310325:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.310330:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:0.0:1746065077.310331:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065077.310333:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00000100:00100000:0.0:1746065077.310353:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27821:x1830881261280256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 397us (508us total) trans 4294975204 rc 0/0 00000100:00100000:0.0:1746065077.310358:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11790 00000100:00100000:3.0:1746065077.310605:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262591744:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.310641:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065077.310688:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310695:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310700:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310703:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.310706:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310711:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310717:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:1.0:1746065077.310719:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.310721:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310726:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460238 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.310737:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310742:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310747:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310750:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.310752:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310756:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310761:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:1.0:1746065077.310763:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.310764:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310787:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14602d9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310798:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310803:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310807:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310810:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.310812:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310816:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310821:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.310823:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.310825:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.310829:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460350 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065077.310843:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262591488:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.310866:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262591616:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.313495:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262592256:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.313495:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262591360:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.313535:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.313550:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262592768:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065077.313563:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.313642:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.314273:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8270 00000100:00100000:0.0:1746065077.314280:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+77:26180:x1830881261280384:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.314288:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.314309:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92beac expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.314326:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc1460326 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be82 expref: 78 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065077.314332:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.314333:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.314335:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 78 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.314358:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc1460326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be82 expref: 78 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065077.314367:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc1460326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be82 expref: 78 pid: 9549 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746065077.314375:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262592896:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065077.314421:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.314433:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.314445:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262591872:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.314459:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.314475:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262592384:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.314488:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.314504:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262592384 00000100:00100000:0.0:1746065077.314506:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262592384 00000100:00100000:0.0:1746065077.314519:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8272 00000100:00100000:0.0:1746065077.314522:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+199:3762:x1830881262591872:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065077.314561:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065077.314563:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065077.314565:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065077.314567:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065077.314569:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065077.314598:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+200:3762:x1830881262591872:12345-0@lo:2:osp-syn-1-1.0 Request processed in 75us (138us total) trans 17179872410 rc 0/0 00000100:00100000:0.0:1746065077.314603:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8272 00000100:00100000:0.0:1746065077.314612:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8273 00000100:00100000:0.0:1746065077.314616:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+165:3762:x1830881262592384:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065077.314624:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:826 count 1 00010000:00010000:0.0:1746065077.314632:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.314641:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 68 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.314646:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065077.314647:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065077.314649:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.314664:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 68 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.314671:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 68 pid: 9549 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.314680:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262593152:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065077.314710:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b240 going to sleep for 11 seconds 00000004:00080000:3.0:1746065077.314713:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf3800/2, rc 0, transno 21474839683 00000100:00100000:3.0:1746065077.314718:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262592256:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1746065077.314723:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dc000/2, rc 0, transno 17179872410 00000004:00080000:3.0:1746065077.314724:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef27800/2, rc 0, transno 21474839684 00000100:00100000:0.0:1746065077.314726:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262591872:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.314727:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262592768:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065077.314733:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dea00/2, rc 0, transno 17179872409 00000100:00100000:3.0:1746065077.314735:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262591744:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065077.314913:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065077.314926:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.314949:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262592128:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.314967:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.315453:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262592640:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.315469:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.315880:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262591616 00000100:00100000:0.0:1746065077.315885:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262591616 00000100:00100000:1.0:1746065077.315887:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065077.315892:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262592512:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.315907:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.315913:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262592128 00000100:00100000:0.0:1746065077.315915:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262592128 00000100:00100000:1.0:1746065077.315926:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.315926:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262592640 00000100:00100000:0.0:1746065077.315927:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262592640 00000100:00100000:0.0:1746065077.315933:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262592512 00000100:00100000:0.0:1746065077.315934:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262592512 00000100:00100000:1.0:1746065077.315938:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262592000:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.315942:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262591488 00000100:00100000:0.0:1746065077.315943:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262591488 00000100:00100000:0.0:1746065077.315950:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8274 00000100:00100000:1.0:1746065077.315951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.315955:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+201:3760:x1830881262591616:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.315967:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262592000 00002000:00080000:0.0:1746065077.315967:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:827 count 1 00000100:00100000:1.0:1746065077.315969:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262592000 00010000:00010000:0.0:1746065077.315978:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065077.315980:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8275 00000100:00100000:1.0:1746065077.315984:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+168:3760:x1830881262592128:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065077.315989:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 78 pid: 1880 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1746065077.315992:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:824 count 1 00010000:00010000:0.0:1746065077.315995:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065077.315996:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065077.315998:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.316000:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.316008:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 68 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.316012:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 78 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.316013:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065077.316014:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065077.316016:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.316020:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 78 pid: 1880 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.316027:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262593280:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.316028:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 68 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.316039:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 68 pid: 10219 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.316047:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262593408:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065077.316067:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065077.316078:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfee40 going to sleep for 11 seconds 00000004:00080000:1.0:1746065077.317159:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef25c00/2, rc 0, transno 21474839686 00000100:00100000:1.0:1746065077.317165:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262592512:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065077.317173:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef26300/2, rc 0, transno 21474839685 00000100:00100000:1.0:1746065077.317175:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262592640:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065077.317236:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dc700/2, rc 0, transno 17179872411 00000100:00100000:0.0:1746065077.317241:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262591488:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065077.317247:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4f9180/2, rc 0, transno 17179872412 00000100:00100000:0.0:1746065077.317250:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262592000:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.319623:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.319641:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.319648:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262592896:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.319677:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 78 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.319682:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262593152:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.319691:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3400, rc 0) 00010000:00010000:0.0:1746065077.319693:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.319940:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262593024:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.319953:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.319984:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3497 00000100:00100000:0.0:1746065077.319990:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+79:2004:x1830881261280512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.319996:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.320000:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc1460197 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x339:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdfd expref: 79 pid: 9549 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746065077.320006:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc1460197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x339:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdfd expref: 79 pid: 9549 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746065077.320015:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131055200/0xad6b7ddc1460197 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x339:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bdfd expref: 79 pid: 9549 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746065077.320060:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.320062:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.320064:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.320073:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.320115:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065077.320130:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+78:2004:x1830881261280512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.320132:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+78:26180:x1830881261280384:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5853us (6491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.320136:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3497 00000100:00100000:1.0:1746065077.320138:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8270 00010000:00010000:3.0:1746065077.320182:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.320189:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.320196:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.320246:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.320260:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065077.320428:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065077.320434:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.320440:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009555b800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065077.320444:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.320451:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.320460:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.320465:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009555b800/0xad6b7ddc14603ab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.320478:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.320479:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.320481:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065077.320482:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+203:3762:x1830881262591360:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5965us (6049us total) trans 17179872413 rc 0/0 00000100:00100000:3.0:1746065077.320489:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8271 00000004:00080000:0.0:1746065077.320606:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dd880/2, rc 0, transno 17179872413 00000100:00100000:0.0:1746065077.320611:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262591360:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.320753:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.320785:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261280768 00000100:00100000:1.0:1746065077.320789:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261280768 00010000:00010000:1.0:1746065077.320807:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 69 pid: 9549 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.320983:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262593280:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.320994:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065077.321026:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3498 00000100:00100000:1.0:1746065077.321032:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+69:2007:x1830881261280768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.321039:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.321042:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 69 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.321049:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 69 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.321069:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc14601f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be20 expref: 69 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.321191:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.321193:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.321196:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.321201:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.321213:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.321232:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+68:2007:x1830881261280768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 200us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.321237:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3498 00010000:00010000:0.0:1746065077.321271:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.321278:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.321285:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.321291:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.321309:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065077.321416:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+169:3762:x1830881262592384:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6799us (6926us total) trans 21474839687 rc 0/0 00000100:00100000:0.0:1746065077.321422:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8273 00000004:00080000:0.0:1746065077.321445:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef27b80/2, rc 0, transno 21474839687 00000100:00100000:0.0:1746065077.321448:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262592384:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065077.321525:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065077.321529:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.321534:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.321537:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.321542:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.321550:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.321556:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131055c00/0xad6b7ddc14603b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.321566:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065077.321567:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065077.321569:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065077.322887:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.322899:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281152 00000100:00100000:1.0:1746065077.322903:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281152 00010000:00010000:1.0:1746065077.322920:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 77 pid: 1880 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.322936:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3499 00000100:00100000:1.0:1746065077.322942:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+77:2004:x1830881261281152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.322950:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.322953:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 77 pid: 1880 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.322966:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 77 pid: 1880 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.322978:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131055400/0xad6b7ddc1460200 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be27 expref: 77 pid: 1880 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.322987:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.322988:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.322991:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.322996:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.323010:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.323027:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+76:2004:x1830881261281152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.323032:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3499 00000100:00100000:1.0:1746065077.323066:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.323078:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281280 00000100:00100000:1.0:1746065077.323081:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281280 00010000:00010000:1.0:1746065077.323091:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 68 pid: 10219 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.323104:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3500 00000100:00100000:1.0:1746065077.323108:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+68:2004:x1830881261281280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.323116:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.323118:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 68 pid: 10219 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.323126:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 68 pid: 10219 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.323135:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.323137:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.323139:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.323144:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.323152:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.323164:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+68:2004:x1830881261281280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.323169:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3500 00010000:00010000:0.0:1746065077.323706:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1460063 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x338:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bd94 expref: 67 pid: 10219 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.323716:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262593408:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065077.323727:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.323734:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.323740:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.323748:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.323753:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc14603c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.323786:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065077.323912:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+169:3760:x1830881262592128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7926us (8943us total) trans 21474839688 rc 0/0 00000100:00100000:0.0:1746065077.323920:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8275 00000004:00080000:1.0:1746065077.323982:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf2a00/2, rc 0, transno 21474839688 00000100:00100000:1.0:1746065077.323986:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262592128:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.324043:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.324280:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281408 00000100:00100000:0.0:1746065077.324284:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281408 00000100:00100000:0.0:1746065077.324701:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8280 00000100:00100000:0.0:1746065077.324707:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+67:26180:x1830881261281408:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.324717:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.324727:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92beb3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065077.324742:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065077.324753:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.324754:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.324759:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 68 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.324769:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 68 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.324795:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ac00, rc 0) 00000100:00100000:0.0:1746065077.324822:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+68:26180:x1830881261281408:12345-192.168.202.27@tcp:101:bash.0 Request processed in 115us (778us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065077.324826:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.324826:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8280 00010000:00010000:3.0:1746065077.324834:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.324840:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.324846:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.324856:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065077.325188:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+203:3760:x1830881262591616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9231us (10260us total) trans 17179872414 rc 0/0 00000100:00100000:3.0:1746065077.325194:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8274 00000004:00080000:1.0:1746065077.325196:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dd500/2, rc 0, transno 17179872414 00000100:00100000:1.0:1746065077.325200:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262591616:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065077.325794:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.325800:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.325806:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.325809:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.325815:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.325827:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.325832:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14603b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.325844:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.325845:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.325847:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.326591:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.329155:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.329168:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261281664 00000100:00100000:1.0:1746065077.329171:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261281664 00002000:00010000:1.0:1746065077.329183:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/829 (0->18446744073709551615) 00002000:00100000:1.0:1746065077.329185:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5f80 with x1830881261281664 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065077.329190:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd5f80. 00000100:00100000:1.0:1746065077.329200:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1228 00000100:00100000:1.0:1746065077.329205:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+75:2004:x1830881261281664:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065077.329266:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065077.329268:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb mtime from disk: 0 -> 1746065077 00002000:00010000:1.0:1746065077.329270:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.329271:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb ctime from disk: 0 -> 1746065077 00002000:00010000:1.0:1746065077.329273:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065077.329287:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+76:2004:x1830881261281664:12345-192.168.202.27@tcp:10:bash.0 Request processed in 82us (132us total) trans 17179872415 rc 0/0 00000100:00100000:1.0:1746065077.329292:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1228 00002000:00010000:1.0:1746065077.329294:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/829 (0->18446744073709551615) 00002000:00100000:1.0:1746065077.329296:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5f80 with x1830881261281664 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065077.329298:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd5f80. 00000100:00100000:0.0:1746065077.333348:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.333373:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282048 00000100:00100000:0.0:1746065077.333379:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282048 00000100:00100000:0.0:1746065077.333416:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4058 00000100:00100000:0.0:1746065077.333423:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261282048:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065077.333642:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261282048:12345-192.168.202.27@tcp:35:bash.0 Request processed in 218us (300us total) trans 4294975206 rc 0/0 00000100:00100000:0.0:1746065077.333649:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4058 00000100:00100000:0.0:1746065077.336911:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.337079:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282304 00000100:00100000:3.0:1746065077.337087:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282304 00000100:00100000:3.0:1746065077.337125:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11791 00000100:00100000:3.0:1746065077.337133:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27822:x1830881261282304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.337154:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.337170:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14603dc lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92beba expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.337253:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14603e3 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.337265:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14603e3 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.337274:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14603e3 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065077.337282:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 5 00010000:00010000:3.0:1746065077.337353:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14603dc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beba expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.337365:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14603e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beba expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.337371:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:3.0:1746065077.337373:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065077.337375:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a529400, rc 0) 00000100:00100000:3.0:1746065077.337426:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27822:x1830881261282304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 294us (523us total) trans 4294975207 rc 0/0 00000100:00100000:3.0:1746065077.337430:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11791 00000100:00100000:0.0:1746065077.343127:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.343173:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.343268:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282560 00000100:00100000:1.0:1746065077.343276:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282560 00000100:00100000:1.0:1746065077.343312:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11792 00000100:00100000:1.0:1746065077.343318:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27822:x1830881261282560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.343336:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.343351:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14603f1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bec1 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.343429:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065077.343443:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.343450:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.343472:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.343481:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 271 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.343490:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262593664:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.343553:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065077.343605:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261282816 00000100:00100000:3.0:1746065077.343608:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261282816 00000100:00100000:3.0:1746065077.343629:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4059 00000100:00100000:3.0:1746065077.343633:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27823:x1830881261282816:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:3.0:1746065077.343797:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27823:x1830881261282816:12345-192.168.202.27@tcp:35:rm.0 Request processed in 162us (623us total) trans 4294975208 rc 0/0 00000100:00100000:3.0:1746065077.343803:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4059 00000100:00100000:0.0:1746065077.346085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065077.346202:0:7204:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880099bd6300 x1830881262593664) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 272 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.346217:0:7204:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 272 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.346235:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460388 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bea5 expref: 272 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.346250:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262593664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.346265:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.346269:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.346279:0:7204:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.346283:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.346296:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.346303:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.346307:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065077.346328:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 5 00010000:00010000:1.0:1746065077.346417:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14603f1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec1 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346428:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec1 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346433:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.346435:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065077.346437:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8600, rc 0) 00000100:00100000:1.0:1746065077.346471:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27822:x1830881261282560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3153us (3353us total) trans 4294975209 rc 0/0 00000100:00100000:1.0:1746065077.346478:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11792 00000100:00100000:1.0:1746065077.346494:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283072 00000100:00100000:1.0:1746065077.346497:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283072 00000100:00100000:1.0:1746065077.346523:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11793 00000100:00100000:1.0:1746065077.346528:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27823:x1830881261283072:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065077.346554:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1746065077.346561:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14603e3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beba expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346571:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc146036c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be9e expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346589:0:7205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc1460388) 00010000:00010000:1.0:1746065077.346595:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a200/0xad6b7ddc1460334 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92be89 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346606:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.346608:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.346621:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065077.346628:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.346633:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.346641:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc146040d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065077.346646:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc146040d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.346651:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc146040d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.346705:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065077.346711:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec1 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346716:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.346733:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec1 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.346743:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc14603f8 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x31a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec1 expref: 269 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.346752:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262593792:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.346826:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065077.348765:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262593792:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.348799:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065077.349197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065077.349911:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.349917:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:1.0:1746065077.350118:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x31a:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1746065077.350181:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350188:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350194:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350199:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.350202:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350208:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350216:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065077.350218:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065077.350220:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350225:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1460414 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350239:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350243:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350247:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350251:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350254:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.350256:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350260:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350266:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973100) 00010000:00010000:1.0:1746065077.350268:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.350270:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350274:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f400/0xad6b7ddc1460406 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065077.350288:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5f1880 reply state ffff88009a58f000 transno 4294975210 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc146040d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350295:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc146040d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.350299:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:1.0:1746065077.350301:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.350303:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065077.350351:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27823:x1830881261283072:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3821us (4270us total) trans 4294975210 rc 0/0 00000100:00100000:1.0:1746065077.350356:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11793 00000100:00100000:0.0:1746065077.352741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.352853:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283328 00000100:00100000:1.0:1746065077.352860:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283328 00000100:00100000:1.0:1746065077.352896:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11794 00000100:00100000:1.0:1746065077.352903:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27822:x1830881261283328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.352921:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.352937:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146041b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bec8 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.352998:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460422 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065077.353007:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460422 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.353014:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460422 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065077.353043:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 5 00000004:00200000:1.0:1746065077.353046:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065077.353057:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460422 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.353074:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778e00/0xad6b7ddc146041b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec8 expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.353085:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e800/0xad6b7ddc1460422 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bec8 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.353091:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:1.0:1746065077.353094:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065077.353096:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e800, rc 0) 00000100:00100000:1.0:1746065077.353143:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27822:x1830881261283328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 240us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.353148:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11794 00000100:00100000:1.0:1746065077.358746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.362853:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283584 00000100:00100000:0.0:1746065077.362865:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283584 00000100:00100000:0.0:1746065077.362911:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11795 00000100:00100000:0.0:1746065077.362919:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27822:x1830881261283584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.362935:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.362951:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460429 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92becf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.363034:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460430 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065077.363045:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460430 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.363054:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460430 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065077.363065:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 5 00010000:00010000:0.0:1746065077.363142:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460429 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92becf expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.363164:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460430 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92becf expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.363171:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:0.0:1746065077.363173:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065077.363175:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055200, rc 0) 00000100:00100000:0.0:1746065077.363216:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27822:x1830881261283584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 298us (4478us total) trans 4294975211 rc 0/0 00000100:00100000:0.0:1746065077.363222:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11795 00000100:00100000:0.0:1746065077.366762:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.368934:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.369031:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261283968 00000100:00100000:0.0:1746065077.369037:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261283968 00000100:00100000:0.0:1746065077.369073:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11797 00000100:00100000:0.0:1746065077.369079:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27824:x1830881261283968:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.369093:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.369106:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc146045a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bedd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.369158:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.369166:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369175:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369182:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.369187:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369191:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369220:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369224:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369229:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369237:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369241:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.369244:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369248:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369255:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:0.0:1746065077.369257:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.369259:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369263:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460461 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369283:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369287:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369291:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369294:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.369296:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369299:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369310:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:0.0:1746065077.369312:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.369314:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369317:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460468 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.369336:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc146045a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bedd expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.369342:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc146045a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bedd expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.369349:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055000, rc 0) 00000100:00100000:0.0:1746065077.369373:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27824:x1830881261283968:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 294us (442us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065077.369378:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11797 00000100:00100000:0.0:1746065077.373126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.373185:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284096 00000100:00100000:1.0:1746065077.373191:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284096 00002000:00100000:1.0:1746065077.373227:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x33d:0x0] (0->4) req@ffff88009c5f0700 x1830881261284096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:748/0 lens 496/0 e 0 to 0 dl 1746065088 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00000100:00100000:0.0:1746065077.373228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065077.373236:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881261284096 ext(0->4) 00010000:00010000:1.0:1746065077.373269:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 77 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.373280:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 77 pid: 3067 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746065077.373286:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f0700 00000100:00100000:1.0:1746065077.373313:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 210 00000100:00100000:1.0:1746065077.373319:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261284096:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:3.0:1746065077.377516:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284352 00000100:00100000:3.0:1746065077.377522:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284352 00010000:00010000:3.0:1746065077.377549:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 79 pid: 3067 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.377568:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3502 00000100:00100000:3.0:1746065077.377575:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+79:2004:x1830881261284352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.377596:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065077.377610:0:9565:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1746065077.377613:0:9565:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1746065077.377618:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 79 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.377626:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 79 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.377641:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14603a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beac expref: 79 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.377657:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.377658:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.377662:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.377669:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460453 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.377690:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065077.377722:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+78:2004:x1830881261284352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 147us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.377727:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3502 00000100:00100000:1.0:1746065077.387805:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.387864:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261284992 00000100:00100000:0.0:1746065077.387870:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261284992 00000100:00100000:3.0:1746065077.388040:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11801 00000100:00100000:3.0:1746065077.388048:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27824:x1830881261284992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.388066:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.388069:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065077.388088:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1460476 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bee4 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.388103:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065077.388111:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.388120:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1460499 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bef2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.388189:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.388198:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388205:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388213:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.388219:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388224:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:0.0:1746065077.388301:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975212 is committed 00000004:00080000:0.0:1746065077.388306:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1568 committed 00000004:00080000:0.0:1746065077.388311:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1558 committed 00000004:00080000:0.0:1746065077.388322:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1557 committed 00000004:00080000:0.0:1746065077.388325:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1567 committed 00000100:00100000:1.0:1746065077.388400:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065077.388412:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262594048:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.388450:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065077.388470:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14604ae lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.388476:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14604ae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388484:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14604ae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065077.388488:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00200000:3.0:1746065077.388492:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31b:0x0]: returning size 0 00000100:00100000:1.0:1746065077.388495:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262594176:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065077.388512:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065077.388514:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065077.388517:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388521:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388525:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388528:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.388530:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065077.388533:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262594176 00010000:00010000:3.0:1746065077.388534:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065077.388536:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262594176 00010000:00010000:3.0:1746065077.388539:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c600) 00010000:00010000:3.0:1746065077.388540:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.388542:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388546:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604a0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065077.388554:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099bd7b80 reply state ffff88008f49c000 transno 4294975213 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065077.388555:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8283 00000100:00100000:1.0:1746065077.388559:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+170:3760:x1830881262594176:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065077.388563:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.388568:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:3.0:1746065077.388570:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065077.388571:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065077.388600:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1460499 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bef2 expref: 267 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.388611:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14604ae lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bef2 expref: 266 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.388616:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88012d56c900) 00010000:00010000:3.0:1746065077.388618:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065077.388620:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104a00, rc 0) 00000100:00100000:3.0:1746065077.388648:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+267:27824:x1830881261284992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 601us (849us total) trans 4294975213 rc 0/0 00000100:00100000:3.0:1746065077.388654:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11801 00000100:00100000:0.0:1746065077.388686:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065077.388693:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262594304:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.388799:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.388829:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065077.388834:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262594432:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.388851:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.388866:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262594432 00000100:00100000:0.0:1746065077.388868:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262594432 00000100:00100000:0.0:1746065077.388883:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8285 00000100:00100000:0.0:1746065077.388887:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+205:3762:x1830881262594432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.388937:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+205:3762:x1830881262594432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 50us (86us total) trans 17179872418 rc 0/0 00000100:00100000:0.0:1746065077.388942:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8285 00000004:00080000:0.0:1746065077.388967:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137344700/2, rc 0, transno 17179872417 00000100:00100000:0.0:1746065077.388972:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262594304:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065077.388984:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137344a80/2, rc 0, transno 17179872418 00000100:00100000:0.0:1746065077.388987:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262594432:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.389113:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+171:3760:x1830881262594176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 553us (597us total) trans 21474839691 rc 0/0 00000100:00100000:1.0:1746065077.389123:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8283 00000004:00080000:1.0:1746065077.389146:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4000/2, rc 0, transno 21474839690 00000100:00100000:1.0:1746065077.389151:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262594048:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065077.389215:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4700/2, rc 0, transno 21474839691 00000100:00100000:3.0:1746065077.389218:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262594176:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065077.389228:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.389234:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.389239:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.389242:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.389245:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.389249:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.389256:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:1.0:1746065077.389258:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.389260:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.389264:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460492 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065077.390831:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.391380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.391438:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285376 00000100:00100000:3.0:1746065077.391441:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285376 00000100:00100000:3.0:1746065077.391459:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11803 00000100:00100000:3.0:1746065077.391464:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+268:27822:x1830881261285376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.391474:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.391481:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf00 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.391505:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 269 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.391514:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 269 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.391524:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:3.0:1746065077.391526:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065077.391528:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019d800, rc 0) 00000100:00100000:3.0:1746065077.391544:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+269:27822:x1830881261285376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.391548:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11803 00000100:00100000:0.0:1746065077.393364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.393420:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285504 00000100:00100000:3.0:1746065077.393424:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285504 00000100:00100000:3.0:1746065077.393449:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11804 00000100:00100000:3.0:1746065077.393455:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+269:27822:x1830881261285504:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.393466:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.393476:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14604d1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf07 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.393515:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14604d8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.393524:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14604d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.393532:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14604d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065077.393566:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31a:0x0]: returning size 5 00000004:00200000:3.0:1746065077.393570:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065077.393590:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14604d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.393609:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14604d1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf07 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.393620:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14604d8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf07 expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.393626:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:3.0:1746065077.393628:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065077.393630:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:3.0:1746065077.394419:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27822:x1830881261285504:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 962us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.394425:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11804 00000100:00100000:0.0:1746065077.394520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065077.394900:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.394906:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.394924:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31b:0x0]: returning size 0 00000004:00080000:0.0:1746065077.395051:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x33e:0x0], index 0: 0 00000004:00080000:0.0:1746065077.395056:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x33f:0x0], index 1: 0 00000004:00080000:0.0:1746065077.395060:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x340:0x0], index 1: 0 00000004:00080000:0.0:1746065077.395063:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x33f:0x0], index 0: 0 00010000:00010000:0.0:1746065077.395144:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395150:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395154:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395158:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abaca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.395161:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395166:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395172:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88012d56c900) 00010000:00010000:0.0:1746065077.395174:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065077.395176:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395180:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abaca00/0xad6b7ddc14604c3 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.395208:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc14604bc lrc: 1/0,0 mode: --/CR res: [0x240000403:0x31b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bef9 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.395214:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc14604bc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bef9 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.395223:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:0.0:1746065077.395254:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27824:x1830881261285248:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4179us (4426us total) trans 4294975214 rc 301/301 00000100:00100000:0.0:1746065077.395260:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11802 00000100:00100000:0.0:1746065077.396309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.396407:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261285760 00000100:00100000:1.0:1746065077.396412:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261285760 00000100:00100000:1.0:1746065077.396467:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8286 00000100:00100000:1.0:1746065077.396473:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+77:2004:x1830881261285760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.396485:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.396498:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf0e expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065077.396515:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x33d:0x0] initial LVB size: 5, mtime: 0x6812d6b5, atime: 0x0, ctime: 0x6812d6b5, blocks: 0x8 00010000:00010000:1.0:1746065077.396527:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.396529:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.396535:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 78 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065077.396545:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 78 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065077.396552:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a529400, rc 0) 00000100:00100000:1.0:1746065077.396591:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+78:2004:x1830881261285760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 118us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.396595:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8286 00000100:00100000:1.0:1746065077.398895:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286016 00000100:00100000:1.0:1746065077.398902:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286016 00000100:00100000:1.0:1746065077.398945:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4060 00000100:00100000:1.0:1746065077.398952:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27824:x1830881261286016:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065077.399153:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27824:x1830881261286016:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 200us (316us total) trans 4294975215 rc 0/0 00000100:00100000:1.0:1746065077.399159:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4060 00000100:00100000:0.0:1746065077.400281:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.400557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.400798:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286400 00000100:00100000:3.0:1746065077.400801:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286400 00000100:00100000:3.0:1746065077.400828:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4061 00000100:00100000:3.0:1746065077.400833:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+269:27824:x1830881261286400:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065077.400936:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27824:x1830881261286400:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 102us (378us total) trans 4294975216 rc 0/0 00000100:00100000:3.0:1746065077.400941:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4061 00000100:00100000:1.0:1746065077.405239:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286528 00000100:00100000:1.0:1746065077.405248:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286528 00000100:00100000:0.0:1746065077.405642:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.405661:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286784 00000100:00100000:0.0:1746065077.405664:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286784 00000100:00100000:0.0:1746065077.405692:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11805 00000100:00100000:0.0:1746065077.405698:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261286784:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.405717:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065077.405728:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8288 00000100:00100000:1.0:1746065077.405733:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+78:2007:x1830881261286528:12345-192.168.202.27@tcp:23:lfs.0 00010000:00010000:0.0:1746065077.405734:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604ed lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf15 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065077.405826:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+78:2007:x1830881261286528:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 91us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.405831:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8288 00010000:00010000:0.0:1746065077.405850:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.405860:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.405869:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.405878:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.405883:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.405888:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.405930:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460502 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.405935:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460502 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.405940:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460502 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.405947:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31b:0x0]: returning size 0 00010000:00010000:0.0:1746065077.406002:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406007:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406012:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406017:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406021:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.406024:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406028:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406036:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:0.0:1746065077.406039:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.406042:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406049:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc14604f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406056:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406060:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406064:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406067:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.406069:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406073:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406078:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:0.0:1746065077.406080:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.406082:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406086:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14604fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.406113:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14604ed lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf15 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.406124:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460502 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf15 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.406134:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065077.406135:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065077.406137:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abace00, rc 0) 00000100:00100000:0.0:1746065077.406168:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261286784:12345-192.168.202.27@tcp:101:bash.0 Request processed in 470us (526us total) trans 4294975217 rc 0/0 00000100:00100000:0.0:1746065077.406173:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11805 00000100:00100000:0.0:1746065077.409290:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287168 00000100:00100000:0.0:1746065077.409297:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287168 00000100:00100000:0.0:1746065077.409622:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261286912 00000100:00100000:0.0:1746065077.409625:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261286912 00000100:00100000:0.0:1746065077.409653:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11806 00000100:00100000:0.0:1746065077.409659:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27822:x1830881261287168:12345-192.168.202.27@tcp:36:lfs.0 00000100:00100000:3.0:1746065077.409678:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11807 00000100:00100000:3.0:1746065077.409684:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261286912:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065077.409694:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.409699:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.409706:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460510 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf1c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.409715:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14604d8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf07 expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.409725:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:3.0:1746065077.409726:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460517 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.409728:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.409734:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460517 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.409741:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460517 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.409744:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065077.409749:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.409753:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.409825:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460510 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf1c expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.409844:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460517 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf1c expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.409849:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065077.409851:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065077.409853:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000004:00010000:0.0:1746065077.410055:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925c8000 reply state ffff88009c237000 transno 4294975218 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.410064:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065077.410069:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:0.0:1746065077.410071:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065077.410073:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065077.410086:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261286912:12345-192.168.202.27@tcp:101:bash.0 Request processed in 401us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.410092:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11807 00000100:00100000:0.0:1746065077.410130:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27822:x1830881261287168:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 470us (1011us total) trans 4294975218 rc 0/0 00000100:00100000:0.0:1746065077.410134:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11806 00000100:00100000:0.0:1746065077.412456:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287296 00000100:00100000:0.0:1746065077.412463:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287296 00000100:00100000:0.0:1746065077.412502:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8289 00000100:00100000:0.0:1746065077.412508:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+78:2006:x1830881261287296:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065077.412622:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065077.412624:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:0.0:1746065077.412626:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb atime from disk: 0 -> 1746065077 00002000:00010000:0.0:1746065077.412628:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:0.0:1746065077.412629:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065077.412674:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+79:2006:x1830881261287296:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 166us (556us total) trans 17179872419 rc 0/0 00000100:00100000:0.0:1746065077.412679:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8289 00000100:00100000:0.0:1746065077.412930:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287552 00000100:00100000:0.0:1746065077.412933:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287552 00000100:00100000:0.0:1746065077.412958:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11808 00000100:00100000:0.0:1746065077.412962:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261287552:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:0.0:1746065077.412992:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.413010:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460502 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf15 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.413023:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065077.413026:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065077.413131:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065077.413142:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.413149:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:0.0:1746065077.413178:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975219 00000004:00010000:0.0:1746065077.413193:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129f40e00 reply state ffff88009c234000 transno 4294975220 ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.413199:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.413204:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065077.413207:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065077.413209:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065077.413256:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261287552:12345-192.168.202.27@tcp:36:bash.0 Request processed in 293us (482us total) trans 4294975220 rc 0/0 00000100:00100000:0.0:1746065077.413262:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11808 00000020:00080000:0.0:1746065077.413265:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065077.416081:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261287808 00000100:00100000:1.0:1746065077.416088:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261287808 00000100:00100000:1.0:1746065077.416205:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4062 00000100:00100000:1.0:1746065077.416212:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27822:x1830881261287808:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065077.416261:0:7207:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x31a:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460430 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92becf expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.416287:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:1.0:1746065077.416294:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.416301:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.416324:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.416332:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.416341:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262594688:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.416832:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.419467:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.419923:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262594688:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.419943:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065077.420383:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.420541:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288320 00000100:00100000:3.0:1746065077.420545:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288320 00010000:00010000:3.0:1746065077.420560:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 279 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.420592:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3504 00000100:00100000:3.0:1746065077.420597:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+279:2005:x1830881261288320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.420604:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.420607:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 279 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.420615:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 279 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.420731:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14604ca lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf00 expref: 279 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.420816:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:3.0:1746065077.420819:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.420825:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.420829:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.420853:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065077.420888:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+278:2005:x1830881261288320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 290us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.420893:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3504 00010000:00010000:0.0:1746065077.421114:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065077.421122:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000040:00080000:0.0:1746065077.422274:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2322, 88 off192736 00000004:00080000:0.0:1746065077.422282:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673440508495ns, next at 673314596215ns, rc = 0 00000040:00080000:0.0:1746065077.422298:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2318, 88 off192280 00000004:00080000:0.0:1746065077.422301:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673440527317ns, next at 673314574413ns, rc = 0 00000040:00080000:0.0:1746065077.422320:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2319, 88 off192368 00000004:00080000:0.0:1746065077.422322:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673440548890ns, next at 673314574413ns, rc = 0 00000040:00080000:0.0:1746065077.422330:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2323, 88 off192824 00000004:00080000:0.0:1746065077.422332:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673440558820ns, next at 673314596215ns, rc = 0 00000001:00080000:0.0:1746065077.422959:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975221 is committed 00000004:00080000:0.0:1746065077.422965:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1560 committed 00000004:00080000:0.0:1746065077.422978:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1570 committed 00010000:00010000:1.0:1746065077.423026:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.423034:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.423039:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.423043:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.423047:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.423052:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.423063:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:1.0:1746065077.423065:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.423068:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00080000:0.0:1746065077.423100:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1569 committed 00000004:00080000:0.0:1746065077.423102:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1559 committed 00000100:00100000:0.0:1746065077.423172:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262594816:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.423216:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065077.423274:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc14604a7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.423311:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423316:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423323:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423327:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.423330:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423334:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423341:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:1.0:1746065077.423343:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.423345:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423349:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc146051e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.423357:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.423362:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.423366:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.423370:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.423372:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.423376:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.423384:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:1.0:1746065077.423386:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.423388:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.423391:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460525 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065077.423736:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262594816 00000100:00100000:0.0:1746065077.423741:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262594816 00000100:00100000:0.0:1746065077.423767:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262594944 00000100:00100000:0.0:1746065077.423769:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262594944 00000100:00100000:1.0:1746065077.423870:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595072 00000100:00100000:1.0:1746065077.423873:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595072 00000100:00100000:0.0:1746065077.424217:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8290 00000100:00100000:0.0:1746065077.424224:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+172:3762:x1830881262594816:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.425195:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+173:3762:x1830881262594816:12345-0@lo:2:osp-syn-0-1.0 Request processed in 971us (1978us total) trans 21474839692 rc 0/0 00000100:00100000:0.0:1746065077.425200:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8290 00000100:00100000:0.0:1746065077.425214:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8291 00000100:00100000:0.0:1746065077.425219:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+172:3759:x1830881262594944:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.425272:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+173:3759:x1830881262594944:12345-0@lo:2:osp-syn-0-1.0 Request processed in 54us (1943us total) trans 21474839693 rc 0/0 00000100:00100000:0.0:1746065077.425277:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8291 00000100:00100000:0.0:1746065077.426448:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8292 00000100:00100000:0.0:1746065077.426462:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+205:3759:x1830881262595072:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.426573:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+206:3759:x1830881262595072:12345-0@lo:2:osp-syn-1-1.0 Request processed in 116us (3210us total) trans 17179872420 rc 0/0 00000100:00100000:1.0:1746065077.426785:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262595200:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.426822:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.426855:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595200 00000100:00100000:1.0:1746065077.426860:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595200 00000100:00100000:1.0:1746065077.426883:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8293 00000100:00100000:1.0:1746065077.426887:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+207:3761:x1830881262595200:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.426941:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+208:3761:x1830881262595200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 53us (119us total) trans 17179872421 rc 0/0 00000100:00100000:1.0:1746065077.426946:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8293 00000004:00080000:1.0:1746065077.426980:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137344000/2, rc 0, transno 17179872421 00000100:00100000:1.0:1746065077.426988:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262595200:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.427287:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8292 00000100:00100000:0.0:1746065077.428872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.435274:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262595328:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.435323:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.435370:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065077.435375:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262595456:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.435389:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.435407:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595328 00000100:00100000:3.0:1746065077.435412:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595328 00000100:00100000:3.0:1746065077.435435:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595456 00000100:00100000:3.0:1746065077.435437:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595456 00000100:00100000:3.0:1746065077.435448:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8295 00000100:00100000:3.0:1746065077.435453:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+208:3762:x1830881262595328:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065077.435556:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065077.435559:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.435561:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb atime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.435563:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.435565:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x33d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065077.435597:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+209:3762:x1830881262595328:12345-0@lo:2:osp-syn-1-1.0 Request processed in 143us (274us total) trans 17179872422 rc 0/0 00000100:00100000:3.0:1746065077.435602:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8295 00000100:00100000:3.0:1746065077.435615:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8296 00000100:00100000:3.0:1746065077.435619:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+208:3760:x1830881262595456:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.435666:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+209:3760:x1830881262595456:12345-0@lo:2:osp-syn-1-1.0 Request processed in 47us (276us total) trans 17179872423 rc 0/0 00000100:00100000:3.0:1746065077.435670:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8296 00000100:00100000:3.0:1746065077.435685:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262595584:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065077.435701:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065077.435724:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137344380/2, rc 0, transno 17179872423 00000100:00100000:3.0:1746065077.435728:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262595456:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.435729:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262595712:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065077.435740:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137345c00/2, rc 0, transno 17179872422 00000100:00100000:3.0:1746065077.435743:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262595328:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.435750:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.435754:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595584 00000100:00100000:3.0:1746065077.435756:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595584 00000100:00100000:3.0:1746065077.435767:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595712 00000100:00100000:3.0:1746065077.435769:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595712 00000100:00100000:3.0:1746065077.435791:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8297 00000100:00100000:3.0:1746065077.435794:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+174:3760:x1830881262595584:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065077.435848:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x33c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065077.435850:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x33c:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.435851:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x33c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065077.435853:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x33c:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.435854:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x33c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065077.435873:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+175:3760:x1830881262595584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (172us total) trans 21474839694 rc 0/0 00000100:00100000:3.0:1746065077.435877:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8297 00000100:00100000:3.0:1746065077.435885:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8298 00000100:00100000:3.0:1746065077.435889:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+174:3761:x1830881262595712:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065077.435944:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+175:3761:x1830881262595712:12345-0@lo:2:osp-syn-0-1.0 Request processed in 54us (193us total) trans 21474839695 rc 0/0 00000100:00100000:3.0:1746065077.435949:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8298 00000004:00080000:3.0:1746065077.435968:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e51880/2, rc 0, transno 21474839694 00000004:00080000:1.0:1746065077.435968:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e53480/2, rc 0, transno 21474839695 00000100:00100000:3.0:1746065077.435971:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262595584:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.435971:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262595712:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065077.437102:0:7207:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b4298c50 reply state ffff88008c533800 transno 4294975222 ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.437122:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.437129:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:1.0:1746065077.437131:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065077.437134:0:7207:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065077.437138:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:1.0:1746065077.437140:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065077.437145:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460430 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92becf expref: 265 pid: 7205 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065077.437217:0:7207:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065077.437233:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+265:27822:x1830881261287808:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 21022us (21198us total) trans 4294975222 rc 0/0 00000100:00100000:1.0:1746065077.437240:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4062 00010000:00010000:3.0:1746065077.437282:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.437294:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.437299:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.437304:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.437307:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.437312:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.437320:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff88009867e000) 00010000:00010000:3.0:1746065077.437322:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065077.437325:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.437329:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460533 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065077.437422:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288576 00000100:00100000:0.0:1746065077.437426:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288576 00000100:00100000:0.0:1746065077.437447:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8299 00000100:00100000:0.0:1746065077.437453:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+79:26180:x1830881261288576:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.437462:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.437474:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf38 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065077.437487:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065077.437501:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.437503:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.437509:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 80 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.437518:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 80 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.437529:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009555a000, rc 0) 00000100:00100000:0.0:1746065077.437544:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+80:26180:x1830881261288576:12345-192.168.202.27@tcp:101:bash.0 Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.437548:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8299 00000100:00100000:0.0:1746065077.440608:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.440852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.440916:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.440948:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288704 00000100:00100000:3.0:1746065077.440954:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288704 00002000:00010000:3.0:1746065077.440979:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/830 (0->18446744073709551615) 00002000:00100000:3.0:1746065077.440982:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51f80 with x1830881261288704 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065077.440990:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51f80. 00000100:00100000:3.0:1746065077.441661:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261288832 00000100:00100000:3.0:1746065077.441667:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261288832 00002000:00010000:3.0:1746065077.441681:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/831 (0->18446744073709551615) 00002000:00100000:3.0:1746065077.441683:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52300 with x1830881261288832 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065077.441689:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52300. 00000100:00100000:0.0:1746065077.447569:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.448156:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.448249:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261289216 00000100:00100000:3.0:1746065077.448256:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261289216 00000100:00100000:3.0:1746065077.448451:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261289472 00000100:00100000:3.0:1746065077.448454:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261289472 00000100:00100000:3.0:1746065077.448468:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4063 00000100:00100000:3.0:1746065077.448475:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+266:27822:x1830881261289216:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065077.448673:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x31a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065077.448727:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2324, 64 off192888 00000004:00080000:3.0:1746065077.448733:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673466958781ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065077.448752:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2320, 64 off192432 00000004:00080000:3.0:1746065077.448755:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673466981880ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065077.448763:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2321, 64 off192496 00000040:00080000:3.0:1746065077.448771:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2325, 64 off192952 00000100:00100000:1.0:1746065077.448856:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4064 00000100:00100000:1.0:1746065077.448864:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+266:26180:x1830881261289472:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065077.449009:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261289472:12345-192.168.202.27@tcp:35:bash.0 Request processed in 146us (854us total) trans 4294975223 rc 0/0 00000100:00100000:1.0:1746065077.449016:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4064 00010000:00010000:3.0:1746065077.449858:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065077.449870:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065077.449878:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065077.449884:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065077.449889:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065077.449894:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065077.450451:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065077.450820:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.450826:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.450832:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.450835:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.450840:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.450849:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31a:0x0].0x0 (ffff8800b53ea800) 00010000:00010000:0.0:1746065077.450852:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065077.450855:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 1/0,0 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.450858:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146055d lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.450871:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.450873:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.450874:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065077.451153:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+267:27822:x1830881261289216:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2675us (3588us total) trans 4294975224 rc 0/0 00000100:00100000:3.0:1746065077.451263:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4063 00000100:00100000:0.0:1746065077.468375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065077.468667:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468680:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.468685:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468690:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468797:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1460579 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.468804:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1460579 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468809:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1460579 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.468817:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31b:0x0]: returning size 5 00010000:00010000:2.0:1746065077.468876:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468881:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468885:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468889:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468893:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.468897:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468904:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468913:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090535300) 00010000:00010000:2.0:1746065077.468914:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.468917:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468921:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146056b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468948:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468952:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468956:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468959:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.468961:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468964:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468969:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880090535100) 00010000:00010000:2.0:1746065077.468971:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.468972:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.468976:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460572 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.469006:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc1460564 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf46 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.469018:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1460579 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf46 expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.469023:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.469024:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.469026:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000100:00100000:2.0:1746065077.469067:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27825:x1830881261289728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 553us (700us total) trans 4294975225 rc 0/0 00000100:00100000:2.0:1746065077.469073:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11812 00000100:00100000:0.0:1746065077.477972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.478095:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261289984 00000100:00100000:2.0:1746065077.478103:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261289984 00000100:00100000:2.0:1746065077.478140:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11813 00000100:00100000:2.0:1746065077.478146:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+269:27826:x1830881261289984:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065077.478192:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065077.478214:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1460541 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf2a expref: 269 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.478757:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1460579 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf46 expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.478771:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460517 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf1c expref: 267 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.478805:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.478816:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.478836:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.478845:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.478852:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.478861:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.478866:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.478870:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.478934:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.478939:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.478944:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:2.0:1746065077.479115:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x31b:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1746065077.479167:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479173:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479178:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479183:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.479186:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479192:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479197:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff880097b72300) 00010000:00010000:2.0:1746065077.479199:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065077.479202:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479205:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460595 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479216:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479220:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479224:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479228:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479231:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.479232:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479236:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479243:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abf00) 00010000:00010000:2.0:1746065077.479245:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.479247:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479250:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460587 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:2.0:1746065077.479257:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cfe680 reply state ffff88012be10000 transno 4294975226 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479262:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.479266:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:2.0:1746065077.479267:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065077.479269:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065077.479320:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+268:27826:x1830881261289984:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1173us (1354us total) trans 4294975226 rc 0/0 00000100:00100000:2.0:1746065077.479326:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11813 00000100:00100000:0.0:1746065077.486281:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.486329:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.486548:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290112 00000100:00100000:1.0:1746065077.486560:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290112 00000100:00100000:2.0:1746065077.486595:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290240 00000100:00100000:2.0:1746065077.486599:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290240 00000100:00100000:2.0:1746065077.487037:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11814 00000100:00100000:1.0:1746065077.487083:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11815 00000100:00100000:1.0:1746065077.487090:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27827:x1830881261290240:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065077.487111:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+269:27825:x1830881261290112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.487111:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.487117:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.487127:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc14605a3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf4d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.487127:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146059c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf54 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.487176:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.487178:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6c00/0xad6b7ddc14605b1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.487186:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6c00/0xad6b7ddc14605b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.487186:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.487195:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6c00/0xad6b7ddc14605b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.487195:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487203:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.487207:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487211:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.487226:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31b:0x0]: returning size 5 00000004:00200000:2.0:1746065077.487230:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1746065077.487239:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065077.487241:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6c00/0xad6b7ddc14605b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065077.487243:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487247:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487252:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487256:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.487258:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc14605a3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf4d expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.487259:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487267:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.487272:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6c00/0xad6b7ddc14605b1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf4d expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.487274:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fa00) 00010000:00010000:1.0:1746065077.487277:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.487278:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff880097b72500) 00010000:00010000:2.0:1746065077.487279:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065077.487280:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.487281:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6c00, rc 0) 00010000:00010000:1.0:1746065077.487284:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc14605aa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487294:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487298:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487302:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487305:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1bd3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.487306:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487310:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.487314:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:1.0:1746065077.487316:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.487318:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065077.487320:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27825:x1830881261290112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 239us (1047us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065077.487322:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14605b8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065077.487325:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11814 00010000:00010000:1.0:1746065077.487338:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146059c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf54 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.487343:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146059c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf54 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.487352:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9600, rc 0) 00000100:00100000:1.0:1746065077.487370:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27827:x1830881261290240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 282us (1041us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065077.487375:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11815 00000100:00100000:0.0:1746065077.491611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.491874:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290368 00000100:00100000:3.0:1746065077.491882:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290368 00000100:00100000:3.0:1746065077.491930:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11816 00000100:00100000:3.0:1746065077.491936:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+269:27827:x1830881261290368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.491952:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.491967:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc14605bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf5b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.491998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065077.492017:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.492028:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492041:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492048:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.492053:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492058:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492094:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492099:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492104:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492109:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492114:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.492117:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492122:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492131:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c000) 00010000:00010000:3.0:1746065077.492133:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.492136:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492140:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14605c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492153:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492157:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492161:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492165:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.492167:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492175:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492180:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:3.0:1746065077.492181:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.492183:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492187:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14605cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.492208:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc14605bf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf5b expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.492213:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc14605bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf5b expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.492224:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80a00, rc 0) 00000100:00100000:3.0:1746065077.492266:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+269:27827:x1830881261290368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 331us (662us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.492272:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11816 00000100:00100000:2.0:1746065077.492461:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290624 00000100:00100000:2.0:1746065077.492465:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290624 00000100:00100000:2.0:1746065077.492488:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4065 00000100:00100000:2.0:1746065077.492493:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+269:27825:x1830881261290624:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:2.0:1746065077.492650:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x31b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1746065077.492765:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2322, 64 off192560 00000040:00080000:2.0:1746065077.493854:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2326, 64 off193016 00000040:00080000:2.0:1746065077.493875:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2327, 64 off193080 00000040:00080000:2.0:1746065077.493886:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2323, 64 off192624 00010000:00010000:2.0:1746065077.493928:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065077.493937:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065077.493944:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065077.493950:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065077.493954:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065077.493958:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065077.493976:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065077.493995:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.494000:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.494005:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.494008:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.494012:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.494020:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31b:0x0].0x0 (ffff880097b72500) 00010000:00010000:0.0:1746065077.494022:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065077.494024:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.494028:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14605d4 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065077.494050:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.494052:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.494053:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065077.494089:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+270:27825:x1830881261290624:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1592us (2088us total) trans 4294975227 rc 0/0 00000100:00100000:2.0:1746065077.494095:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4065 00000100:00100000:0.0:1746065077.495096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.495143:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290752 00000100:00100000:1.0:1746065077.495149:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290752 00000100:00100000:1.0:1746065077.495189:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11817 00000100:00100000:1.0:1746065077.495196:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27827:x1830881261290752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.495209:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.495221:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14605db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf62 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.495260:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14605e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.495267:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14605e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.495274:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14605e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065077.495307:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065077.495311:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065077.495333:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14605db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf62 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.495355:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14605e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf62 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.495361:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f200) 00010000:00010000:1.0:1746065077.495363:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065077.495365:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5a00, rc 0) 00000100:00100000:1.0:1746065077.495392:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27827:x1830881261290752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 197us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.495397:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11817 00000100:00100000:0.0:1746065077.497200:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.497239:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261290880 00000100:00100000:3.0:1746065077.497245:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261290880 00000100:00100000:3.0:1746065077.497284:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11818 00000100:00100000:3.0:1746065077.497289:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27825:x1830881261290880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.497306:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.497318:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc14605e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf69 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.497363:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.497371:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497378:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497386:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.497390:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497394:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497424:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497429:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497434:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497439:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497444:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.497446:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497455:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497463:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f200) 00010000:00010000:3.0:1746065077.497466:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.497469:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497473:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc14605f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497482:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497486:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497491:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497495:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.497497:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497501:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497506:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:3.0:1746065077.497507:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.497509:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497513:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779600/0xad6b7ddc14605f7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.497532:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc14605e9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf69 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.497538:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc14605e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf69 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.497544:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abace00, rc 0) 00000100:00100000:3.0:1746065077.497594:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27825:x1830881261290880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 304us (399us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.497600:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11818 00000100:00100000:0.0:1746065077.509812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.509921:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291136 00000100:00100000:1.0:1746065077.509929:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291136 00000100:00100000:1.0:1746065077.509980:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11819 00000100:00100000:1.0:1746065077.509987:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27827:x1830881261291136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.510003:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.510006:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065077.510026:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14605e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf62 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.510050:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f200) 00010000:00010000:1.0:1746065077.510060:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.510069:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc14605fe lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf70 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.510159:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.510172:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510179:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510187:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.510192:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510197:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510476:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.510483:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510488:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065077.510496:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00010000:00010000:1.0:1746065077.510517:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510523:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510528:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510533:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510539:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.510542:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510548:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510555:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065077.510558:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.510560:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510565:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc1460605 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065077.510573:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cfd880 reply state ffff88009ade4000 transno 4294975228 ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510595:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.510600:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:1.0:1746065077.510602:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.510604:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065077.510623:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc14605fe lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.510636:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.510641:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065077.510644:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.510645:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055200, rc 0) 00000100:00100000:1.0:1746065077.510703:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27827:x1830881261291136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 716us (898us total) trans 4294975228 rc 0/0 00000100:00100000:1.0:1746065077.510709:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11819 00000100:00100000:0.0:1746065077.515443:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.515493:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.515689:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291392 00000100:00100000:1.0:1746065077.515697:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291392 00000100:00100000:3.0:1746065077.515724:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291648 00000100:00100000:3.0:1746065077.515727:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291648 00000100:00100000:1.0:1746065077.515745:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11820 00000100:00100000:1.0:1746065077.515751:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27827:x1830881261291392:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065077.515789:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11821 00010000:00010000:1.0:1746065077.515791:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065077.515795:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27829:x1830881261291648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.515800:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.515806:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460628 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf7e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.515806:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460621 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf77 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.515881:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.515881:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.515890:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.515898:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.515900:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.515905:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 2/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065077.515907:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00010000:00010000:1.0:1746065077.515909:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 5/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.515920:0:7203:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.515935:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.515947:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 277 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.515957:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262595840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.515976:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779200/0xad6b7ddc1460628 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.516002:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 277 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.516007:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 277 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.516012:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80a00, rc 0) 00000100:00100000:3.0:1746065077.516536:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27829:x1830881261291648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 739us (1041us total) trans 4294975229 rc 0/0 00000100:00100000:1.0:1746065077.516536:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065077.516541:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11821 00000100:00100000:1.0:1746065077.518108:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262595840:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.518124:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065077.518851:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.518938:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291776 00000100:00100000:3.0:1746065077.518943:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291776 00010000:00010000:3.0:1746065077.518967:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 277 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.518981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.519109:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261291904 00000100:00100000:3.0:1746065077.519113:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261291904 00010000:00010000:3.0:1746065077.519133:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 278 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.519149:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3505 00000100:00100000:3.0:1746065077.519155:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+278:2005:x1830881261291776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.519165:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.519169:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.519172:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3506 00010000:00010000:3.0:1746065077.519176:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.519178:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+278:2007:x1830881261291904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.519184:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.519186:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 278 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.519192:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80a00/0xad6b7ddc1460636 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf7e expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.519193:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 278 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.519202:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1460613 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf70 expref: 277 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.519203:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554fd00) 00010000:00010000:3.0:1746065077.519207:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.519213:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.519222:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.519393:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065077.519396:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065077.519429:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+276:2007:x1830881261291904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 251us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.519434:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3506 00010000:00010000:3.0:1746065077.519537:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.519561:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.519567:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065077.519597:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00000100:00100000:3.0:1746065077.519816:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+275:2005:x1830881261291776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 660us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.519822:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3505 00000004:00080000:1.0:1746065077.520216:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x341:0x0], index 1: 0 00000004:00080000:1.0:1746065077.520225:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x340:0x0], index 0: 0 00000004:00080000:1.0:1746065077.520228:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x341:0x0], index 0: 0 00000004:00080000:1.0:1746065077.520231:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x342:0x0], index 1: 0 00010000:00010000:1.0:1746065077.520399:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520406:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520411:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520420:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.520423:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520428:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520436:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065077.520439:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.520441:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520445:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc146062f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.520484:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460621 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf77 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.520491:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460621 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf77 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.520504:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5a00, rc 0) 00000100:00100000:1.0:1746065077.520539:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27827:x1830881261291392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4787us (5104us total) trans 4294975230 rc 301/301 00000100:00100000:1.0:1746065077.520545:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11820 00000100:00100000:2.0:1746065077.522105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.522167:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292160 00000100:00100000:0.0:1746065077.522173:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292160 00000100:00100000:0.0:1746065077.522353:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4066 00000100:00100000:0.0:1746065077.522361:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27827:x1830881261292160:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065077.523231:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27827:x1830881261292160:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 869us (1128us total) trans 4294975231 rc 0/0 00000100:00100000:0.0:1746065077.523238:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4066 00000100:00100000:2.0:1746065077.526180:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.526214:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.526263:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292416 00000100:00100000:0.0:1746065077.526269:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292416 00000100:00100000:1.0:1746065077.526593:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292544 00000100:00100000:1.0:1746065077.526597:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292544 00000100:00100000:1.0:1746065077.526623:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11822 00000100:00100000:1.0:1746065077.526630:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27829:x1830881261292544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.526649:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.526666:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc146064b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf85 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.526737:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460652 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065077.526746:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460652 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.526755:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460652 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065077.526797:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00000004:00200000:1.0:1746065077.526801:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065077.526813:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460652 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.526833:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc146064b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf85 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.526856:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460652 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf85 expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.526863:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065077.526865:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.526868:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00000100:00100000:1.0:1746065077.526903:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27829:x1830881261292544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 274us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.526909:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11822 00000100:00100000:0.0:1746065077.526984:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4067 00000100:00100000:0.0:1746065077.526990:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27827:x1830881261292416:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065077.527089:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27827:x1830881261292416:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 98us (915us total) trans 4294975232 rc 0/0 00000100:00100000:0.0:1746065077.527094:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4067 00000100:00100000:2.0:1746065077.530638:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.530682:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.530759:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292672 00000100:00100000:3.0:1746065077.530766:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292672 00000100:00100000:0.0:1746065077.530798:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.530811:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261292800 00000100:00100000:3.0:1746065077.530813:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261292800 00000100:00100000:3.0:1746065077.530832:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8300 00000100:00100000:3.0:1746065077.530838:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+71:2007:x1830881261292672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.530851:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.530866:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf8c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065077.530886:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065077.530902:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.530905:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.530911:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 72 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.530927:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 72 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.530935:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96600, rc 0) 00000100:00100000:3.0:1746065077.530986:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+72:2007:x1830881261292672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.530992:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8300 00000100:00100000:2.0:1746065077.530997:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293056 00000100:00100000:2.0:1746065077.531000:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293056 00000100:00100000:3.0:1746065077.531005:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8301 00000100:00100000:3.0:1746065077.531009:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+81:2007:x1830881261292800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.531015:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065077.531020:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11823 00010000:00010000:3.0:1746065077.531024:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf93 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.531024:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261293056:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.531033:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746065077.531034:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065077.531041:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.531042:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.531042:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460667 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bf9a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.531045:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 82 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.531052:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 82 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.531058:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:3.0:1746065077.531071:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+82:2007:x1830881261292800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 62us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.531075:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8301 00010000:00010000:2.0:1746065077.531136:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.531149:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531156:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531164:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.531169:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531173:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531210:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146067c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.531217:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146067c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531222:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146067c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065077.531229:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00010000:00010000:2.0:1746065077.531283:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531289:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531294:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531299:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531304:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.531307:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531316:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531325:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72600) 00010000:00010000:2.0:1746065077.531327:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.531330:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531334:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc146066e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531357:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531362:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531366:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531370:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.531372:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531377:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531383:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:2.0:1746065077.531385:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.531387:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531391:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460675 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.531416:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1460667 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf9a expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.531426:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146067c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf9a expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.531431:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.531432:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.531434:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7000, rc 0) 00000100:00100000:2.0:1746065077.531462:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261293056:12345-192.168.202.27@tcp:101:bash.0 Request processed in 437us (664us total) trans 4294975233 rc 0/0 00000100:00100000:2.0:1746065077.531467:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11823 00000100:00100000:1.0:1746065077.533245:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065077.533261:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262595968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065077.533395:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065077.533497:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595968 00000100:00100000:2.0:1746065077.533502:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595968 00000100:00100000:2.0:1746065077.533533:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1746065077.533538:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+209:3761:x1830881262595968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746065077.533555:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490365888 pending 229376 free 3920257024 avail 3688734720 00000100:00100000:2.0:1746065077.533594:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+209:3761:x1830881262595968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.533600:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1746065077.533828:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262595968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065077.534015:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.534033:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293184 00000100:00100000:2.0:1746065077.534034:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.534036:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293184 00000100:00100000:3.0:1746065077.534097:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293568 00000100:00100000:3.0:1746065077.534100:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293568 00000100:00100000:2.0:1746065077.534109:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.534120:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4068 00000100:00100000:3.0:1746065077.534124:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27829:x1830881261293568:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065077.534157:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11824 00000100:00100000:0.0:1746065077.534162:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261293184:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:3.0:1746065077.534390:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27829:x1830881261293568:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 264us (354us total) trans 4294975234 rc 0/0 00000100:00100000:3.0:1746065077.534396:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4068 00000100:00100000:3.0:1746065077.534432:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293312 00000100:00100000:3.0:1746065077.534435:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293312 00010000:00010000:0.0:1746065077.534473:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.534484:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b000/0xad6b7ddc146068a lrc: 2/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfa1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.534507:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.534520:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.534529:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065077.534546:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 538 00000100:00100000:3.0:1746065077.534553:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+282:2004:x1830881261293312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.534558:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.534569:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146067c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf9a expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.534589:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065077.534590:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b000/0xad6b7ddc146068a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.534593:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065077.534599:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.534605:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00000100:00100000:3.0:1746065077.534607:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+281:2004:x1830881261293312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (498us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065077.534607:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065077.534608:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009555a400, rc 0) 00000100:00100000:3.0:1746065077.534612:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 538 00000100:00100000:0.0:1746065077.534636:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261293184:12345-192.168.202.27@tcp:101:bash.0 Request processed in 474us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.534640:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11824 00000100:00100000:0.0:1746065077.536289:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.536473:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261293824 00000100:00100000:2.0:1746065077.536479:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261293824 00000100:00100000:0.0:1746065077.536498:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.536513:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294080 00000100:00100000:2.0:1746065077.536515:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294080 00000100:00100000:2.0:1746065077.536528:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11825 00000100:00100000:0.0:1746065077.536533:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11826 00000100:00100000:2.0:1746065077.536534:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261293824:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:0.0:1746065077.536538:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27829:x1830881261294080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.536559:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.536572:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1460698 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfa8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.536589:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.536602:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1460652 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf85 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.536613:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.536616:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065077.536632:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.536640:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.536646:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.536653:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.536658:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.536662:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.536720:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.536721:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14606b4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065077.536726:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.536731:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065077.536758:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975235 00000004:00010000:2.0:1746065077.536800:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cfea00 reply state ffff88012be15000 transno 4294975236 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.537337:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14606b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.537345:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14606b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.537354:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00010000:00010000:2.0:1746065077.540826:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.540839:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.540841:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065077.540845:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065077.540970:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261293824:12345-192.168.202.27@tcp:36:bash.0 Request processed in 4432us (4682us total) trans 4294975236 rc 0/0 00000100:00100000:2.0:1746065077.540978:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11825 00000020:00080000:2.0:1746065077.540983:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1746065077.541341:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541349:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541357:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541362:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541366:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.541369:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541374:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541382:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065077.541384:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.541386:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541478:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146069f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541489:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541493:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541496:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541500:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.541502:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541509:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541515:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:0.0:1746065077.541517:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.541519:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541523:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc14606a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.541554:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1460698 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa8 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.541574:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14606b4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa8 expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.541591:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065077.541592:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:0.0:1746065077.541595:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:0.0:1746065077.543333:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27829:x1830881261294080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6788us (6827us total) trans 4294975237 rc 0/0 00000100:00100000:0.0:1746065077.543341:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11826 00000100:00100000:2.0:1746065077.543588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.543622:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294208 00000100:00100000:0.0:1746065077.543629:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294208 00000100:00100000:0.0:1746065077.543668:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11827 00000100:00100000:0.0:1746065077.543674:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261294208:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065077.543693:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.543706:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14606c2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfaf expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.543749:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14606c2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfaf expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.543759:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14606c2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfaf expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.543792:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065077.543795:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065077.543797:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8600, rc 0) 00000100:00100000:0.0:1746065077.543832:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261294208:12345-192.168.202.27@tcp:101:bash.0 Request processed in 158us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.543837:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11827 00000100:00100000:0.0:1746065077.544450:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.544482:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294336 00000100:00100000:2.0:1746065077.544485:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294336 00000100:00100000:2.0:1746065077.544505:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11828 00000100:00100000:2.0:1746065077.544510:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27829:x1830881261294336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.544519:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.544528:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc14606c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfb6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.544572:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.544589:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.544597:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.544632:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 0 00000004:00200000:2.0:1746065077.544636:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065077.544648:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.544655:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.544675:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc14606c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.544687:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.544698:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.544700:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.544702:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6400, rc 0) 00000100:00100000:2.0:1746065077.544736:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27829:x1830881261294336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 226us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.544741:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11828 00000100:00100000:0.0:1746065077.545453:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.545487:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294592 00000100:00100000:2.0:1746065077.545491:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294592 00000100:00100000:2.0:1746065077.545520:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11829 00000100:00100000:2.0:1746065077.545526:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261294592:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.545534:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.545536:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746065077.545547:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14606c2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfaf expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.545560:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14606b4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa8 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.545567:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.545570:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.545586:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14606d7 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfbd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.545609:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.545617:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.545623:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.545643:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.545652:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 285 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.545661:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262596096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.545736:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.546668:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262596096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.546685:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065077.547121:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.547182:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294720 00000100:00100000:0.0:1746065077.547186:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294720 00010000:00010000:0.0:1746065077.547204:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 286 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.547230:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3507 00000100:00100000:0.0:1746065077.547235:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+286:2005:x1830881261294720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.547242:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.547246:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 286 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.547254:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 286 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.547266:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14606d0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfb6 expref: 286 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.547277:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065077.547281:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.547288:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.547293:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.547305:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065077.547340:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+285:2005:x1830881261294720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.547347:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3507 00010000:00010000:2.0:1746065077.547505:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.547511:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065077.548022:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.548111:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294848 00000100:00100000:1.0:1746065077.548115:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294848 00000100:00100000:1.0:1746065077.548138:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11830 00000100:00100000:1.0:1746065077.548143:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27829:x1830881261294848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.548154:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.548162:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfc4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.548192:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.548198:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 4/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.548209:0:7204:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.548217:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.548225:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065077.548228:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065077.548231:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.548237:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6a00, rc 0) 00000100:00100000:1.0:1746065077.548257:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27829:x1830881261294848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 114us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.548262:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11830 00000040:00080000:2.0:1746065077.549217:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2328, 88 off193168 00000004:00080000:2.0:1746065077.549223:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673567448902ns, next at 674466957028ns, rc = 0 00000040:00080000:2.0:1746065077.549249:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2324, 88 off192712 00000004:00080000:2.0:1746065077.549251:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673567477779ns, next at 674466981116ns, rc = 0 00000040:00080000:2.0:1746065077.549260:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2325, 88 off192800 00000004:00080000:2.0:1746065077.549263:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673567489388ns, next at 674466981116ns, rc = 0 00000040:00080000:2.0:1746065077.549271:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2329, 88 off193256 00000004:00080000:2.0:1746065077.549273:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673567499590ns, next at 674466957028ns, rc = 0 00000001:00080000:0.0:1746065077.550349:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975238 is committed 00000004:00080000:0.0:1746065077.550356:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1575 committed 00000004:00080000:0.0:1746065077.550371:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1565 committed 00000004:00080000:0.0:1746065077.550379:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1564 committed 00000004:00080000:0.0:1746065077.550380:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1574 committed 00000004:00080000:0.0:1746065077.550405:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1563 committed 00000004:00080000:0.0:1746065077.550406:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1573 committed 00010000:00010000:3.0:1746065077.550499:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.550508:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065077.550557:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596224:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065077.550558:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.550563:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.550566:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.550571:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.550609:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:3.0:1746065077.550612:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.550615:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.550619:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7400/0xad6b7ddc146058e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065077.550624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065077.550634:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.550638:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.550642:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065077.550643:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596736:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065077.550646:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.550648:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.550653:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065077.550656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065077.550659:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abc00) 00010000:00010000:3.0:1746065077.550660:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.550663:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.550666:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc146060c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065077.550668:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065077.550672:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596352:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065077.550678:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.550683:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065077.550684:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065077.550687:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.550691:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.550693:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065077.550693:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596864:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065077.550697:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.550702:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00000100:00100000:2.0:1746065077.550703:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065077.550704:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.550707:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.550711:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc14606ad lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065077.550720:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596224 00000100:00100000:2.0:1746065077.550725:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596224 00000100:00100000:3.0:1746065077.550726:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596736 00000100:00100000:3.0:1746065077.550729:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596736 00000100:00100000:3.0:1746065077.550747:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596352 00000100:00100000:3.0:1746065077.550748:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596352 00000100:00100000:0.0:1746065077.550787:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262596480:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.550809:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.551071:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065077.551076:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262596608:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.551090:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065077.551104:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596864 00000100:00100000:2.0:1746065077.551107:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596864 00000100:00100000:2.0:1746065077.551121:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596480 00000100:00100000:2.0:1746065077.551122:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596480 00000100:00100000:2.0:1746065077.551134:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8302 00000100:00100000:2.0:1746065077.551139:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+212:3759:x1830881262596736:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065077.551245:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+213:3759:x1830881262596736:12345-0@lo:2:osp-syn-1-1.0 Request processed in 105us (587us total) trans 17179872425 rc 0/0 00000100:00100000:2.0:1746065077.551251:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8302 00000100:00100000:2.0:1746065077.551263:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8303 00000100:00100000:2.0:1746065077.551267:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+212:3759:x1830881262596224:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.551271:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8304 00000100:00100000:1.0:1746065077.551277:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+212:3759:x1830881262596864:12345-0@lo:2:osp-syn-1-1.0 00002000:00080000:2.0:1746065077.551279:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:829 count 1 00010000:00010000:2.0:1746065077.551290:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065077.551320:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x342:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065077.551322:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x342:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.551324:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x342:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.551325:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x342:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.551327:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x342:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065077.551346:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+213:3759:x1830881262596864:12345-0@lo:2:osp-syn-1-1.0 Request processed in 69us (641us total) trans 17179872426 rc 0/0 00000100:00100000:1.0:1746065077.551350:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8304 00000100:00100000:1.0:1746065077.551360:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8305 00000100:00100000:1.0:1746065077.551363:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+212:3761:x1830881262596480:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065077.551371:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:831 count 1 00010000:00010000:1.0:1746065077.551378:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551390:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 81 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551396:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065077.551398:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065077.551400:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551418:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 81 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551428:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 81 pid: 3067 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.551436:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262596992:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.551478:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.551521:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597120:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.551531:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596608 00000100:00100000:1.0:1746065077.551533:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596608 00000100:00100000:0.0:1746065077.551538:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.551546:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8306 00000100:00100000:0.0:1746065077.551549:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597632:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.551550:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+213:3761:x1830881262596608:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065077.551558:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:832 count 1 00000100:00100000:0.0:1746065077.551560:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.551567:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00002000:00010000:1.0:1746065077.551570:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1746065077.551570:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597248:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065077.551574:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551589:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.551591:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.551594:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.551596:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.551602:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597760:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065077.551603:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551609:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.551613:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065077.551615:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.551626:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065077.551628:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.551632:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.551637:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.551640:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.551645:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.551654:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.551660:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc14606fa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.551674:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.551676:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.551677:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065077.551685:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597120 00000100:00100000:3.0:1746065077.551687:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597120 00000100:00100000:3.0:1746065077.551697:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597632 00000100:00100000:3.0:1746065077.551699:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597632 00000100:00100000:3.0:1746065077.551704:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597248 00000100:00100000:3.0:1746065077.551705:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597248 00010000:00010000:2.0:1746065077.551708:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 81 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065077.551710:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597760 00000100:00100000:3.0:1746065077.551712:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597760 00010000:00010000:2.0:1746065077.551713:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.551715:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.551717:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.551718:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8307 00000100:00100000:3.0:1746065077.551721:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+214:3759:x1830881262596352:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065077.551729:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:830 count 1 00010000:00010000:2.0:1746065077.551730:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 81 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.551737:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 81 pid: 3068 timeout: 773 lvb_type: 1 00002000:00010000:3.0:1746065077.551740:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065077.551743:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.551744:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262597888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.551749:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.551750:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.551752:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.551759:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.551760:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065077.551765:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.551770:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.551789:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8308 00000100:00100000:2.0:1746065077.551794:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+178:3761:x1830881262597120:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065077.551797:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1746065077.551804:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:828 count 1 00010000:00010000:2.0:1746065077.551815:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.551824:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 71 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.551829:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065077.551830:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065077.551832:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.551846:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 71 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.551853:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 71 pid: 11461 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.551860:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262598016:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.551880:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.551892:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8309 00000100:00100000:3.0:1746065077.551893:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+215:3759:x1830881262596352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 171us (1208us total) trans 17179872427 rc 0/0 00000100:00100000:2.0:1746065077.551896:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+178:3761:x1830881262597632:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065077.551898:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8307 00000100:00100000:3.0:1746065077.551906:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8310 00000100:00100000:3.0:1746065077.551909:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+178:3761:x1830881262597248:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065077.551915:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:829 count 1 00002000:00010000:3.0:1746065077.551925:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065077.551928:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.551934:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.551935:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.551937:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.551944:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.551949:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.551955:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.551959:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+179:3761:x1830881262597632:12345-0@lo:2:osp-syn-0-1.0 Request processed in 63us (397us total) trans 21474839697 rc 0/0 00010000:00010000:3.0:1746065077.551963:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065077.551963:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8309 00000100:00100000:2.0:1746065077.551972:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8311 00000100:00100000:2.0:1746065077.551976:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+178:3761:x1830881262597760:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065077.552006:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x341:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065077.552007:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x341:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.552009:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x341:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.552010:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x341:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.552012:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x341:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065077.552028:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+180:3761:x1830881262597760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 52us (414us total) trans 21474839699 rc 0/0 00000100:00100000:3.0:1746065077.552031:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+180:3761:x1830881262597248:12345-0@lo:6:osp-syn-0-1.0 Request processed in 122us (435us total) trans 21474839698 rc 0/0 00000100:00100000:2.0:1746065077.552033:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8311 00000100:00100000:3.0:1746065077.552035:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8310 00000100:00100000:2.0:1746065077.552047:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262597376:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.552062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065077.552083:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098662d80/2, rc 0, transno 17179872427 00000100:00100000:2.0:1746065077.552087:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596352:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065077.552094:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098663480/2, rc 0, transno 17179872426 00000100:00100000:2.0:1746065077.552096:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596864:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065077.552101:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098661880/2, rc 0, transno 17179872425 00000100:00100000:2.0:1746065077.552104:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596736:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065077.552110:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065077.552113:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262597504:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.552127:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065077.552165:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.552172:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.552174:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065077.552177:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.552185:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.552190:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.552206:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.552218:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262598144:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065077.552235:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065077.552280:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065077.552284:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552290:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.552293:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552299:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552307:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552313:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460701 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552323:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.552325:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552329:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.552331:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552339:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552345:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552350:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc146070f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552357:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.552358:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.552359:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.552363:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065077.552378:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc380/2, rc 0, transno 21474839698 00000100:00100000:0.0:1746065077.552381:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597248:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1746065077.552387:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fe300/2, rc 0, transno 21474839699 00000100:00100000:0.0:1746065077.552390:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597760:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065077.552395:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fe680/2, rc 0, transno 21474839697 00000100:00100000:0.0:1746065077.552397:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597632:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.552634:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+215:3761:x1830881262596608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1083us (1542us total) trans 17179872428 rc 0/0 00000004:00080000:0.0:1746065077.552638:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098661c00/2, rc 0, transno 17179872428 00000100:00100000:1.0:1746065077.552640:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8306 00000100:00100000:0.0:1746065077.552641:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262596608:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.552649:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597376 00000100:00100000:1.0:1746065077.552651:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597376 00000100:00100000:1.0:1746065077.552662:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597504 00000100:00100000:1.0:1746065077.552663:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597504 00000100:00100000:1.0:1746065077.552670:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8312 00000100:00100000:1.0:1746065077.552673:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+180:3759:x1830881262597376:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065077.552681:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:830 count 1 00010000:00010000:1.0:1746065077.552688:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552696:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 71 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552701:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065077.552702:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065077.552704:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552715:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 71 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552721:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 71 pid: 1880 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.552732:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262598272:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.552748:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065077.552758:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8313 00000100:00100000:1.0:1746065077.552762:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+180:3759:x1830881262597504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065077.552768:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:831 count 1 00002000:00010000:1.0:1746065077.552794:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065077.552798:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552803:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.552804:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.552806:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552813:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552818:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552822:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.552836:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065077.552838:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.552841:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552850:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.552853:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552859:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552867:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552873:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146071d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.552882:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.552883:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.552885:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065077.552905:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+181:3759:x1830881262597504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 142us (777us total) trans 21474839700 rc 0/0 00000100:00100000:1.0:1746065077.552913:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8313 00000004:00080000:2.0:1746065077.553221:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc700/2, rc 0, transno 21474839700 00000100:00100000:2.0:1746065077.553225:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262597504:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.555061:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262597888:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.555081:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.555103:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262598144:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065077.555126:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14606d7 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 268 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065077.555140:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 267 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.555156:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262598016:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.555163:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00010000:00010000:3.0:1746065077.555167:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.555192:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261294592:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9666us (9740us total) trans 4294975238 rc 0/0 00000100:00100000:2.0:1746065077.555199:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11829 00000100:00100000:1.0:1746065077.555550:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262598272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.555564:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065077.555595:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262596992:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.555605:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.555637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.555662:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.555685:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.555697:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.555713:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295360 00000100:00100000:0.0:1746065077.555717:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295360 00010000:00010000:0.0:1746065077.555737:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 72 pid: 1880 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.555764:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261294976 00000100:00100000:0.0:1746065077.555766:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261294976 00010000:00010000:0.0:1746065077.555803:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 82 pid: 3067 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.555814:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295232 00000100:00100000:0.0:1746065077.555816:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295232 00010000:00010000:0.0:1746065077.555825:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 73 pid: 11461 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.555832:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295104 00000100:00100000:0.0:1746065077.555834:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295104 00010000:00010000:0.0:1746065077.555841:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 83 pid: 3068 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746065077.555849:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3508 00000100:00100000:0.0:1746065077.555854:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+73:2007:x1830881261295360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.555863:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.555867:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 73 pid: 1880 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.555875:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 73 pid: 1880 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.555879:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3509 00000100:00100000:1.0:1746065077.555884:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261294976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.555889:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1460548 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf31 expref: 73 pid: 1880 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.555890:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.555893:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 83 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.555898:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.555900:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 83 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.555900:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.555903:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.555910:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009555a000/0xad6b7ddc146054f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf38 expref: 83 pid: 3067 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.555914:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.555918:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.555919:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.555921:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.555928:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.555929:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.555938:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065077.555943:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+72:2007:x1830881261295360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.555948:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3508 00000100:00100000:1.0:1746065077.555949:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+82:2005:x1830881261294976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.555953:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3509 00000100:00100000:0.0:1746065077.555958:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3510 00000100:00100000:1.0:1746065077.555962:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3511 00000100:00100000:0.0:1746065077.555962:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261295232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065077.555965:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+81:2007:x1830881261295104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.555967:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.555970:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.555970:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 71 pid: 11461 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.555973:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 81 pid: 3068 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746065077.555977:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 71 pid: 11461 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.555980:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 81 pid: 3068 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746065077.555986:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc14603d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92beb3 expref: 71 pid: 11461 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.555988:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a529400/0xad6b7ddc14604e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x33d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf0e expref: 81 pid: 3068 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746065077.555992:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.555994:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.555994:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.555995:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.555996:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.555997:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.556001:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556003:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556015:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065077.556015:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.556025:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+80:2007:x1830881261295104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.556025:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+70:2004:x1830881261295232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.556030:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3511 00010000:00010000:1.0:1746065077.556044:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556050:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556057:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556059:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556064:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556065:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556070:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556075:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556075:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065077.556083:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065077.556225:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+182:3761:x1830881262597120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4432us (4686us total) trans 21474839702 rc 0/0 00000100:00100000:1.0:1746065077.556225:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+182:3759:x1830881262597376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3550us (4162us total) trans 21474839701 rc 0/0 00000100:00100000:3.0:1746065077.556232:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8308 00000004:00080000:3.0:1746065077.556267:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd880/2, rc 0, transno 21474839702 00000100:00100000:3.0:1746065077.556272:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262597120:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065077.556337:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fed80/2, rc 0, transno 21474839701 00000100:00100000:2.0:1746065077.556341:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262597376:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065077.556354:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.556363:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.556369:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.556373:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.556383:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1746065077.556536:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+215:3759:x1830881262596224:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5267us (5911us total) trans 17179872429 rc 0/0 00010000:00010000:3.0:1746065077.556734:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1746065077.556740:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556747:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.556749:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556755:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556766:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556770:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131055200/0xad6b7ddc1460716 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556801:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065077.556804:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556808:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.556810:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556816:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556822:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556830:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1460708 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556838:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065077.556841:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556845:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.556847:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556852:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556859:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556864:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc14606ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.556873:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065077.556875:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065077.556876:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065077.556924:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8312 00010000:00010000:1.0:1746065077.556940:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.556946:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556952:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556962:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556967:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.556975:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065077.557052:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+216:3761:x1830881262596480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5687us (6241us total) trans 17179872430 rc 0/0 00000100:00100000:1.0:1746065077.557057:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8305 00000100:00100000:0.0:1746065077.557175:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3510 00010000:00010000:0.0:1746065077.557191:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065077.557195:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.557200:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.557202:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.557208:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.557216:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.557221:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc14606f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.557231:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.557233:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.557234:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.557368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.557418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.557524:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295488 00000100:00100000:1.0:1746065077.557528:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295488 00000100:00100000:1.0:1746065077.557548:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295616 00000100:00100000:1.0:1746065077.557550:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295616 00000100:00100000:1.0:1746065077.557560:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4069 00000100:00100000:1.0:1746065077.557564:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+268:27829:x1830881261295488:12345-192.168.202.27@tcp:49:lfs.0 00000100:00100000:2.0:1746065077.557628:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8303 00000004:00080000:2.0:1746065077.557733:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098660a80/2, rc 0, transno 17179872429 00000100:00100000:2.0:1746065077.557737:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262596224:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.558171:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+268:27829:x1830881261295488:12345-192.168.202.27@tcp:49:lfs.0 Request processed in 605us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.558177:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4069 00000100:00100000:1.0:1746065077.558188:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4070 00000100:00100000:1.0:1746065077.558193:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261295616:12345-192.168.202.27@tcp:49:bash.0 00000100:00100000:1.0:1746065077.558225:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+267:26180:x1830881261295616:12345-192.168.202.27@tcp:49:bash.0 Request processed in 32us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.558229:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4070 00010000:00010000:3.0:1746065077.558814:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065077.558838:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098662a00/2, rc 0, transno 17179872430 00000100:00100000:3.0:1746065077.558843:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262596480:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.560888:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.561458:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.561501:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295744 00000100:00100000:1.0:1746065077.561507:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295744 00000100:00100000:1.0:1746065077.561536:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261295872 00000100:00100000:1.0:1746065077.561537:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261295872 00000100:00100000:0.0:1746065077.561546:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8314 00000100:00100000:0.0:1746065077.561554:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+81:26180:x1830881261295744:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065077.561559:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8315 00000100:00100000:1.0:1746065077.561563:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+81:2006:x1830881261295872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.561567:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.561568:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.561590:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460724 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfd2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.561592:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfcb expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065077.561609:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065077.561683:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.561685:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065077.561691:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 83 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.561704:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 83 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.561712:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:1.0:1746065077.561721:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262598400:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065077.561793:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+83:26180:x1830881261295744:12345-192.168.202.27@tcp:101:bash.0 Request processed in 220us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.561799:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8314 00000100:00100000:1.0:1746065077.561983:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.564024:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065077.564118:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb mtime: 0 -> 1746065077 00002000:00010000:1.0:1746065077.564122:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb atime: 0 -> 1746065077 00002000:00010000:1.0:1746065077.564124:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb ctime: 0 -> 1746065077 00000100:00100000:1.0:1746065077.564138:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262598400:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065077.564162:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460724 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd2 expref: 82 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065077.564172:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296000 00010000:00010000:1.0:1746065077.564173:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31c00/0xad6b7ddc1460724 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd2 expref: 82 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065077.564177:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296000 00010000:00010000:1.0:1746065077.564182:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31c00, rc 0) 00000100:00100000:1.0:1746065077.564212:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+81:2006:x1830881261295872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2647us (2755us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.564218:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8316 00000100:00100000:2.0:1746065077.564224:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+70:26180:x1830881261296000:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065077.564224:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8315 00010000:00010000:2.0:1746065077.564234:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.564246:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfd9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065077.564494:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065077.564508:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.564510:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.564515:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 71 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.564525:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 71 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.564532:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00000100:00100000:2.0:1746065077.564552:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+71:26180:x1830881261296000:12345-192.168.202.27@tcp:101:bash.0 Request processed in 329us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.564557:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8316 00000100:00100000:0.0:1746065077.566949:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.566979:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.567049:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296128 00000100:00100000:1.0:1746065077.567057:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296128 00002000:00010000:1.0:1746065077.567086:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/833 (0->18446744073709551615) 00002000:00100000:1.0:1746065077.567089:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098667800 with x1830881261296128 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065077.567098:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098667800. 00000100:00100000:0.0:1746065077.567100:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.567297:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296256 00000100:00100000:1.0:1746065077.567301:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296256 00002000:00010000:1.0:1746065077.567312:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/832 (0->18446744073709551615) 00002000:00100000:1.0:1746065077.567314:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098667b80 with x1830881261296256 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065077.567319:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098667b80. 00000100:00100000:3.0:1746065077.567344:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1231 00000100:00100000:3.0:1746065077.567352:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+81:2005:x1830881261296128:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:1.0:1746065077.567483:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1232 00000100:00100000:1.0:1746065077.567489:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+71:2005:x1830881261296256:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065077.567493:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065077.567496:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.567497:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb atime from disk: 1746065077 -> 0 00002000:00010000:3.0:1746065077.567499:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:3.0:1746065077.567501:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x341:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065077.567535:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+82:2005:x1830881261296128:12345-192.168.202.27@tcp:10:bash.0 Request processed in 185us (598us total) trans 17179872431 rc 0/0 00000100:00100000:3.0:1746065077.567541:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1231 00002000:00010000:3.0:1746065077.567544:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/833 (0->18446744073709551615) 00002000:00100000:3.0:1746065077.567546:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098667800 with x1830881261296128 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065077.567549:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098667800. 00002000:00010000:1.0:1746065077.567555:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x340:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065077.567557:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x340:0x0] updating lvb mtime from disk: 0 -> 1746065077 00002000:00010000:1.0:1746065077.567559:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x340:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.567561:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x340:0x0] updating lvb ctime from disk: 0 -> 1746065077 00002000:00010000:1.0:1746065077.567562:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x340:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065077.567590:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+72:2005:x1830881261296256:12345-192.168.202.27@tcp:10:bash.0 Request processed in 100us (609us total) trans 21474839703 rc 0/0 00000100:00100000:1.0:1746065077.567595:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1232 00002000:00010000:1.0:1746065077.567597:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/832 (0->18446744073709551615) 00002000:00100000:1.0:1746065077.567599:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098667b80 with x1830881261296256 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065077.567603:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098667b80. 00000100:00100000:2.0:1746065077.567663:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296512 00000100:00100000:2.0:1746065077.567667:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296512 00000100:00100000:2.0:1746065077.567698:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4071 00000100:00100000:2.0:1746065077.567703:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27829:x1830881261296512:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065077.567961:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27829:x1830881261296512:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 257us (859us total) trans 4294975239 rc 0/0 00000100:00100000:2.0:1746065077.567966:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4071 00000100:00100000:0.0:1746065077.570440:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.570477:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.570743:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261296768 00000100:00100000:3.0:1746065077.570750:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261296768 00000100:00100000:3.0:1746065077.570808:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4072 00000100:00100000:3.0:1746065077.570815:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261296768:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065077.570898:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297024 00000100:00100000:2.0:1746065077.570901:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297024 00000100:00100000:2.0:1746065077.570923:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11831 00000100:00100000:2.0:1746065077.570927:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27829:x1830881261297024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.570940:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.570959:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460739 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfe0 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.571026:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.571036:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571045:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571055:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.571060:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571065:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571140:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.571147:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571152:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.571160:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 2 00010000:00010000:2.0:1746065077.571210:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571215:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571220:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571226:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571232:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a529400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.571235:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571239:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571248:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72800) 00010000:00010000:2.0:1746065077.571250:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.571253:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571257:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc1460740 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571265:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571269:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571272:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571276:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.571278:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571281:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571285:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72400) 00010000:00010000:2.0:1746065077.571287:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.571289:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571293:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc1460747 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.571324:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460739 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.571335:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.571340:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.571341:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.571343:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8600, rc 0) 00000100:00100000:2.0:1746065077.571663:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27829:x1830881261297024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 733us (1183us total) trans 4294975240 rc 0/0 00000100:00100000:2.0:1746065077.571669:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11831 00000100:00100000:3.0:1746065077.571672:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261296768:12345-192.168.202.27@tcp:35:bash.0 Request processed in 858us (1238us total) trans 4294975241 rc 0/0 00000100:00100000:3.0:1746065077.571677:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4072 00000100:00100000:0.0:1746065077.576399:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.577768:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297152 00000100:00100000:2.0:1746065077.577792:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297152 00000100:00100000:2.0:1746065077.577843:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4073 00000100:00100000:2.0:1746065077.577849:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27829:x1830881261297152:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065077.577966:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27829:x1830881261297152:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 117us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.577972:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4073 00000100:00100000:0.0:1746065077.579864:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.579936:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297408 00000100:00100000:2.0:1746065077.579942:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297408 00000100:00100000:2.0:1746065077.579978:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11832 00000100:00100000:2.0:1746065077.579984:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27829:x1830881261297408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.580003:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.580255:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc146075c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfe7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.580343:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc1460763 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.580356:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc1460763 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.580365:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc1460763 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.580375:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31d:0x0]: returning size 5 00010000:00010000:2.0:1746065077.580444:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc146075c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe7 expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.580456:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc1460763 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe7 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.580463:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.580466:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065077.580469:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3000, rc 0) 00000100:00100000:2.0:1746065077.580515:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27829:x1830881261297408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 531us (657us total) trans 4294975242 rc 0/0 00000100:00100000:2.0:1746065077.580520:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11832 00000100:00100000:0.0:1746065077.584098:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.584199:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297664 00000100:00100000:2.0:1746065077.584205:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297664 00000100:00100000:2.0:1746065077.584238:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4074 00000100:00100000:2.0:1746065077.584243:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27829:x1830881261297664:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065077.584292:0:7207:0:(mdt_open.c:2285:mdt_close_handle_layouts()) ### [0x240000403:0x31d:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc1460763 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe7 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584318:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:2.0:1746065077.584327:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584333:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584338:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584343:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584348:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 7/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.584375:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584385:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 273 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.584396:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598528:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.584490:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584497:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 273 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.584503:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.584688:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584695:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 273 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.584702:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.584831:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.584839:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 273 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.584846:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.584862:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.588852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065077.588957:0:7207:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff8800982ddf80 x1830881262598528) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 273 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.588973:0:7207:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 273 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.588992:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14606e5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfc4 expref: 273 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.589015:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ddf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.589143:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261297920 00000100:00100000:2.0:1746065077.589149:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261297920 00010000:00010000:3.0:1746065077.589154:0:7207:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff8800982dd500 x1830881262598656) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.589163:0:7207:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 273 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.589197:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11833 00000100:00100000:2.0:1746065077.589204:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27830:x1830881261297920:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065077.589241:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00000100:00100000:3.0:1746065077.589307:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598656:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.589319:0:7207:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff8800982ddc00 x1830881262598784) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 273 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.589350:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14606de lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfbd expref: 273 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.589359:0:7203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc14606de) 00010000:00010000:2.0:1746065077.589361:0:7203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc14606e5) 00010000:00010000:2.0:1746065077.589365:0:7203:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.589377:0:7203:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 272 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.589384:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.589387:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.589394:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.589399:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.589413:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.589433:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.589439:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.589445:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.589453:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.589458:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.589463:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.589520:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.589526:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.589532:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.589546:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc146074e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe0 expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.589555:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598784:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.589566:0:7207:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff8800982dd880 x1830881262598912) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 271 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.589572:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460691 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfa1 expref: 271 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.589595:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262598912:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.589613:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065077.589617:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589623:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589627:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000004:00020000:3.0:1746065077.589698:0:7207:0:(lod_lov.c:1538:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000403:0x31d:0x0]: rc = -1 00000004:00080000:2.0:1746065077.589704:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x31d:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1746065077.589717:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589722:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589726:0:7207:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589731:0:7207:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.589734:0:7207:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589739:0:7207:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.589745:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065077.589747:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1746065077.589750:0:7207:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.589750:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.589754:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1460771 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.589755:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.589759:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.589761:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065077.589763:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065077.589766:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3000/0xad6b7ddc1460763 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfe7 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.589859:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27829:x1830881261297664:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 5614us (5766us total) trans 4294975244 rc -1/-1 00000100:00100000:3.0:1746065077.589866:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4074 00010000:00010000:2.0:1746065077.590081:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.590084:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590089:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590095:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065077.590097:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065077.590099:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590106:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460786 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590120:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590125:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590129:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590133:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590136:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.590138:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590142:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590147:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72800) 00010000:00010000:2.0:1746065077.590149:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.590151:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590155:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460778 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065077.590164:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880131898380 reply state ffff88012be17000 transno 4294975243 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590171:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.590176:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:2.0:1746065077.590178:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065077.590180:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065077.590208:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27830:x1830881261297920:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1004us (1363us total) trans 4294975243 rc 0/0 00000100:00100000:2.0:1746065077.590213:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11833 00000100:00100000:0.0:1746065077.592335:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.592486:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298048 00000100:00100000:3.0:1746065077.592492:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298048 00000100:00100000:3.0:1746065077.592524:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11834 00000100:00100000:3.0:1746065077.592530:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27829:x1830881261298048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.592549:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.592563:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97800/0xad6b7ddc146078d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bfee expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.592614:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97800/0xad6b7ddc146078d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfee expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.592624:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97800/0xad6b7ddc146078d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfee expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.592638:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:3.0:1746065077.592640:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065077.592643:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97800, rc 0) 00000100:00100000:3.0:1746065077.593193:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27829:x1830881261298048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 661us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.593199:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11834 00000100:00100000:0.0:1746065077.596022:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.596120:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298304 00000100:00100000:3.0:1746065077.596127:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298304 00000100:00100000:3.0:1746065077.596163:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4075 00000100:00100000:3.0:1746065077.596168:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27829:x1830881261298304:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065077.596393:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x31d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065077.596447:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2330, 64 off193320 00000040:00080000:3.0:1746065077.596465:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2326, 64 off192864 00000040:00080000:3.0:1746065077.596473:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2327, 64 off192928 00000040:00080000:3.0:1746065077.596481:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2331, 64 off193384 00010000:00010000:3.0:1746065077.596521:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065077.596532:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.596541:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.596547:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.596552:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.596557:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.598106:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065077.598291:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27829:x1830881261298304:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2118us (2272us total) trans 4294975245 rc 0/0 00000100:00100000:3.0:1746065077.598300:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4075 00010000:00010000:1.0:1746065077.599944:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065077.599953:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.599960:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065077.599964:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.599971:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.599983:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31d:0x0].0x0 (ffff88012d56ce00) 00010000:00010000:1.0:1746065077.599986:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065077.599988:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.599992:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460794 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.600019:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.600021:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.600022:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065077.609418:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.609464:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298432 00000100:00100000:3.0:1746065077.609473:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298432 00000100:00100000:1.0:1746065077.611486:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11835 00000100:00100000:1.0:1746065077.611500:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27831:x1830881261298432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.611518:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.611538:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc146079b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bff5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.611608:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.611618:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611629:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611636:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.611642:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611647:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611680:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611684:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611688:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611693:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611698:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.611701:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611706:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611714:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065077.611716:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.611719:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611723:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14607a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611749:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611754:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611757:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611761:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.611763:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611767:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611786:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065077.611788:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.611791:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611795:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3400/0xad6b7ddc14607a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.611820:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc146079b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bff5 expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.611827:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc146079b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bff5 expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.611839:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054c00, rc 0) 00000100:00100000:1.0:1746065077.611896:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27831:x1830881261298432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 401us (2485us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065077.611902:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11835 00000100:00100000:0.0:1746065077.625891:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.625990:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298560 00000100:00100000:3.0:1746065077.625998:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298560 00000100:00100000:3.0:1746065077.626048:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11836 00000100:00100000:3.0:1746065077.626055:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27831:x1830881261298560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.626075:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.626091:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14607b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92bffc expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.626147:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.626156:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626165:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626341:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.626346:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626352:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626390:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626395:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626399:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626403:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626407:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.626410:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626416:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626425:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:3.0:1746065077.626427:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.626430:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.626434:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627940:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627948:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627954:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627957:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.627961:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627966:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627974:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065077.627977:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.627980:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.627984:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14607be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.628018:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14607b0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bffc expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.628024:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14607b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bffc expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.628035:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96400, rc 0) 00000100:00100000:3.0:1746065077.628095:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27831:x1830881261298560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2039us (2211us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.628102:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11836 00000100:00100000:0.0:1746065077.633089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.633122:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.633212:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298816 00000100:00100000:3.0:1746065077.633219:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298816 00000100:00100000:3.0:1746065077.633250:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261298944 00000100:00100000:3.0:1746065077.633252:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261298944 00000100:00100000:3.0:1746065077.633270:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11837 00000100:00100000:3.0:1746065077.633276:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27832:x1830881261298816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.633291:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.633310:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97600/0xad6b7ddc14607c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c003 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.633377:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.633386:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633395:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633403:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.633407:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633412:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633439:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633444:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633448:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633453:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633457:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.633460:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633465:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633473:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:3.0:1746065077.633475:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.633478:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633482:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14607cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633491:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633495:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633500:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633503:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.633505:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633509:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633515:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065077.633517:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.633519:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633522:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc14607d3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633544:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97600/0xad6b7ddc14607c5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c003 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.633551:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97600/0xad6b7ddc14607c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c003 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.633562:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97600, rc 0) 00000100:00100000:3.0:1746065077.633620:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27832:x1830881261298816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 343us (537us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.633626:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11837 00000100:00100000:3.0:1746065077.633639:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11838 00000100:00100000:3.0:1746065077.633644:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27831:x1830881261298944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.633662:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.633668:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc14607da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c00a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.633690:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14607e1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.633696:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14607e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.633701:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14607e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065077.633732:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065077.633735:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065077.633754:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc14607da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c00a expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.633766:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14607e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c00a expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.633771:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:3.0:1746065077.633797:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065077.633799:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5a00, rc 0) 00000100:00100000:3.0:1746065077.633814:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27831:x1830881261298944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 170us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.633819:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11838 00000100:00100000:0.0:1746065077.637376:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.637428:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261299200 00000100:00100000:1.0:1746065077.637437:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261299200 00000100:00100000:1.0:1746065077.637485:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11839 00000100:00100000:1.0:1746065077.637492:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27831:x1830881261299200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.637508:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.637511:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065077.637532:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14607e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c00a expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.637557:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065077.637565:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.637574:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc14607e8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c011 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.637660:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.637669:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.637676:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.637684:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.637690:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.637694:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638728:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.638738:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638744:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065077.638751:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00010000:00010000:1.0:1746065077.638768:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638800:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638805:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638810:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638815:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.638818:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638823:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638835:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f600) 00010000:00010000:1.0:1746065077.638837:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.638839:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638847:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc14607ef lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065077.638856:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88013189a300 reply state ffff880098340000 transno 4294975246 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638862:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.638867:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065077.638868:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.638871:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065077.638891:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc14607e8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.638903:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.638908:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f200) 00010000:00010000:1.0:1746065077.638910:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.638912:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000100:00100000:1.0:1746065077.638963:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27831:x1830881261299200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1472us (1595us total) trans 4294975246 rc 0/0 00000100:00100000:1.0:1746065077.638968:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11839 00000100:00100000:0.0:1746065077.646327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.647357:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261299456 00000100:00100000:1.0:1746065077.647367:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261299456 00000100:00100000:1.0:1746065077.647423:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11840 00000100:00100000:1.0:1746065077.647432:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27831:x1830881261299456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.647450:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.647468:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146080b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c018 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.647554:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.647565:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.647570:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.647608:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.647619:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 277 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.647634:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262599040:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065077.647736:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.655509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.655541:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.655562:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261299584 00000100:00100000:0.0:1746065077.655568:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261299584 00010000:00010000:0.0:1746065077.655635:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.655675:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3512 00000100:00100000:0.0:1746065077.655682:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+278:2005:x1830881261299584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.655693:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.655698:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.655708:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 278 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.655730:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f200) 00010000:00010000:0.0:1746065077.655734:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.655742:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.655747:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.655761:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065077.655828:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+278:2005:x1830881261299584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 145us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.655834:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3512 00000100:00100000:0.0:1746065077.656095:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261299840 00000100:00100000:0.0:1746065077.656099:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261299840 00000100:00100000:0.0:1746065077.656121:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11841 00000100:00100000:0.0:1746065077.656126:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27833:x1830881261299840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.656139:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.656151:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460819 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c01f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.656215:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.656222:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656228:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656236:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.656241:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656243:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14607fd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c011 expref: 279 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746065077.656246:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065077.656261:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262599040:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065077.656275:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.656293:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.656296:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065077.656308:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00010000:00010000:0.0:1746065077.656326:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.656331:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656336:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.656340:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00010000:00010000:0.0:1746065077.656389:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656395:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656400:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656404:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.656407:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656412:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656419:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f200) 00000004:00080000:1.0:1746065077.656420:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x342:0x0], index 0: 0 00010000:00010000:0.0:1746065077.656421:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00080000:1.0:1746065077.656424:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x343:0x0], index 1: 0 00010000:00010000:0.0:1746065077.656424:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 2/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00080000:1.0:1746065077.656427:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x344:0x0], index 1: 0 00000004:00080000:1.0:1746065077.656430:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x343:0x0], index 0: 0 00010000:00010000:0.0:1746065077.656432:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146082e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656446:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656450:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656453:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656457:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656460:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.656462:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656466:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656471:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854800) 00010000:00010000:0.0:1746065077.656473:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.656475:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656479:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc1460820 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656481:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.656485:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656486:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.656489:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656490:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.656494:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.656494:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656496:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.656498:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.656500:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.656500:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.656504:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656506:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f200) 00010000:00010000:1.0:1746065077.656508:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065077.656508:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065077.656510:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.656510:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.656512:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656514:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460812 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.656516:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460827 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.656538:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146080b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c018 expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.656538:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460819 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c01f expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.656544:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1460819 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c01f expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.656548:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146080b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c018 expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.656553:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00010000:00010000:1.0:1746065077.656556:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7000, rc 0) 00000100:00100000:0.0:1746065077.657189:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27833:x1830881261299840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1061us (1687us total) trans 4294975247 rc 301/301 00000100:00100000:0.0:1746065077.657194:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11841 00000100:00100000:1.0:1746065077.658616:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27831:x1830881261299456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11180us (12292us total) trans 4294975248 rc 301/301 00000100:00100000:1.0:1746065077.658623:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11840 00000100:00100000:1.0:1746065077.666246:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.666550:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261300096 00000100:00100000:3.0:1746065077.666558:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261300096 00000100:00100000:3.0:1746065077.666690:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4076 00000100:00100000:3.0:1746065077.666697:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27831:x1830881261300096:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065077.666953:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27831:x1830881261300096:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 256us (713us total) trans 4294975249 rc 0/0 00000100:00100000:3.0:1746065077.666959:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4076 00000100:00100000:0.0:1746065077.670259:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.670309:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.670321:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261300352 00000100:00100000:2.0:1746065077.670328:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261300352 00000100:00100000:2.0:1746065077.670372:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4077 00000100:00100000:2.0:1746065077.670380:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27831:x1830881261300352:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065077.670838:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261300480 00000100:00100000:1.0:1746065077.670843:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261300480 00000100:00100000:1.0:1746065077.670868:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11842 00000100:00100000:1.0:1746065077.670872:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27833:x1830881261300480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.670881:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.670897:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460843 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c026 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.670947:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146084a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.670958:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146084a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.670967:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146084a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065077.670984:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00000004:00200000:1.0:1746065077.670988:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065077.670997:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146084a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.671015:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460843 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c026 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.671031:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146084a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c026 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.671037:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.671040:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.671042:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000100:00100000:2.0:1746065077.671116:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27831:x1830881261300352:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 736us (862us total) trans 4294975250 rc 0/0 00000100:00100000:2.0:1746065077.671123:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4077 00000100:00100000:1.0:1746065077.671870:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27833:x1830881261300480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 995us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.672195:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11842 00000100:00100000:0.0:1746065077.678504:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.678549:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.679231:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261300864 00000100:00100000:3.0:1746065077.679239:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261300864 00000100:00100000:3.0:1746065077.679281:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8317 00000100:00100000:3.0:1746065077.679288:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261300864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.679303:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.679321:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c034 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065077.679343:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065077.679360:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.679362:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.679370:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 73 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.679382:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 73 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.679390:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:3.0:1746065077.679432:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261300864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 145us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.679438:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8317 00000100:00100000:1.0:1746065077.679515:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261300736 00000100:00100000:1.0:1746065077.679520:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261300736 00000100:00100000:1.0:1746065077.679544:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11843 00000100:00100000:1.0:1746065077.679548:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261300736:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.679559:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.679570:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460858 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c02d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.680078:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.680089:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680097:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680108:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.680114:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680118:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680159:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146086d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.680165:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146086d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680170:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146086d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065077.680178:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00010000:00010000:1.0:1746065077.680232:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680238:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680242:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680247:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680251:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.680254:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680262:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680270:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fa00) 00010000:00010000:1.0:1746065077.680273:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.680276:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680280:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146085f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680302:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680307:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680312:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680315:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.680317:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680322:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680327:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065077.680329:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.680331:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680335:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460866 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.680365:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1460858 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c02d expref: 283 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.680380:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146086d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c02d expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.680385:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.680387:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.680389:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9600, rc 0) 00000100:00100000:1.0:1746065077.680586:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261300736:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1025us (2078us total) trans 4294975251 rc 0/0 00000100:00100000:1.0:1746065077.680592:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11843 00000100:00100000:0.0:1746065077.682420:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.682610:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261301120 00000100:00100000:2.0:1746065077.682616:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261301120 00000100:00100000:2.0:1746065077.683030:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4078 00000100:00100000:2.0:1746065077.683037:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27833:x1830881261301120:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065077.683600:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27833:x1830881261301120:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 563us (1184us total) trans 4294975252 rc 0/0 00000100:00100000:2.0:1746065077.683607:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4078 00000100:00100000:2.0:1746065077.684813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.684858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.684956:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261301248 00000100:00100000:1.0:1746065077.684961:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261301248 00000100:00100000:3.0:1746065077.685225:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261301376 00000100:00100000:3.0:1746065077.685229:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261301376 00000100:00100000:1.0:1746065077.685366:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11844 00000100:00100000:1.0:1746065077.685374:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261301248:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065077.685386:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.685581:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc146087b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c03b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.685612:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc1460882 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.685623:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc1460882 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.685632:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc1460882 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.685714:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc146087b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c03b expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.685729:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc1460882 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c03b expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.685736:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.685738:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065077.685740:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee800, rc 0) 00000100:00100000:3.0:1746065077.685966:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 539 00000100:00100000:3.0:1746065077.685973:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+285:2007:x1830881261301376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.685980:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.685992:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9600/0xad6b7ddc146086d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c02d expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.686009:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.686012:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.686170:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261301248:12345-192.168.202.27@tcp:101:bash.0 Request processed in 796us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.686174:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+284:2007:x1830881261301376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 201us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.686179:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 539 00000100:00100000:1.0:1746065077.686179:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11844 00000100:00100000:2.0:1746065077.686551:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.686877:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261301632 00000100:00100000:1.0:1746065077.686882:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261301632 00000100:00100000:1.0:1746065077.686902:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11845 00000100:00100000:1.0:1746065077.686907:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27833:x1830881261301632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.686919:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.686928:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460889 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c042 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.686985:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460890 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.686993:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460890 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.687000:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460890 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065077.687013:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00010000:00010000:1.0:1746065077.687087:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1460889 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c042 expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.687098:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460890 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c042 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.687103:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.687644:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065077.687647:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8600, rc 0) 00000100:00100000:1.0:1746065077.687689:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27833:x1830881261301632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 781us (1137us total) trans 4294975253 rc 0/0 00000100:00100000:1.0:1746065077.687694:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11845 00000100:00100000:0.0:1746065077.688671:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.688876:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261301888 00000100:00100000:1.0:1746065077.688881:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261301888 00000100:00100000:1.0:1746065077.688912:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11846 00000100:00100000:1.0:1746065077.688918:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261301888:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065077.688944:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.688957:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146084a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c026 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.688969:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.688971:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.689078:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.689086:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.689094:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:1.0:1746065077.689123:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975254 00000004:00010000:1.0:1746065077.689139:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c527b80 reply state ffff88009a58c000 transno 4294975255 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.689147:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.689152:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.689154:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065077.689156:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065077.689817:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261301888:12345-192.168.202.27@tcp:36:bash.0 Request processed in 898us (1147us total) trans 4294975255 rc 0/0 00000100:00100000:1.0:1746065077.689823:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11846 00000020:00080000:1.0:1746065077.689826:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746065077.689924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.690064:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261302016 00000100:00100000:1.0:1746065077.690068:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261302016 00000100:00100000:1.0:1746065077.690094:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11847 00000100:00100000:1.0:1746065077.690100:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27833:x1830881261302016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065077.690111:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065077.690119:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bba00/0xad6b7ddc14608a5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c049 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.690172:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065077.690182:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.690191:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065077.690207:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00000004:00200000:1.0:1746065077.690210:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065077.690219:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.690235:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bba00/0xad6b7ddc14608a5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.690245:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.690251:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.690253:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065077.690255:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:1.0:1746065077.690289:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27833:x1830881261302016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.690295:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11847 00000100:00100000:0.0:1746065077.691710:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.691809:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261302272 00000100:00100000:3.0:1746065077.691814:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261302272 00000100:00100000:3.0:1746065077.691851:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11848 00000100:00100000:3.0:1746065077.691936:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261302272:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065077.691951:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.691953:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065077.691968:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8600/0xad6b7ddc1460890 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c042 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.692055:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.692058:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.692066:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14608b3 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c050 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.692097:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065077.692295:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.692301:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.692325:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.692335:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 288 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.692346:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262599168:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065077.692590:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.692648:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.692724:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261302528 00000100:00100000:2.0:1746065077.692729:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261302528 00000100:00100000:2.0:1746065077.692759:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4079 00000100:00100000:2.0:1746065077.692764:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27833:x1830881261302528:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065077.692907:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262599296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746065077.692938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.693043:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599296 00000100:00100000:1.0:1746065077.693047:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599296 00000100:00100000:1.0:1746065077.693069:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1746065077.693073:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+181:3759:x1830881262599296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746065077.693085:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490364992 pending 229376 free 3919237120 avail 3687714816 00000100:00100000:2.0:1746065077.693096:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27833:x1830881261302528:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 331us (505us total) trans 4294975256 rc 0/0 00000100:00100000:2.0:1746065077.693101:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4079 00000100:00100000:1.0:1746065077.693108:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+181:3759:x1830881262599296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.693113:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1746065077.693178:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262599296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065077.695476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.695508:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.695529:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261302912 00000100:00100000:0.0:1746065077.695534:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261302912 00000100:00100000:0.0:1746065077.695572:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11849 00000100:00100000:0.0:1746065077.695588:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27833:x1830881261302912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.695602:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.695615:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14608c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c057 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.695673:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.695682:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695690:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695697:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.695702:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695706:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695771:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.695794:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695799:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065077.695806:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 0 00010000:00010000:0.0:1746065077.695850:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695855:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695860:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695864:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c55d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.695867:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695872:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695879:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065077.695881:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065077.695884:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695887:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c55d200/0xad6b7ddc14608d6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695904:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695908:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695912:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695915:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695919:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.695920:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695924:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695928:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854700) 00010000:00010000:0.0:1746065077.695929:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.695931:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695934:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14608c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695939:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695943:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695946:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695950:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.695952:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695955:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695959:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:0.0:1746065077.695961:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.695963:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14608cf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.695988:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14608c1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c057 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.695994:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14608c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c057 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.696003:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bd3800, rc 0) 00000100:00100000:0.0:1746065077.696037:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27833:x1830881261302912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 450us (567us total) trans 4294975257 rc 301/301 00000100:00100000:0.0:1746065077.696042:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11849 00000100:00100000:1.0:1746065077.696160:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261302656 00000100:00100000:1.0:1746065077.696164:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261302656 00010000:00010000:1.0:1746065077.696180:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 291 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746065077.696195:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3513 00000100:00100000:1.0:1746065077.696199:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+291:2007:x1830881261302656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.696206:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.696210:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 291 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.696218:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 291 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.696227:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.696230:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.696236:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.696241:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065077.696251:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065077.696267:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+291:2007:x1830881261302656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.696272:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3513 00010000:00010000:3.0:1746065077.696367:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130105000/0xad6b7ddc14608ac lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c049 expref: 290 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.696376:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262599168:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.696389:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.696395:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.696398:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:3.0:1746065077.696534:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2328, 88 off193016 00000004:00080000:3.0:1746065077.696539:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673714764697ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065077.696555:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2332, 88 off193472 00000004:00080000:3.0:1746065077.696557:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673714783192ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065077.696600:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2333, 88 off193560 00000004:00080000:3.0:1746065077.696603:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673714829241ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065077.696613:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2329, 88 off193104 00000004:00080000:3.0:1746065077.696615:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673714841679ns, next at 674466981116ns, rc = 0 00000100:00100000:1.0:1746065077.700361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:2.0:1746065077.700834:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975258 is committed 00000004:00080000:2.0:1746065077.700841:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1567 committed 00000004:00080000:2.0:1746065077.700847:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1577 committed 00010000:00010000:0.0:1746065077.701013:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701023:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701033:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701037:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.701041:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701047:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701060:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:0.0:1746065077.701063:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.701066:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701071:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc146077f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065077.701085:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701089:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701093:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701096:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.701098:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701102:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701108:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:0.0:1746065077.701110:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.701111:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701115:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14607f6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701129:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701134:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701138:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701141:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0ba200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.701143:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701146:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701151:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065077.701153:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.701154:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.701158:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146089e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065077.701273:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1576 committed 00000004:00080000:2.0:1746065077.701276:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1566 committed 00000100:00100000:3.0:1746065077.701405:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262599808:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.701441:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.701468:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065077.701472:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262599424:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.701484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.701497:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262599552:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.701508:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.701517:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065077.701519:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262599680:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.701529:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.701543:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599808 00000100:00100000:3.0:1746065077.701548:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599808 00000100:00100000:3.0:1746065077.701572:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599424 00000100:00100000:3.0:1746065077.701582:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599424 00000100:00100000:3.0:1746065077.701593:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599552 00000100:00100000:3.0:1746065077.701595:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599552 00000100:00100000:3.0:1746065077.701605:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599680 00000100:00100000:3.0:1746065077.701606:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599680 00000100:00100000:3.0:1746065077.701617:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8318 00000100:00100000:3.0:1746065077.701622:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+218:3759:x1830881262599808:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.701753:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+219:3759:x1830881262599808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 130us (310us total) trans 17179872432 rc 0/0 00000100:00100000:3.0:1746065077.701759:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8318 00000100:00100000:3.0:1746065077.701771:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8319 00000100:00100000:3.0:1746065077.701796:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+218:3759:x1830881262599424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065077.701808:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:833 count 1 00010000:00010000:3.0:1746065077.701820:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.701834:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 81 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.701845:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065077.701846:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065077.701849:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.701867:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 81 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.701876:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 81 pid: 3068 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.701885:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262599936:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065077.701931:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065077.701943:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8320 00000100:00100000:3.0:1746065077.701947:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+218:3761:x1830881262599552:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065077.701956:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:834 count 1 00010000:00010000:3.0:1746065077.701964:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.701972:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 81 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.701976:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.701977:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.701979:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.701994:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 81 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.702000:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 81 pid: 1880 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746065077.702007:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262600064:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065077.702023:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065077.702035:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8321 00000100:00100000:3.0:1746065077.702039:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+218:3761:x1830881262599680:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.702096:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+219:3761:x1830881262599680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 56us (565us total) trans 17179872433 rc 0/0 00000100:00100000:3.0:1746065077.702101:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8321 00000004:00080000:3.0:1746065077.702133:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137346680/2, rc 0, transno 17179872433 00000100:00100000:3.0:1746065077.702137:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262599680:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065077.702149:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137347800/2, rc 0, transno 17179872432 00000100:00100000:3.0:1746065077.702151:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262599808:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065077.702212:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303168 00000100:00100000:2.0:1746065077.702215:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303168 00000100:00100000:2.0:1746065077.702235:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4080 00000100:00100000:2.0:1746065077.702239:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27833:x1830881261303168:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065077.702343:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27833:x1830881261303168:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 103us (1989us total) trans 4294975259 rc 0/0 00000100:00100000:2.0:1746065077.702348:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4080 00000100:00100000:1.0:1746065077.702508:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262600576:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.702531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.702544:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065077.702548:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262600192:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.702562:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.702818:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262600448:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.702839:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065077.702850:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065077.702853:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262600320:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.702862:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065077.703027:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262600576 00000100:00100000:2.0:1746065077.703031:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262600576 00000100:00100000:2.0:1746065077.703047:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262600192 00000100:00100000:2.0:1746065077.703049:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262600192 00000100:00100000:2.0:1746065077.703057:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262600448 00000100:00100000:2.0:1746065077.703058:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262600448 00000100:00100000:2.0:1746065077.703066:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262600320 00000100:00100000:2.0:1746065077.703067:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262600320 00000100:00100000:2.0:1746065077.703076:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8322 00000100:00100000:2.0:1746065077.703080:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+184:3759:x1830881262600576:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.703161:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+185:3759:x1830881262600576:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (629us total) trans 21474839704 rc 0/0 00000100:00100000:2.0:1746065077.703166:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8322 00000100:00100000:2.0:1746065077.703175:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8323 00000100:00100000:2.0:1746065077.703179:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+184:3759:x1830881262600192:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065077.703187:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:832 count 1 00010000:00010000:2.0:1746065077.703196:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.703207:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 72 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.703212:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065077.703213:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065077.703215:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.703231:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 72 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.703239:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 72 pid: 3068 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.703248:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262600704:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.703277:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.703292:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8324 00000100:00100000:2.0:1746065077.703304:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+184:3762:x1830881262600448:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065077.703352:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065077.703355:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.703356:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.703358:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.703360:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065077.703379:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+185:3762:x1830881262600448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 76us (540us total) trans 21474839705 rc 0/0 00000100:00100000:2.0:1746065077.703384:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8324 00000100:00100000:2.0:1746065077.703392:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8325 00000100:00100000:2.0:1746065077.703396:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+184:3762:x1830881262600320:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065077.703405:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:833 count 1 00010000:00010000:2.0:1746065077.703412:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.703420:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 72 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.703425:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.703426:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.703428:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.703440:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 72 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.703447:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 72 pid: 1880 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746065077.703458:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262600832:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.703475:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1746065077.703794:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7ff480/2, rc 0, transno 21474839705 00000100:00100000:0.0:1746065077.703800:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262600448:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065077.704082:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3480/2, rc 0, transno 21474839704 00000100:00100000:1.0:1746065077.704086:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262600576:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065077.707107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.707124:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.707538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.707550:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.707568:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.707587:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303296 00000100:00100000:0.0:1746065077.707590:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303808 00000100:00100000:0.0:1746065077.707594:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303808 00000100:00100000:3.0:1746065077.707595:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303296 00010000:00010000:3.0:1746065077.707622:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 82 pid: 3068 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.707623:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4081 00000100:00100000:0.0:1746065077.707633:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27833:x1830881261303808:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065077.707662:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303552 00000100:00100000:3.0:1746065077.707664:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303552 00000100:00100000:1.0:1746065077.707668:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303424 00000100:00100000:1.0:1746065077.707671:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303424 00010000:00010000:3.0:1746065077.707676:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 73 pid: 3068 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.707684:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 83 pid: 1880 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746065077.707689:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303680 00000100:00100000:3.0:1746065077.707691:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303680 00000100:00100000:1.0:1746065077.707695:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3514 00010000:00010000:3.0:1746065077.707699:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 74 pid: 1880 timeout: 773 lvb_type: 1 00000100:00100000:1.0:1746065077.707699:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261303296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.707708:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065077.707709:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3515 00010000:00010000:1.0:1746065077.707712:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 83 pid: 3068 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.707714:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261303552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065077.707720:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 83 pid: 3068 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.707722:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.707726:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 74 pid: 3068 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.707733:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 74 pid: 3068 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746065077.707739:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.707741:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.707745:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.707745:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707746:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.707749:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.707751:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707755:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.707767:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.707768:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065077.707814:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261303552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.707814:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261303296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 113us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.707820:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3514 00000100:00100000:3.0:1746065077.707823:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3515 00000100:00100000:3.0:1746065077.707833:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3516 00000100:00100000:1.0:1746065077.707836:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3517 00000100:00100000:3.0:1746065077.707837:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+82:2005:x1830881261303424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065077.707841:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261303680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.707842:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.707846:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 82 pid: 1880 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746065077.707847:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065077.707851:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 73 pid: 1880 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746065077.707854:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 82 pid: 1880 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746065077.707859:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 73 pid: 1880 timeout: 773 lvb_type: 1 00010000:00010000:3.0:1746065077.707863:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.707865:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.707867:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.707869:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065077.707871:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.707873:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.707873:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065077.707877:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707881:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065077.707885:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065077.707893:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+82:2005:x1830881261303424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.707898:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3516 00000100:00100000:1.0:1746065077.707899:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261303680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065077.707904:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3517 00010000:00010000:3.0:1746065077.707934:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1460660 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf93 expref: 81 pid: 1880 timeout: 773 lvb_type: 1 00000100:00100000:3.0:1746065077.707945:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262600064:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.707958:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707970:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707976:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707983:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.707989:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.708002:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065077.708158:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+219:3761:x1830881262599552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6210us (6648us total) trans 17179872434 rc 0/0 00000100:00100000:3.0:1746065077.708165:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8320 00010000:00010000:3.0:1746065077.708215:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c050 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.708223:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.708225:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065077.708234:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14608b3 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c050 expref: 270 pid: 7204 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746065077.708237:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27833:x1830881261303808:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 608us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.708243:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4081 00010000:00010000:3.0:1746065077.708245:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c050 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.708262:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065077.708264:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.708266:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065077.708267:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97000, rc 0) 00010000:00010000:0.0:1746065077.708267:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.708273:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.708276:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.708285:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261302272:12345-192.168.202.27@tcp:101:bash.0 Request processed in 16352us (16578us total) trans 4294975258 rc 0/0 00010000:00010000:0.0:1746065077.708286:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.708290:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11848 00010000:00010000:0.0:1746065077.708295:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.708300:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc14608eb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.708313:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.708315:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065077.708316:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065077.708922:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137345500/2, rc 0, transno 17179872434 00000100:00100000:2.0:1746065077.708928:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262599552:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065077.708949:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460659 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bf8c expref: 72 pid: 1880 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746065077.708957:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262600832:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.708968:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.708975:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.708981:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.708987:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.708992:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.709793:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065077.709914:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+185:3762:x1830881262600320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6516us (7049us total) trans 21474839706 rc 0/0 00000100:00100000:2.0:1746065077.709921:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8325 00010000:00010000:2.0:1746065077.709947:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146072b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfcb expref: 80 pid: 3068 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.709955:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262599936:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.709966:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.709971:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.709976:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.709981:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.709986:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.710007:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065077.710088:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+219:3759:x1830881262599424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8292us (8603us total) trans 17179872435 rc 0/0 00000100:00100000:2.0:1746065077.710093:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8319 00010000:00010000:2.0:1746065077.710114:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d8200/0xad6b7ddc1460732 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92bfd9 expref: 71 pid: 3068 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.710121:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262600704:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.710130:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.710136:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.710141:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.710147:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.710152:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.710159:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1746065077.710219:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+185:3759:x1830881262600192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7039us (7656us total) trans 21474839707 rc 0/0 00000100:00100000:2.0:1746065077.710224:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8323 00010000:00010000:3.0:1746065077.710269:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1746065077.710274:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710280:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b1c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.710283:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710289:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710307:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710313:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1c00/0xad6b7ddc14608f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710324:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065077.710327:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710336:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.710339:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710343:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710350:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710355:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc14608e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710365:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065077.710367:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710371:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065077.710373:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710378:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710384:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710392:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b0800/0xad6b7ddc14608f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.710399:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065077.710401:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065077.710402:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.710523:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065077.710543:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7ff800/2, rc 0, transno 21474839707 00000100:00100000:1.0:1746065077.710547:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262600192:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065077.710556:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137345880/2, rc 0, transno 17179872435 00000100:00100000:1.0:1746065077.710559:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262599424:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065077.710645:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fdc00/2, rc 0, transno 21474839706 00000100:00100000:0.0:1746065077.710649:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262600320:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065077.710658:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.712819:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.714479:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261303936 00000100:00100000:2.0:1746065077.714489:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261303936 00000100:00100000:2.0:1746065077.714545:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8326 00000100:00100000:2.0:1746065077.714552:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+71:26180:x1830881261303936:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.714567:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.714590:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c05e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.714616:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.714623:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.714625:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.714628:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 72 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.714651:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.714660:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746065077.714670:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262600960:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.714750:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.718179:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262600960:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.718206:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 72 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.718221:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1400, rc 0) 00000100:00100000:2.0:1746065077.718272:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+72:26180:x1830881261303936:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3719us (5458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.718280:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8326 00000100:00100000:0.0:1746065077.718812:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.719979:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261304064 00000100:00100000:2.0:1746065077.719987:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261304064 00010000:00010000:2.0:1746065077.720015:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746065077.720052:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3518 00000100:00100000:2.0:1746065077.720058:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+72:2005:x1830881261304064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.720069:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.720074:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 773 lvb_type: 1 00010000:00010000:2.0:1746065077.720084:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 773 lvb_type: 1 00010000:00010000:2.0:1746065077.720102:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc1460851 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c034 expref: 72 pid: 3068 timeout: 773 lvb_type: 1 00010000:00010000:2.0:1746065077.720115:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.720116:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.720122:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 71 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.720129:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 71 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.720160:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 71 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.720174:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881262601088:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065077.720257:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.725136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.725908:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261304320 00000100:00100000:3.0:1746065077.725916:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261304320 00000100:00100000:3.0:1746065077.725973:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11850 00000100:00100000:3.0:1746065077.725981:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27835:x1830881261304320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.726001:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.726017:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1460907 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c065 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.726082:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.726164:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881262601088:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065077.726183:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065077.726231:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+71:2005:x1830881261304064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6172us (7420us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065077.726232:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065077.726239:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3518 00010000:00010000:3.0:1746065077.726242:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.726251:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.726260:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065077.726263:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261304448 00010000:00010000:3.0:1746065077.726265:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065077.726266:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261304448 00010000:00010000:3.0:1746065077.726270:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065077.726291:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8327 00000100:00100000:2.0:1746065077.726295:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+80:26180:x1830881261304448:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.726303:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.726320:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c06c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065077.726335:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065077.726348:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.726349:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.726356:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 81 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.726366:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 81 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.726373:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b0c00, rc 0) 00000100:00100000:2.0:1746065077.726391:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+81:26180:x1830881261304448:12345-192.168.202.27@tcp:101:bash.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.726396:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8327 00010000:00010000:3.0:1746065077.727150:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065077.727160:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727166:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065077.727174:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 2 00010000:00010000:3.0:1746065077.727239:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727245:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727249:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727253:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727258:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.727261:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727267:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727275:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:3.0:1746065077.727277:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.727280:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727286:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146090e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727750:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727757:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727761:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727765:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.727768:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727868:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727883:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56cb00) 00010000:00010000:3.0:1746065077.727886:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.727888:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727892:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460915 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.727929:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1460907 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 271 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.727940:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.727949:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.727950:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065077.727952:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:3.0:1746065077.727987:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27835:x1830881261304320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2007us (2859us total) trans 4294975260 rc 0/0 00000100:00100000:3.0:1746065077.727993:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11850 00010000:00010000:3.0:1746065077.729207:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.731052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.731211:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261304576 00000100:00100000:2.0:1746065077.731218:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261304576 00002000:00010000:2.0:1746065077.731251:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/834 (0->18446744073709551615) 00002000:00100000:2.0:1746065077.731255:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f800 with x1830881261304576 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065077.731264:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834f800. 00000100:00100000:2.0:1746065077.731290:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1233 00000100:00100000:2.0:1746065077.731297:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261304576:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065077.731444:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065077.731446:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb mtime from disk: 0 -> 1746065077 00002000:00010000:2.0:1746065077.731448:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.731450:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb ctime from disk: 0 -> 1746065077 00000100:00100000:1.0:1746065077.731450:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065077.731452:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065077.731499:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261304576:12345-192.168.202.27@tcp:10:bash.0 Request processed in 202us (454us total) trans 21474839708 rc 0/0 00000100:00100000:2.0:1746065077.731505:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1233 00002000:00010000:2.0:1746065077.731507:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/834 (0->18446744073709551615) 00002000:00100000:2.0:1746065077.731509:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f800 with x1830881261304576 ext(0->18446744073709551615) 00000100:00100000:1.0:1746065077.731511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065077.731513:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834f800. 00000100:00100000:2.0:1746065077.731524:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261304704 00000100:00100000:2.0:1746065077.731527:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261304704 00002000:00010000:2.0:1746065077.731535:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/835 (0->18446744073709551615) 00002000:00100000:2.0:1746065077.731537:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881261304704 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065077.731542:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f1f80. 00000100:00100000:2.0:1746065077.731558:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1234 00000100:00100000:2.0:1746065077.731563:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+81:2004:x1830881261304704:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065077.731645:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065077.731647:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb mtime from disk: 0 -> 1746065077 00002000:00010000:2.0:1746065077.731649:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.731650:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb ctime from disk: 0 -> 1746065077 00002000:00010000:2.0:1746065077.731652:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065077.731901:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261304960 00000100:00100000:0.0:1746065077.731905:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261304960 00000100:00100000:0.0:1746065077.731926:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4082 00000100:00100000:0.0:1746065077.731931:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27835:x1830881261304960:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065077.732029:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27835:x1830881261304960:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 98us (578us total) trans 4294975261 rc 0/0 00000100:00100000:0.0:1746065077.732038:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4082 00000100:00100000:2.0:1746065077.736784:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+82:2004:x1830881261304704:12345-192.168.202.27@tcp:10:bash.0 Request processed in 5192us (5244us total) trans 17179872436 rc 0/0 00000100:00100000:2.0:1746065077.736798:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1234 00002000:00010000:2.0:1746065077.736805:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/835 (0->18446744073709551615) 00002000:00100000:2.0:1746065077.736808:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881261304704 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065077.736818:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f1f80. 00000100:00100000:0.0:1746065077.739892:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.740032:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261305216 00000100:00100000:2.0:1746065077.740043:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261305216 00000100:00100000:2.0:1746065077.740080:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4083 00000100:00100000:2.0:1746065077.740086:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261305216:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065077.740452:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261305216:12345-192.168.202.27@tcp:35:bash.0 Request processed in 365us (565us total) trans 4294975262 rc 0/0 00000100:00100000:2.0:1746065077.740458:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4083 00000100:00100000:1.0:1746065077.743762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.743842:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261305472 00000100:00100000:3.0:1746065077.743848:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261305472 00000100:00100000:3.0:1746065077.743886:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11851 00000100:00100000:3.0:1746065077.743892:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27835:x1830881261305472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.743908:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.743923:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3800/0xad6b7ddc1460931 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c073 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.744003:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065077.744015:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.744020:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.744044:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.744053:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 273 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.744063:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262601216:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065077.744133:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065077.746974:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262601216:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.746995:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065077.747045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.747091:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261305600 00000100:00100000:2.0:1746065077.747096:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261305600 00010000:00010000:2.0:1746065077.747120:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 274 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.747594:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3519 00000100:00100000:2.0:1746065077.747602:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+274:2005:x1830881261305600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.747614:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.747619:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 274 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.747629:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 274 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.747648:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460923 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c065 expref: 274 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.747674:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.747678:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.747686:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.747692:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.748172:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.748209:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.748215:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065077.748237:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 5 00010000:00010000:3.0:1746065077.748342:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3800/0xad6b7ddc1460931 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.748369:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.748374:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.748377:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065077.748379:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:2.0:1746065077.748430:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+274:2005:x1830881261305600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 828us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.748436:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3519 00000100:00100000:3.0:1746065077.749071:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27835:x1830881261305472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5176us (5313us total) trans 4294975263 rc 0/0 00000100:00100000:3.0:1746065077.749077:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11851 00000100:00100000:0.0:1746065077.749835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.749898:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261305728 00000100:00100000:3.0:1746065077.749903:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261305728 00000100:00100000:3.0:1746065077.750054:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11852 00000100:00100000:3.0:1746065077.750061:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27836:x1830881261305728:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1746065077.750077:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.750090:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3e00/0xad6b7ddc1460946 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c07a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.750132:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065077.750140:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.750148:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.750156:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065077.750161:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.750165:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.750219:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065077.750228:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.750234:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 4/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.750256:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.750266:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 274 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.750276:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262601344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065077.750342:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.751493:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.751985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.752043:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262601344:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.752060:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065077.752103:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261305856 00000100:00100000:2.0:1746065077.752108:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261305856 00000100:00100000:2.0:1746065077.752143:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11853 00000100:00100000:2.0:1746065077.752150:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27835:x1830881261305856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.752167:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.752178:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460962 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c081 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.752245:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.752253:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.752259:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065077.752271:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261305984 00000100:00100000:2.0:1746065077.752274:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261305984 00010000:00010000:2.0:1746065077.752284:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 277 pid: 7204 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.752309:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3520 00000100:00100000:2.0:1746065077.752315:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+277:2007:x1830881261305984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.752322:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.752327:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 277 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.752335:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 277 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.752348:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460938 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x31f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c073 expref: 277 pid: 7204 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.752375:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.752378:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.752384:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.752388:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.752394:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.752398:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.752402:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.752416:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.752601:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.752608:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065077.752634:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+276:2007:x1830881261305984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 318us (648us total) trans 0 rc 0/0 00000004:00200000:3.0:1746065077.752640:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 5 00000100:00100000:2.0:1746065077.752640:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3520 00000004:00200000:3.0:1746065077.752643:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065077.752656:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.752657:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.752661:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.752664:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.752672:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065077.752672:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 5 00000004:00200000:2.0:1746065077.752674:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1746065077.752677:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00000004:00010000:2.0:1746065077.752679:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.752682:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065077.752696:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc1460962 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c081 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.752705:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c081 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.752710:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.752712:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.752714:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b0800, rc 0) 00000100:00100000:2.0:1746065077.752795:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27835:x1830881261305856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 645us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.752800:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11853 00010000:00010000:3.0:1746065077.753462:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753467:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.753470:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753475:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753482:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c000) 00010000:00010000:3.0:1746065077.753484:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.753487:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753491:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc146094d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753500:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753503:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753507:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753510:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.753512:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753516:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753525:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:3.0:1746065077.753526:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.753528:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753531:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc1460954 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.753554:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3e00/0xad6b7ddc1460946 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c07a expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.753565:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c07a expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.753569:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.753571:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065077.753572:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3000, rc 0) 00000100:00100000:3.0:1746065077.753617:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27836:x1830881261305728:12345-192.168.202.27@tcp:101:rm.0 Request processed in 3556us (3784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.753622:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11852 00000100:00100000:0.0:1746065077.755974:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.756123:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261306112 00000100:00100000:2.0:1746065077.756130:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261306112 00000100:00100000:2.0:1746065077.756212:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 540 00000100:00100000:0.0:1746065077.756255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.756310:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261306368 00000100:00100000:3.0:1746065077.756313:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261306368 00000100:00100000:3.0:1746065077.756341:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11854 00000100:00100000:3.0:1746065077.756346:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27835:x1830881261306368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.756360:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.756376:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460970 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c088 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.756465:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460977 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00000100:00100000:1.0:1746065077.756476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065077.756477:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460977 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065077.756485:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460977 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065077.756494:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 5 00000100:00100000:0.0:1746065077.756527:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261306624 00000100:00100000:0.0:1746065077.756530:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261306624 00000100:00100000:0.0:1746065077.756556:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11855 00000100:00100000:0.0:1746065077.756562:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:27836:x1830881261306624:12345-192.168.202.27@tcp:36:rm.0 00000100:00100000:2.0:1746065077.756563:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+274:2006:x1830881261306112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.756573:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.756593:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065077.756606:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc14608ba lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c050 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.756609:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460969 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c081 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.756619:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.756622:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065077.756625:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc146095b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c07a expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.756633:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc1460882 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c03b expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.756642:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065077.756644:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065077.756655:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+274:2006:x1830881261306112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 437us (689us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065077.756658:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065077.756661:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 540 00010000:00010000:0.0:1746065077.756663:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.756669:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.756677:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.756681:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.756686:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.756953:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460970 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c088 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.756964:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460977 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c088 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.756969:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.756971:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065077.756973:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2000, rc 0) 00000100:00100000:3.0:1746065077.756996:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27835:x1830881261306368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 649us (741us total) trans 4294975264 rc 0/0 00000100:00100000:3.0:1746065077.757001:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11854 00010000:00010000:0.0:1746065077.757457:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065077.757465:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757470:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:0.0:1746065077.757635:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x31f:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1746065077.757684:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757690:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757695:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757699:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.757702:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757708:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757715:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065077.757717:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065077.757719:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757723:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460993 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757733:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757737:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757741:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757744:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757748:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.757749:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757753:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757758:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34400) 00010000:00010000:0.0:1746065077.757759:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065077.757761:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757765:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1460985 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:0.0:1746065077.757793:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5f2300 reply state ffff88009c234000 transno 4294975265 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757801:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.757805:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:0.0:1746065077.757807:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065077.757809:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065077.757840:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27836:x1830881261306624:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1278us (1363us total) trans 4294975265 rc 0/0 00000100:00100000:0.0:1746065077.757845:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11855 00000100:00100000:0.0:1746065077.759749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.760011:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261306752 00000100:00100000:2.0:1746065077.760020:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261306752 00000100:00100000:2.0:1746065077.760064:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11856 00000100:00100000:2.0:1746065077.760071:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27835:x1830881261306752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.760116:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.760129:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1c00/0xad6b7ddc146099a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c08f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.760169:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1c00/0xad6b7ddc146099a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c08f expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.760179:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1c00/0xad6b7ddc146099a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c08f expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.760191:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.760193:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065077.760195:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1c00, rc 0) 00000100:00100000:2.0:1746065077.760337:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27835:x1830881261306752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 265us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.760342:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11856 00000100:00100000:1.0:1746065077.764535:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.765496:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261306880 00000100:00100000:3.0:1746065077.765509:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261306880 00000100:00100000:3.0:1746065077.765569:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8328 00000100:00100000:3.0:1746065077.765585:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261306880:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065077.765626:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.765648:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 72 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.765654:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065077.765656:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065077.765659:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.765686:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 72 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.765697:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 72 pid: 9549 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.765708:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262601472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065077.765867:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.767707:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.767756:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307008 00000100:00100000:2.0:1746065077.767762:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307008 00000100:00100000:2.0:1746065077.767823:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11857 00000100:00100000:2.0:1746065077.767830:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27837:x1830881261307008:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.767842:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.767856:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc14609a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c096 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.767902:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.767912:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767920:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767926:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.767931:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767935:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767966:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767970:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767974:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767978:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767983:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.767986:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767991:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.767999:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:2.0:1746065077.768002:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.768005:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768009:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc14609af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768028:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768032:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768035:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768039:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.768041:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768046:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768052:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:2.0:1746065077.768054:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.768056:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768060:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0600/0xad6b7ddc14609b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.768079:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc14609a8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c096 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.768089:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0400/0xad6b7ddc14609a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c096 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.768097:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b0400, rc 0) 00000100:00100000:2.0:1746065077.768136:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27837:x1830881261307008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 306us (433us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.768141:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11857 00000100:00100000:3.0:1746065077.770332:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262601472:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065077.770352:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.770813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.770920:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307136 00000100:00100000:2.0:1746065077.770926:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307136 00000100:00100000:2.0:1746065077.770974:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11858 00000100:00100000:2.0:1746065077.770982:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27837:x1830881261307136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.770997:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.771015:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14609bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c09d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.771058:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.771066:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771074:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771082:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.771087:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771096:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065077.771332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.771380:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307264 00000100:00100000:3.0:1746065077.771384:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307264 00002000:00100000:3.0:1746065077.771412:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x342:0x0] (0->4) req@ffff88009835bb80 x1830881261307264/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:748/0 lens 496/0 e 0 to 0 dl 1746065088 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065077.771420:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009835bb80 with x1830881261307264 ext(0->4) 00010000:00010000:3.0:1746065077.771427:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 73 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.771438:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 73 pid: 9549 timeout: 773 lvb_type: 0 00002000:00010000:3.0:1746065077.771445:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009835bb80 00000100:00100000:3.0:1746065077.771473:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 211 00000100:00100000:3.0:1746065077.771479:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261307264:12345-192.168.202.27@tcp:4:bash.0 00010000:00010000:2.0:1746065077.771508:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771513:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771517:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771521:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771525:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1bd3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.771528:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771532:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771541:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72300) 00010000:00010000:2.0:1746065077.771543:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.771545:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771549:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14609c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771558:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771561:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771565:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771569:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.771570:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771586:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771591:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:2.0:1746065077.771593:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.771595:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771598:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc14609cb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.771621:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14609bd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c09d expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.771627:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bee800/0xad6b7ddc14609bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c09d expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.771636:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee800, rc 0) 00000100:00100000:2.0:1746065077.771674:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27837:x1830881261307136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 693us (862us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.771679:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11858 00000100:00100000:3.0:1746065077.772224:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+75:2005:x1830881261307264:12345-192.168.202.27@tcp:4:bash.0 Request processed in 743us (891us total) trans 21474839709 rc 0/0 00000100:00100000:3.0:1746065077.772230:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 211 00002000:00100000:3.0:1746065077.772235:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x342:0x0] (0->4) req@ffff88009835bb80 x1830881261307264/t21474839709(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:748/0 lens 496/448 e 0 to 0 dl 1746065088 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065077.772242:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009835bb80 with x1830881261307264 ext(0->4) 00010000:00010000:3.0:1746065077.772247:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 75 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.772256:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 75 pid: 9549 timeout: 773 lvb_type: 0 00002000:00010000:3.0:1746065077.772261:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009835bb80 00000100:00100000:0.0:1746065077.773623:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.773663:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.773666:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307392 00000100:00100000:2.0:1746065077.773672:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307392 00000100:00100000:2.0:1746065077.773700:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11859 00000100:00100000:2.0:1746065077.773705:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27837:x1830881261307392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.773718:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.773735:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14609d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0a4 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.773759:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307520 00000100:00100000:3.0:1746065077.773762:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307520 00010000:00010000:2.0:1746065077.773795:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc14609d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.773805:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc14609d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.773813:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc14609d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065077.773847:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065077.773851:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065077.773857:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 75 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.773872:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14609d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0a4 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.773874:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3521 00000100:00100000:3.0:1746065077.773879:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+75:2004:x1830881261307520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.773883:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc14609d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0a4 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.773888:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.773889:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72200) 00010000:00010000:2.0:1746065077.773891:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065077.773893:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1800, rc 0) 00002000:00010000:3.0:1746065077.773898:0:8352:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1746065077.773900:0:8352:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1746065077.773904:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 75 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.773912:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 75 pid: 9549 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.773926:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1400/0xad6b7ddc1460900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c05e expref: 75 pid: 9549 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.773931:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27837:x1830881261307392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 226us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.773935:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11859 00010000:00010000:3.0:1746065077.773939:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.773940:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.773944:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.773951:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.774067:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065077.774072:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774079:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065077.774086:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+74:2004:x1830881261307520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 206us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.774091:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3521 00010000:00010000:0.0:1746065077.774092:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774103:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774109:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774114:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065077.774117:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774124:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774133:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.774138:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc14609a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065077.774186:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261306880:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 8609us (9660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.774192:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8328 00000100:00100000:0.0:1746065077.776289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.776364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.776423:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307776 00000100:00100000:2.0:1746065077.776429:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307776 00000100:00100000:2.0:1746065077.776465:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261307904 00000100:00100000:2.0:1746065077.776467:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261307904 00000100:00100000:2.0:1746065077.776481:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11860 00000100:00100000:2.0:1746065077.776486:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27835:x1830881261307776:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065077.776516:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.776532:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1c00/0xad6b7ddc146099a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c08f expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.776544:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.776547:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.776565:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.776572:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.776589:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:2.0:1746065077.776769:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2330, 88 off193192 00000004:00080000:2.0:1746065077.776797:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673795023295ns, next at 674466981116ns, rc = 0 00000040:00080000:2.0:1746065077.776827:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2334, 88 off193648 00000004:00080000:2.0:1746065077.776831:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673795057388ns, next at 674466957028ns, rc = 0 00000040:00080000:2.0:1746065077.776844:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2335, 88 off193736 00000004:00080000:2.0:1746065077.776847:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673795073115ns, next at 674466957028ns, rc = 0 00000040:00080000:2.0:1746065077.776855:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2331, 88 off193280 00000004:00080000:2.0:1746065077.776857:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673795083788ns, next at 674466981116ns, rc = 0 00000100:00100000:2.0:1746065077.776903:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11861 00000100:00100000:2.0:1746065077.776909:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27837:x1830881261307904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.776919:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.776929:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc14609e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0ab expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.776965:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.776972:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.776978:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.776986:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.776992:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.776997:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777023:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777029:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777033:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777039:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777044:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.777049:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777054:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777061:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72200) 00010000:00010000:2.0:1746065077.777065:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.777067:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777072:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14609ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777080:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777084:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777088:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777092:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.777094:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777098:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777104:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:2.0:1746065077.777106:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.777108:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777115:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc14609f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.777135:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc14609e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ab expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.777141:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc14609e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ab expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.777147:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2a00, rc 0) 00000100:00100000:2.0:1746065077.777185:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27837:x1830881261307904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 276us (820us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.777191:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11861 00000100:00100000:1.0:1746065077.782930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.782981:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261308160 00000100:00100000:2.0:1746065077.782991:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261308160 00000100:00100000:2.0:1746065077.783034:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11862 00000100:00100000:2.0:1746065077.783040:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27837:x1830881261308160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.783057:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.783060:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065077.783086:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc14609d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0a4 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.783105:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72200) 00010000:00010000:2.0:1746065077.783114:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.783127:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc14609fc lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0b2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.783228:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.783240:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.783250:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.783259:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.783266:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.783271:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:0.0:1746065077.784389:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975266 is committed 00000004:00080000:0.0:1746065077.784398:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1569 committed 00000004:00080000:0.0:1746065077.784414:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1579 committed 00000004:00080000:0.0:1746065077.784420:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1578 committed 00000004:00080000:0.0:1746065077.784421:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1568 committed 00000100:00100000:1.0:1746065077.784489:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065077.784505:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262601600:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.784554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.784605:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262601600 00000100:00100000:1.0:1746065077.784609:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262601600 00000100:00100000:1.0:1746065077.784636:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8329 00000100:00100000:1.0:1746065077.784642:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+185:3759:x1830881262601600:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.784754:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+186:3759:x1830881262601600:12345-0@lo:2:osp-syn-0-1.0 Request processed in 113us (200us total) trans 21474839710 rc 0/0 00000100:00100000:1.0:1746065077.784759:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8329 00000004:00080000:1.0:1746065077.784802:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3800/2, rc 0, transno 21474839710 00000100:00100000:1.0:1746065077.784806:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262601600:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065077.784849:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.784857:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.784863:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.784867:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abace00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.784870:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.784874:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.784883:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:3.0:1746065077.784885:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.784887:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.784891:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc146098c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.784936:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.784945:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.784952:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.784959:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x321:0x0]: returning size 0 00010000:00010000:2.0:1746065077.784977:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.784982:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.784986:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.784990:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.784995:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.784998:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.785002:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.785008:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:2.0:1746065077.785010:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.785012:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.785016:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460a03 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065077.785024:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5f0380 reply state ffff88012e372000 transno 4294975267 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.785031:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.785035:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:2.0:1746065077.785037:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065077.785039:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065077.785059:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc14609fc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.785069:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.785075:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:2.0:1746065077.785077:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.785079:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:2.0:1746065077.785110:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27837:x1830881261308160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2070us (2192us total) trans 4294975267 rc 0/0 00000100:00100000:2.0:1746065077.785116:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11862 00000100:00100000:2.0:1746065077.785133:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262601728:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.785152:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065077.785182:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065077.785186:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262601856:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065077.785200:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746065077.785225:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098359880 reply state ffff880134bd3400 transno 4294975266 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.785232:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.785237:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.785239:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065077.785240:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065077.785269:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065077.785276:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27835:x1830881261307776:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 8790us (8992us total) trans 4294975266 rc 0/0 00000100:00100000:2.0:1746065077.785281:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11860 00000100:00100000:1.0:1746065077.785325:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262601984:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.785346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.785367:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262601728 00000100:00100000:1.0:1746065077.785370:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262601728 00000100:00100000:1.0:1746065077.785384:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262601856 00000100:00100000:1.0:1746065077.785385:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262601856 00000100:00100000:1.0:1746065077.785394:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262601984 00000100:00100000:1.0:1746065077.785395:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262601984 00000100:00100000:1.0:1746065077.785406:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8330 00000100:00100000:1.0:1746065077.785410:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+186:3761:x1830881262601728:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.785476:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+187:3761:x1830881262601728:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (323us total) trans 21474839711 rc 0/0 00000100:00100000:1.0:1746065077.785481:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8330 00000100:00100000:1.0:1746065077.785491:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8331 00000100:00100000:1.0:1746065077.785495:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+220:3761:x1830881262601856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.785539:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8332 00000100:00100000:3.0:1746065077.785545:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+221:3759:x1830881262601984:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065077.785552:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065077.785554:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.785557:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065077.785558:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:1.0:1746065077.785559:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065077.785590:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+221:3761:x1830881262601856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 93us (388us total) trans 17179872437 rc 0/0 00000100:00100000:1.0:1746065077.785594:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8331 00000100:00100000:3.0:1746065077.785618:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+221:3759:x1830881262601984:12345-0@lo:2:osp-syn-1-1.0 Request processed in 74us (271us total) trans 17179872438 rc 0/0 00000100:00100000:3.0:1746065077.785623:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8332 00000004:00080000:1.0:1746065077.785634:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f57b80/2, rc 0, transno 17179872438 00000100:00100000:1.0:1746065077.785637:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262601984:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065077.785759:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54a80/2, rc 0, transno 17179872437 00000100:00100000:2.0:1746065077.785763:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262601856:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065077.785769:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3b80/2, rc 0, transno 21474839711 00000100:00100000:2.0:1746065077.785787:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262601728:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065077.787092:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.787101:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.787106:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.787110:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065077.787113:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.787119:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.787128:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065077.787130:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065077.787132:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065077.787137:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc14609e0 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065077.790750:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.790843:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261308416 00000100:00100000:2.0:1746065077.790851:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261308416 00000100:00100000:2.0:1746065077.790898:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11863 00000100:00100000:2.0:1746065077.790904:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27837:x1830881261308416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.790921:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.790936:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96200/0xad6b7ddc1460a1f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0b9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.791026:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.791037:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.791043:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.791066:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.791075:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 270 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.791084:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262602112:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065077.791973:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.792033:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261308544 00000100:00100000:2.0:1746065077.792037:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261308544 00000100:00100000:2.0:1746065077.792062:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11864 00000100:00100000:2.0:1746065077.792067:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27835:x1830881261308544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.792079:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.792088:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0c0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.792120:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.792130:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.792143:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.792146:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065077.792149:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96800, rc 0) 00000100:00100000:2.0:1746065077.792172:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:27835:x1830881261308544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.792177:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11864 00000100:00100000:2.0:1746065077.793314:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.794482:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262602112:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.794507:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065077.794970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.795033:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261308672 00000100:00100000:3.0:1746065077.795039:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261308672 00010000:00010000:3.0:1746065077.795073:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.795111:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3522 00000100:00100000:3.0:1746065077.795117:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+272:2004:x1830881261308672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.795128:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.795133:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.795144:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.795166:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a11 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b2 expref: 272 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.795199:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:3.0:1746065077.795204:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.795213:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.795219:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.795236:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065077.795289:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+271:2004:x1830881261308672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 171us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.795296:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3522 00010000:00010000:2.0:1746065077.795507:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.795513:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.795534:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x321:0x0]: returning size 0 00000100:00100000:0.0:1746065077.795829:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.795896:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261308800 00000100:00100000:0.0:1746065077.795901:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261308800 00000100:00100000:0.0:1746065077.795927:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11865 00000100:00100000:0.0:1746065077.795932:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27835:x1830881261308800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065077.795944:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065077.795955:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460a34 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0c7 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.796000:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460a3b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065077.796008:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460a3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.796014:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460a3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065077.796041:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x31f:0x0]: returning size 5 00000004:00200000:0.0:1746065077.796045:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065077.796056:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460a3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065077.796074:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460a34 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c7 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.796087:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460a3b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c7 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.796094:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065077.796096:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065077.796098:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1800, rc 0) 00000004:00080000:2.0:1746065077.796201:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x345:0x0], index 1: 0 00000004:00080000:2.0:1746065077.796207:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x344:0x0], index 0: 0 00000004:00080000:2.0:1746065077.796211:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x345:0x0], index 0: 0 00000004:00080000:2.0:1746065077.796214:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x346:0x0], index 1: 0 00010000:00010000:2.0:1746065077.796290:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.796297:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.796302:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.796307:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.796311:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.796316:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.796323:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:2.0:1746065077.796325:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065077.796327:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.796332:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a26 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065077.796880:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27835:x1830881261308800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 945us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.796889:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11865 00010000:00010000:2.0:1746065077.796950:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96200/0xad6b7ddc1460a1f lrc: 1/0,0 mode: --/CR res: [0x240000403:0x321:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b9 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.796957:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96200/0xad6b7ddc1460a1f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x321:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0b9 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.796967:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:2.0:1746065077.796985:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27837:x1830881261308416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6082us (6244us total) trans 4294975268 rc 301/301 00000100:00100000:2.0:1746065077.796993:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11863 00000100:00100000:0.0:1746065077.798963:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.799016:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.799091:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261309184 00000100:00100000:3.0:1746065077.799100:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261309184 00000100:00100000:2.0:1746065077.799137:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261308928 00000100:00100000:3.0:1746065077.799140:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4084 00000100:00100000:2.0:1746065077.799140:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261308928 00000100:00100000:3.0:1746065077.799146:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27837:x1830881261309184:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065077.799169:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8333 00000100:00100000:2.0:1746065077.799174:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261308928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.799184:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.799200:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0ce expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065077.799222:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x342:0x0] initial LVB size: 5, mtime: 0x6812d6b5, atime: 0x0, ctime: 0x6812d6b5, blocks: 0x8 00010000:00010000:2.0:1746065077.799237:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.799239:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.799245:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 74 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.799257:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 74 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.799264:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96a00, rc 0) 00000100:00100000:2.0:1746065077.799309:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+74:2004:x1830881261308928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 135us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.799314:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8333 00000100:00100000:3.0:1746065077.799333:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27837:x1830881261309184:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 187us (316us total) trans 4294975269 rc 0/0 00000100:00100000:3.0:1746065077.799339:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4084 00000100:00100000:0.0:1746065077.803866:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.803903:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.805314:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261309568 00000100:00100000:3.0:1746065077.805324:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261309568 00000100:00100000:3.0:1746065077.805959:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8334 00000100:00100000:3.0:1746065077.805968:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+74:2004:x1830881261309568:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065077.806074:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+74:2004:x1830881261309568:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 107us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.806079:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8334 00000100:00100000:3.0:1746065077.806117:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261309440 00000100:00100000:3.0:1746065077.806120:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261309440 00000100:00100000:3.0:1746065077.806139:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4085 00000100:00100000:3.0:1746065077.806143:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27837:x1830881261309440:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065077.807040:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27837:x1830881261309440:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 894us (3180us total) trans 4294975270 rc 0/0 00000100:00100000:3.0:1746065077.807046:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4085 00000100:00100000:0.0:1746065077.815413:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.815452:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.815556:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261309824 00000100:00100000:2.0:1746065077.815565:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261309824 00000100:00100000:2.0:1746065077.815622:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11866 00000100:00100000:2.0:1746065077.815630:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261309824:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:3.0:1746065077.815682:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261309952 00000100:00100000:3.0:1746065077.815686:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261309952 00000100:00100000:3.0:1746065077.815708:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8335 00000100:00100000:3.0:1746065077.815713:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+74:2006:x1830881261309952:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065077.815835:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+74:2006:x1830881261309952:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.815841:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8335 00010000:00010000:2.0:1746065077.816107:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.816851:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1460a50 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0d5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.816977:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.816988:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.816998:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817006:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.817011:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817016:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817053:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1460a65 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.817057:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1460a65 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817061:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1460a65 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065077.817069:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x321:0x0]: returning size 0 00010000:00010000:2.0:1746065077.817124:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817132:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817137:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817141:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817145:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.817148:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817152:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817160:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:2.0:1746065077.817163:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.817166:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817169:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460a57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817177:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817180:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817184:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817187:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.817190:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817193:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817198:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:2.0:1746065077.817199:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.817201:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817205:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96600/0xad6b7ddc1460a5e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.817231:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1460a50 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0d5 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.817243:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1460a65 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0d5 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.817249:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.817250:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.817252:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:2.0:1746065077.817841:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261309824:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2209us (2434us total) trans 4294975271 rc 0/0 00000100:00100000:2.0:1746065077.817847:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11866 00000100:00100000:1.0:1746065077.821878:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.821922:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261310208 00000100:00100000:3.0:1746065077.821930:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261310208 00000100:00100000:1.0:1746065077.821967:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.821975:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261310336 00000100:00100000:3.0:1746065077.821978:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261310336 00000100:00100000:3.0:1746065077.821995:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11867 00000100:00100000:2.0:1746065077.822123:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11868 00000100:00100000:2.0:1746065077.822130:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261310336:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:3.0:1746065077.822166:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27835:x1830881261310208:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065077.822213:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.822230:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96200/0xad6b7ddc1460a73 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0dc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.822286:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.822304:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460a3b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x31f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c7 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.822628:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a7a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.822639:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.822647:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.822722:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96200/0xad6b7ddc1460a73 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0dc expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.822733:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a7a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0dc expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.822740:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.822742:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065077.822745:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00010000:00010000:3.0:1746065077.822833:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.822836:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.822855:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.822862:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.822868:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065077.823344:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925c9f80 reply state ffff88008f10e000 transno 4294975272 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.823353:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.823358:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.823360:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065077.823362:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065077.823610:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261310336:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1479us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.823617:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11868 00000100:00100000:3.0:1746065077.824493:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27835:x1830881261310208:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 2379us (2621us total) trans 4294975272 rc 0/0 00000100:00100000:3.0:1746065077.824499:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11867 00000100:00100000:0.0:1746065077.830067:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.832107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.832206:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261310720 00000100:00100000:3.0:1746065077.832215:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261310720 00000100:00100000:2.0:1746065077.832521:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261310464 00000100:00100000:2.0:1746065077.832527:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261310464 00000100:00100000:2.0:1746065077.832559:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8336 00000100:00100000:2.0:1746065077.832566:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+74:27835:x1830881261310464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.832587:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.832601:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0e3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.832628:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.832636:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.832637:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.832640:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 75 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.832668:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.832677:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746065077.832687:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262602240:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.832767:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065077.832973:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11869 00000100:00100000:3.0:1746065077.832978:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261310720:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065077.833016:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.833035:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1460a65 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0d5 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.833050:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065077.833053:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.833202:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.833212:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.833220:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065077.833250:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975273 00000004:00010000:3.0:1746065077.833262:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009576ca80 reply state ffff88009c237000 transno 4294975274 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.833269:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.833274:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065077.833276:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065077.833279:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065077.833336:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261310720:12345-192.168.202.27@tcp:36:bash.0 Request processed in 357us (1236us total) trans 4294975274 rc 0/0 00000100:00100000:3.0:1746065077.833341:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11869 00000020:00080000:3.0:1746065077.833347:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065077.837874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.837939:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261310848 00000100:00100000:2.0:1746065077.837950:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261310848 00000100:00100000:2.0:1746065077.838002:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11870 00000100:00100000:2.0:1746065077.838009:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261310848:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.838032:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.838049:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1460a96 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0ea expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.838094:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1460a96 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ea expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.838109:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1460a96 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ea expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.838122:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.838124:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065077.838127:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:2.0:1746065077.838176:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261310848:12345-192.168.202.27@tcp:101:bash.0 Request processed in 168us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.838182:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11870 00000100:00100000:2.0:1746065077.838656:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262602240:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.838678:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 75 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.838690:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96600, rc 0) 00000100:00100000:2.0:1746065077.838709:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+75:27835:x1830881261310464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6144us (8653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.838715:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8336 00000100:00100000:0.0:1746065077.839879:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.840407:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261310976 00000100:00100000:2.0:1746065077.840413:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261310976 00010000:00010000:2.0:1746065077.840441:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 773 lvb_type: 1 00000100:00100000:2.0:1746065077.840474:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3523 00000100:00100000:2.0:1746065077.840481:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+75:2005:x1830881261310976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.840490:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.840509:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 773 lvb_type: 1 00010000:00010000:2.0:1746065077.840518:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 773 lvb_type: 1 00010000:00010000:2.0:1746065077.840537:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc1460a49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ce expref: 75 pid: 12260 timeout: 773 lvb_type: 1 00010000:00010000:2.0:1746065077.840548:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.840550:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.840555:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 74 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.840562:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 74 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.840599:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 74 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065077.840609:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262602368:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065077.840689:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.841749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.842302:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261311232 00000100:00100000:3.0:1746065077.842307:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261311232 00000100:00100000:3.0:1746065077.842355:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11871 00000100:00100000:3.0:1746065077.842361:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261311232:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065077.842376:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.842379:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065077.842398:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1460a96 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ea expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.842410:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065077.842414:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.842424:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1460a9d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0f1 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.842464:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460aa4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.842473:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460aa4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.842481:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460aa4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:3.0:1746065077.842678:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2336, 88 off193824 00000004:00080000:3.0:1746065077.842684:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673860909193ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065077.842719:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2332, 88 off193368 00000004:00080000:3.0:1746065077.842722:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673860948618ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065077.842740:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2333, 88 off193456 00000004:00080000:3.0:1746065077.842742:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673860968914ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065077.842750:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2337, 88 off193912 00000004:00080000:3.0:1746065077.842752:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673860978320ns, next at 674466957028ns, rc = 0 00000100:00100000:0.0:1746065077.844571:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262602368:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065077.844600:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065077.844655:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261310976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4173us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.844664:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3523 00000100:00100000:2.0:1746065077.848224:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.848253:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261311360 00000100:00100000:2.0:1746065077.848260:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261311360 00000100:00100000:2.0:1746065077.848291:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8337 00000100:00100000:2.0:1746065077.848296:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261311360:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065077.848410:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065077.848414:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:2.0:1746065077.848415:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb atime from disk: 0 -> 1746065077 00002000:00010000:2.0:1746065077.848417:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb ctime from disk: 1746065077 -> 1746065078 00002000:00010000:2.0:1746065077.848418:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065077.848458:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+75:2005:x1830881261311360:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 161us (241us total) trans 21474839712 rc 0/0 00000100:00100000:2.0:1746065077.848464:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8337 00000001:00080000:0.0:1746065077.848826:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975275 is committed 00000004:00080000:0.0:1746065077.848832:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1581 committed 00000004:00080000:0.0:1746065077.848847:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1571 committed 00010000:00010000:1.0:1746065077.848891:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848900:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848907:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848912:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.848916:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848921:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848933:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:1.0:1746065077.848935:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.848938:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848942:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1460a0a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848972:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848977:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848981:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848984:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.848987:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848990:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.848997:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:1.0:1746065077.848999:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.849002:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849005:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1460a81 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849014:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849019:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849023:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849027:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.849028:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849032:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849038:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:1.0:1746065077.849040:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065077.849042:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065077.849046:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460a8f lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x321:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065077.849078:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262602496:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.849115:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065077.849217:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1570 committed 00000004:00080000:0.0:1746065077.849220:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1580 committed 00000100:00100000:3.0:1746065077.850628:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262602624:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.850658:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065077.850660:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.850665:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262602880:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065077.850675:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065077.850680:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262602752:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.850685:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.850694:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065077.850709:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262602496 00000100:00100000:1.0:1746065077.850713:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262602496 00000100:00100000:3.0:1746065077.850714:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262602624 00000100:00100000:3.0:1746065077.850717:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262602624 00000100:00100000:1.0:1746065077.850742:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262602880 00000100:00100000:1.0:1746065077.850744:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262602880 00000100:00100000:3.0:1746065077.851198:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262602752 00000100:00100000:3.0:1746065077.851202:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262602752 00000100:00100000:2.0:1746065077.851297:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8338 00000100:00100000:2.0:1746065077.851304:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+222:3760:x1830881262602496:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.851306:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8339 00000100:00100000:1.0:1746065077.851313:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+222:3761:x1830881262602624:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.851387:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8340 00000100:00100000:1.0:1746065077.851392:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+188:3760:x1830881262602880:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.851419:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+224:3760:x1830881262602496:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (2303us total) trans 17179872439 rc 0/0 00000100:00100000:2.0:1746065077.851425:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8338 00000100:00100000:2.0:1746065077.851442:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8341 00000100:00100000:2.0:1746065077.851447:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+188:3761:x1830881262602752:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065077.851493:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dea00/2, rc 0, transno 17179872439 00000100:00100000:2.0:1746065077.851498:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262602496:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065077.851506:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+190:3760:x1830881262602880:12345-0@lo:2:osp-syn-0-1.0 Request processed in 114us (820us total) trans 21474839713 rc 0/0 00000004:00080000:2.0:1746065077.851507:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925c8700/2, rc 0, transno 21474839713 00000100:00100000:2.0:1746065077.851510:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262602880:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.851512:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8340 00000100:00100000:2.0:1746065077.851541:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+189:3761:x1830881262602752:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (845us total) trans 21474839714 rc 0/0 00000100:00100000:2.0:1746065077.851545:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8341 00000100:00100000:1.0:1746065077.851548:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+223:3761:x1830881262602624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 236us (888us total) trans 17179872440 rc 0/0 00000100:00100000:1.0:1746065077.851552:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8339 00000004:00080000:3.0:1746065077.851985:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925ca680/2, rc 0, transno 21474839714 00000100:00100000:3.0:1746065077.851989:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262602752:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065077.852002:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dd500/2, rc 0, transno 17179872440 00000100:00100000:3.0:1746065077.852005:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262602624:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065077.852049:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460aa4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x321:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f1 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.852058:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065077.852061:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065077.852072:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1460a9d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f1 expref: 270 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065077.852085:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460aa4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x321:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f1 expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.852105:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065077.852108:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065077.852110:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2a00, rc 0) 00000100:00100000:3.0:1746065077.852143:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:26180:x1830881261311232:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9782us (10397us total) trans 4294975275 rc 0/0 00000100:00100000:3.0:1746065077.852148:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11871 00000100:00100000:0.0:1746065077.852619:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.853168:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261311616 00000100:00100000:3.0:1746065077.853173:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261311616 00000100:00100000:3.0:1746065077.853202:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4086 00000100:00100000:3.0:1746065077.853208:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27835:x1830881261311616:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:3.0:1746065077.853244:0:7207:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x31f:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460977 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c088 expref: 269 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.853273:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065077.853283:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 269 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.853289:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 4/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.853311:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 269 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.853320:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 269 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.853330:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262603008:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065077.853384:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065077.855398:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.856113:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262603008:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.856122:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261311744 00000100:00100000:2.0:1746065077.856128:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261311744 00010000:00010000:3.0:1746065077.856133:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:2.0:1746065077.856176:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8342 00000100:00100000:2.0:1746065077.856182:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+82:26180:x1830881261311744:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.856197:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.856223:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0f8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065077.856242:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065077.856259:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.856261:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.856267:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 83 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.856279:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 83 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.856287:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c000, rc 0) 00000100:00100000:2.0:1746065077.856346:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+83:26180:x1830881261311744:12345-192.168.202.27@tcp:101:bash.0 Request processed in 164us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.856351:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8342 00000100:00100000:0.0:1746065077.860510:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.860584:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261311872 00000100:00100000:2.0:1746065077.860592:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261311872 00010000:00010000:2.0:1746065077.860622:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 270 pid: 7231 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.860657:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3524 00000100:00100000:2.0:1746065077.860663:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+270:2004:x1830881261311872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065077.860673:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065077.860678:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 270 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.860692:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 270 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.860709:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460a2d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0c0 expref: 270 pid: 7231 timeout: 773 lvb_type: 0 00010000:00010000:2.0:1746065077.860730:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.860735:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: --/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.860742:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.860748:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.860765:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065077.860825:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+269:2004:x1830881261311872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 162us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.860831:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3524 00010000:00010000:3.0:1746065077.860895:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.860901:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000040:00080000:3.0:1746065077.861087:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2334, 88 off193544 00000004:00080000:3.0:1746065077.861092:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673879318159ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065077.861112:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2338, 88 off194000 00000004:00080000:3.0:1746065077.861115:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673879341232ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065077.861124:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2339, 88 off194088 00000004:00080000:3.0:1746065077.861126:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673879352610ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065077.861133:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2335, 88 off193632 00000004:00080000:3.0:1746065077.861135:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673879361398ns, next at 674466981116ns, rc = 0 00000100:00100000:0.0:1746065077.862684:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.862733:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261312000 00000100:00100000:2.0:1746065077.862740:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261312000 00000100:00100000:2.0:1746065077.862795:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8343 00000100:00100000:2.0:1746065077.862802:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+75:26180:x1830881261312000:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.862815:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.862829:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c0ff expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065077.862846:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065077.862862:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.862863:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.862870:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 76 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.862881:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 76 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.862889:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c400, rc 0) 00000100:00100000:2.0:1746065077.862931:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+76:26180:x1830881261312000:12345-192.168.202.27@tcp:101:bash.0 Request processed in 130us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.862936:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8343 00000100:00100000:1.0:1746065077.868972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065077.869021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.869092:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261312256 00000100:00100000:3.0:1746065077.869101:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261312256 00002000:00010000:3.0:1746065077.869137:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/836 (0->18446744073709551615) 00002000:00100000:3.0:1746065077.869141:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cbb80 with x1830881261312256 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065077.869152:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cbb80. 00000100:00100000:3.0:1746065077.869169:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261312128 00000100:00100000:3.0:1746065077.869171:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261312128 00002000:00010000:3.0:1746065077.869179:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/837 (0->18446744073709551615) 00002000:00100000:3.0:1746065077.869181:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925caa00 with x1830881261312128 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065077.869186:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925caa00. 00000100:00100000:3.0:1746065077.869207:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1235 00000100:00100000:3.0:1746065077.869214:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+76:2005:x1830881261312256:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:2.0:1746065077.869236:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1236 00000100:00100000:2.0:1746065077.869244:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+83:2004:x1830881261312128:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065077.869345:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x344:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065077.869345:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x345:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065077.869348:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x344:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065077.869348:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x345:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:3.0:1746065077.869350:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x344:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.869350:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x345:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.869351:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x345:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:3.0:1746065077.869352:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x344:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:3.0:1746065077.869353:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x344:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1746065077.869353:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x345:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065077.869646:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261312256:12345-192.168.202.27@tcp:10:bash.0 Request processed in 430us (682us total) trans 21474839715 rc 0/0 00000100:00100000:3.0:1746065077.869652:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1235 00002000:00010000:3.0:1746065077.869655:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/836 (0->18446744073709551615) 00002000:00100000:3.0:1746065077.869657:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cbb80 with x1830881261312256 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065077.869661:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cbb80. 00000100:00100000:2.0:1746065077.869999:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+84:2004:x1830881261312128:12345-192.168.202.27@tcp:10:bash.0 Request processed in 754us (976us total) trans 17179872441 rc 0/0 00000100:00100000:2.0:1746065077.870006:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1236 00002000:00010000:2.0:1746065077.870008:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/837 (0->18446744073709551615) 00002000:00100000:2.0:1746065077.870010:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925caa00 with x1830881261312128 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065077.870014:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925caa00. 00000001:00080000:0.0:1746065077.873461:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975276 is committed 00000004:00080000:0.0:1746065077.873471:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1573 committed 00000004:00080000:0.0:1746065077.873489:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1583 committed 00000004:00080000:0.0:1746065077.873504:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1582 committed 00000004:00080000:0.0:1746065077.873506:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1572 committed 00000100:00100000:3.0:1746065077.873607:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262603264:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.873607:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262603392:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.873714:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262603520:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.873755:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262603136:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.875388:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065077.875417:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065077.875455:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262603264 00000100:00100000:2.0:1746065077.875460:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262603264 00000004:00010000:3.0:1746065077.875478:0:7207:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009576f100 reply state ffff88008c52e000 transno 4294975276 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:2.0:1746065077.875488:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262603392 00000100:00100000:2.0:1746065077.875490:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262603392 00010000:00010000:3.0:1746065077.875495:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065077.875502:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00000100:00100000:2.0:1746065077.875502:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8344 00010000:00010000:3.0:1746065077.875505:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065077.875507:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+190:3761:x1830881262603264:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065077.875509:0:7207:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065077.875514:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:3.0:1746065077.875515:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065077.875520:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460977 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c088 expref: 268 pid: 7204 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746065077.875605:0:7207:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065077.875616:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:27835:x1830881261311616:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 22407us (22997us total) trans 4294975276 rc 0/0 00002000:00010000:2.0:1746065077.875619:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065077.875621:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:2.0:1746065077.875623:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb atime from disk: 1746065077 -> 1746065077 00000100:00100000:3.0:1746065077.875624:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4086 00002000:00010000:2.0:1746065077.875625:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:2.0:1746065077.875627:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x342:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065077.875645:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8345 00000100:00100000:2.0:1746065077.875647:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+191:3761:x1830881262603264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 140us (266us total) trans 21474839716 rc 0/0 00000100:00100000:3.0:1746065077.875650:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+191:3762:x1830881262603392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.875652:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8344 00010000:00010000:2.0:1746065077.875668:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.875674:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.875679:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.875684:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.875687:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.875692:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065077.875703:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065077.875705:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065077.875707:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:3.0:1746065077.875711:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+191:3762:x1830881262603392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 60us (295us total) trans 21474839717 rc 0/0 00010000:00010000:2.0:1746065077.875711:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460aab lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:3.0:1746065077.875715:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8345 00000004:00080000:3.0:1746065077.875742:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c525f80/2, rc 0, transno 21474839716 00000004:00080000:2.0:1746065077.875742:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c524000/2, rc 0, transno 21474839717 00000100:00100000:3.0:1746065077.875746:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262603264:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065077.875746:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262603392:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065077.875980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065077.876442:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262603520 00000100:00100000:3.0:1746065077.876446:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262603520 00000100:00100000:3.0:1746065077.876472:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8346 00000100:00100000:3.0:1746065077.876476:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+223:3759:x1830881262603520:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065077.877281:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+224:3759:x1830881262603520:12345-0@lo:2:osp-syn-1-1.0 Request processed in 801us (1298us total) trans 17179872442 rc 0/0 00000100:00100000:3.0:1746065077.877286:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8346 00000100:00100000:3.0:1746065077.877313:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065077.877771:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54e00/2, rc 0, transno 17179872442 00000100:00100000:1.0:1746065077.877795:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262603520:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065077.877842:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262603136 00000100:00100000:2.0:1746065077.877845:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262603136 00000100:00100000:2.0:1746065077.877864:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8347 00000100:00100000:2.0:1746065077.877869:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+224:3760:x1830881262603136:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065077.877932:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065077.877935:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb mtime from disk: 1746065077 -> 1746065077 00002000:00010000:2.0:1746065077.877937:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065077.877938:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb ctime from disk: 1746065077 -> 1746065077 00002000:00010000:2.0:1746065077.877940:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x343:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065077.877964:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+225:3760:x1830881262603136:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (649us total) trans 17179872443 rc 0/0 00000100:00100000:2.0:1746065077.877969:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8347 00000004:00080000:3.0:1746065077.878092:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f55880/2, rc 0, transno 17179872443 00000100:00100000:3.0:1746065077.878096:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262603136:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065077.878423:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.878462:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.879806:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261312640 00000100:00100000:2.0:1746065077.879813:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261312640 00000100:00100000:2.0:1746065077.879863:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11872 00000100:00100000:2.0:1746065077.879869:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+267:27835:x1830881261312640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.879886:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.879908:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d200/0xad6b7ddc1460ac0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c106 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.879954:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d200/0xad6b7ddc1460ac0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c106 expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.879966:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d200/0xad6b7ddc1460ac0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x31f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c106 expref: 268 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.879980:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff880097e34f00) 00010000:00010000:2.0:1746065077.879982:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065077.879985:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d200, rc 0) 00000100:00100000:2.0:1746065077.880031:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27835:x1830881261312640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 161us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.880036:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11872 00000100:00100000:3.0:1746065077.880085:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261312512 00000100:00100000:3.0:1746065077.880089:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261312512 00000100:00100000:3.0:1746065077.880117:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4087 00000100:00100000:3.0:1746065077.880122:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+268:26180:x1830881261312512:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065077.880278:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:26180:x1830881261312512:12345-192.168.202.27@tcp:35:bash.0 Request processed in 156us (1856us total) trans 4294975277 rc 0/0 00000100:00100000:3.0:1746065077.880283:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4087 00000100:00100000:3.0:1746065077.886319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.886365:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.886427:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261312896 00000100:00100000:0.0:1746065077.886434:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261312896 00000100:00100000:0.0:1746065077.886481:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4088 00000100:00100000:0.0:1746065077.886488:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27835:x1830881261312896:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065077.886678:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x31f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065077.886725:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2336, 64 off193696 00000040:00080000:0.0:1746065077.886744:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2340, 64 off194152 00000040:00080000:0.0:1746065077.886751:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2341, 64 off194216 00000040:00080000:0.0:1746065077.886758:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2337, 64 off193760 00010000:00010000:0.0:1746065077.886819:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065077.886831:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065077.886840:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065077.886847:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065077.886851:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065077.886857:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065077.886867:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065077.886997:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27835:x1830881261312896:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 509us (686us total) trans 4294975278 rc 0/0 00000100:00100000:0.0:1746065077.887003:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4088 00000100:00100000:2.0:1746065077.887422:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261313024 00000100:00100000:2.0:1746065077.887426:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261313024 00000100:00100000:2.0:1746065077.887453:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11873 00000100:00100000:2.0:1746065077.887460:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27838:x1830881261313024:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1746065077.887472:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.887482:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460ace lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c10d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.887519:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.887526:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887532:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887542:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.887547:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887552:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887600:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.887607:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887613:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065077.887635:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x321:0x0]: returning size 5 00000004:00200000:2.0:1746065077.887639:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065077.887651:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887657:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887663:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887668:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887672:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887681:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887685:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.887689:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887694:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887702:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.887705:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.887708:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887711:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460ad5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887724:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887728:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887733:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887736:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.887738:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887742:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887750:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.887752:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.887754:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887757:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460adc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.887793:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460ace lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c10d expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.887805:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c10d expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.887810:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.887812:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065077.887814:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835da00, rc 0) 00000100:00100000:2.0:1746065077.887845:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27838:x1830881261313024:12345-192.168.202.27@tcp:101:rm.0 Request processed in 386us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.887851:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11873 00010000:00010000:1.0:1746065077.888045:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065077.888051:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.888056:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b1000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065077.888059:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.888064:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.888071:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x31f:0x0].0x0 (ffff880097e34f00) 00010000:00010000:1.0:1746065077.888073:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065077.888075:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.888079:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460ac7 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x31f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065077.888091:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.888092:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.888094:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065077.898284:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.900624:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261313280 00000100:00100000:2.0:1746065077.900634:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261313280 00000100:00100000:2.0:1746065077.900696:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11874 00000100:00100000:2.0:1746065077.900704:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27838:x1830881261313280:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065077.900752:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065077.900790:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460aa4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x321:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f1 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.900827:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460ae3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c10d expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.900838:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460a7a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x321:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0dc expref: 269 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.900846:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065077.900855:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.900875:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.900884:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.900897:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.900905:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.900910:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.900914:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.900976:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.900982:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.900991:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:2.0:1746065077.901167:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2342, 64 off194280 00000040:00080000:2.0:1746065077.901185:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2338, 64 off193824 00000040:00080000:2.0:1746065077.901194:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2339, 64 off193888 00000040:00080000:2.0:1746065077.901201:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2343, 64 off194344 00010000:00010000:2.0:1746065077.901239:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 3/0,1 mode: --/PW res: [0x240000403:0x321:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.901246:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901252:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901257:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901261:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901266:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901290:0:7231:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065077.901306:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901311:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901315:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901318:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065077.901324:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065077.901324:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901327:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901330:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835cc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065077.901332:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901332:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901337:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901340:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff880097e34800) 00010000:00010000:2.0:1746065077.901342:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065077.901345:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901353:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x321:0x0].0x0 (ffff880097e34800) 00010000:00010000:2.0:1746065077.901354:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460af8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x321:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901355:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065077.901358:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 1/0,0 mode: --/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901362:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460aff lrc: 0/0,0 mode: --/PW res: [0x240000403:0x321:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065077.901376:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.901377:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065077.901378:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065077.901445:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901450:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901454:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901458:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901461:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.901463:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901466:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901476:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.901478:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.901480:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901485:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460aea lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065077.901493:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009576c000 reply state ffff88009fadd000 transno 4294975279 ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901499:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.901504:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.901505:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065077.901507:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065077.901587:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27838:x1830881261313280:12345-192.168.202.27@tcp:36:rm.0 Request processed in 883us (3309us total) trans 4294975279 rc 0/0 00000100:00100000:2.0:1746065077.901594:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11874 00000100:00100000:0.0:1746065077.907941:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.908013:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261313536 00000100:00100000:2.0:1746065077.908021:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261313536 00000100:00100000:2.0:1746065077.908058:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11875 00000100:00100000:2.0:1746065077.908066:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27839:x1830881261313536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.908086:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.908103:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b06 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c114 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.908167:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.908182:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908192:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908200:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.908205:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908209:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908242:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908247:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908251:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908255:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908259:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835da00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.908262:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908267:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908276:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a65aa800) 00010000:00010000:2.0:1746065077.908279:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.908282:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908286:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b0d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908305:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908310:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908314:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908318:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.908321:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908325:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908330:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.908332:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.908333:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908337:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460b14 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.908358:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b06 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c114 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.908368:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c114 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.908378:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:2.0:1746065077.908439:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27839:x1830881261313536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 373us (505us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.908444:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11875 00000100:00100000:0.0:1746065077.911332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.911747:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261313664 00000100:00100000:2.0:1746065077.911755:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261313664 00000100:00100000:2.0:1746065077.911818:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11876 00000100:00100000:2.0:1746065077.911825:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27839:x1830881261313664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.911840:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.911856:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b1b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c11b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.911905:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.911914:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.911923:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.911931:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.911937:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.911946:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.911975:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.911980:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913424:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913432:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913436:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.913439:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913446:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913457:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.913459:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.913462:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913466:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b22 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913479:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913483:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913488:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913491:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abace00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.913493:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913497:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913501:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.913503:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.913504:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913508:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460b29 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.913541:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b1b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c11b expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.913547:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b1b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c11b expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.913557:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:2.0:1746065077.913760:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27839:x1830881261313664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1934us (2991us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.913767:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11876 00000100:00100000:0.0:1746065077.920942:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.921098:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261313792 00000100:00100000:2.0:1746065077.921106:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261313792 00000100:00100000:2.0:1746065077.921909:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11877 00000100:00100000:2.0:1746065077.921919:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27840:x1830881261313792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.921938:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.921958:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b30 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c122 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.922014:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.922024:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922033:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922041:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.922046:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922051:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922083:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922088:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922092:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922097:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922103:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.922106:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922112:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922120:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.922122:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.922125:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922130:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b37 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922408:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922414:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922418:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922422:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.922424:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922428:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922437:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.922439:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.922442:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922445:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b3e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.922472:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b30 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c122 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.922478:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b30 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c122 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.922486:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:2.0:1746065077.922763:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27840:x1830881261313792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 844us (1826us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.922769:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11877 00000100:00100000:0.0:1746065077.925333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.925604:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261314048 00000100:00100000:2.0:1746065077.925612:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261314048 00000100:00100000:2.0:1746065077.925663:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11878 00000100:00100000:2.0:1746065077.925670:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27841:x1830881261314048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.925687:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.925704:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b45 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c129 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.925765:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.925802:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925811:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925820:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.925824:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925828:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925853:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925858:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925863:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925868:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925872:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835cc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.925875:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925880:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925888:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.925890:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.925892:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925896:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460b4c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925910:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925914:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925918:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925922:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.925923:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925927:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925932:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.925933:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.925935:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925939:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d800/0xad6b7ddc1460b53 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.925957:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b45 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c129 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.925963:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460b45 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c129 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.925970:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835da00, rc 0) 00000100:00100000:2.0:1746065077.926015:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27841:x1830881261314048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 346us (688us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065077.926021:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11878 00000100:00100000:0.0:1746065077.930820:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.931095:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261314176 00000100:00100000:3.0:1746065077.931107:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261314176 00000100:00100000:3.0:1746065077.931158:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11879 00000100:00100000:3.0:1746065077.931165:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27841:x1830881261314176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.931183:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.931198:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555aa00/0xad6b7ddc1460b5a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c130 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.931354:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.931365:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931373:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931382:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.931388:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931392:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931431:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931436:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931441:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931446:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931451:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009555a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.931454:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931459:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931467:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4f4700) 00010000:00010000:3.0:1746065077.931469:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.931472:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931476:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460b61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931499:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931503:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931507:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931511:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.931513:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931517:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931522:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:3.0:1746065077.931524:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.931525:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931528:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1460b68 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.931550:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555aa00/0xad6b7ddc1460b5a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c130 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.931556:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555aa00/0xad6b7ddc1460b5a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c130 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.931567:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009555aa00, rc 0) 00000100:00100000:3.0:1746065077.931627:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27841:x1830881261314176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 462us (811us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.931634:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11879 00000100:00100000:0.0:1746065077.934494:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.934634:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261314304 00000100:00100000:3.0:1746065077.934641:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261314304 00000100:00100000:3.0:1746065077.934691:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11880 00000100:00100000:3.0:1746065077.934698:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27840:x1830881261314304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.934716:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.934732:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460b6f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c137 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.934816:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.934825:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934833:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934841:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.934846:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934850:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934878:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934883:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934888:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934893:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934897:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.934901:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934906:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934915:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4f4f00) 00010000:00010000:3.0:1746065077.934918:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.934920:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934925:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96e00/0xad6b7ddc1460b76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934934:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934938:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934942:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934945:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.934946:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934951:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934955:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:3.0:1746065077.934957:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.934958:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934965:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460b7d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.934985:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460b6f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c137 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.934991:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460b6f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c137 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.935002:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:3.0:1746065077.935048:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27840:x1830881261314304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 351us (559us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.935054:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11880 00000100:00100000:0.0:1746065077.937943:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.938243:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261314432 00000100:00100000:2.0:1746065077.938250:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261314432 00000100:00100000:2.0:1746065077.938666:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11881 00000100:00100000:2.0:1746065077.938675:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27840:x1830881261314432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.938693:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.938712:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b84 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c13e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.938767:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b8b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.938816:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.938826:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065077.938867:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065077.938873:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065077.938899:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460b84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c13e expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.938922:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b8b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c13e expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.938929:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.938931:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065077.938934:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:2.0:1746065077.938993:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27840:x1830881261314432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 320us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.938999:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11881 00000100:00100000:0.0:1746065077.940968:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.941191:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261314688 00000100:00100000:3.0:1746065077.941203:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261314688 00000100:00100000:3.0:1746065077.941247:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11882 00000100:00100000:3.0:1746065077.941253:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27842:x1830881261314688:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.941268:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.941281:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460b92 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c145 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.941347:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.941355:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941362:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941373:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.941378:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941383:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941408:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941412:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941417:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941422:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941427:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.941430:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941434:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941442:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:3.0:1746065077.941444:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.941447:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941451:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460b99 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941461:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941465:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941469:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941472:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.941473:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941477:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941481:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:3.0:1746065077.941482:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.941484:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941487:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460ba0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.941504:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460b92 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c145 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.941509:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1460b92 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c145 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.941515:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96000, rc 0) 00000100:00100000:3.0:1746065077.941556:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27842:x1830881261314688:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 304us (594us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065077.941562:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11882 00000100:00100000:0.0:1746065077.945546:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.945668:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261314944 00000100:00100000:3.0:1746065077.945678:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261314944 00000100:00100000:3.0:1746065077.946392:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11883 00000100:00100000:3.0:1746065077.946401:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27840:x1830881261314944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.946417:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.946420:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065077.946443:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460b8b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c13e expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.946456:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:3.0:1746065077.946465:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065077.946478:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97600/0xad6b7ddc1460ba7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c14c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.946561:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.946571:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946588:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946596:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.946602:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946606:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946906:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.946914:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946920:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065077.946927:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00010000:00010000:3.0:1746065077.946947:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946952:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946957:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946962:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946966:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.946969:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946974:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946981:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880099592800) 00010000:00010000:3.0:1746065077.946983:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.946985:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.946993:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1460bae lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065077.947001:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e37e300 reply state ffff88009522c000 transno 4294975280 ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.947007:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.947012:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:3.0:1746065077.947014:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065077.947016:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065077.947034:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97600/0xad6b7ddc1460ba7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.947046:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.947052:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36000) 00010000:00010000:3.0:1746065077.947054:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065077.947055:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009555a400, rc 0) 00000100:00100000:3.0:1746065077.947099:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27840:x1830881261314944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 699us (1562us total) trans 4294975280 rc 0/0 00000100:00100000:3.0:1746065077.947104:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11883 00000100:00100000:0.0:1746065077.950562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.950748:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261315200 00000100:00100000:2.0:1746065077.950756:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261315200 00000100:00100000:2.0:1746065077.950832:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11884 00000100:00100000:2.0:1746065077.950839:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27840:x1830881261315200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.950861:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.950876:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460bca lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c153 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.950955:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065077.950966:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.950971:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.950996:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.951006:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 274 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:2.0:1746065077.951016:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262603648:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065077.951147:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065077.956071:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262603648:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065077.956093:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065077.956560:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.956728:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261315328 00000100:00100000:3.0:1746065077.956734:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261315328 00010000:00010000:3.0:1746065077.956763:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 275 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:3.0:1746065077.957195:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3525 00000100:00100000:3.0:1746065077.957204:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+275:2004:x1830881261315328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065077.957214:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065077.957220:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 275 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.957230:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 275 pid: 7203 timeout: 773 lvb_type: 0 00010000:00010000:3.0:1746065077.957248:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555a400/0xad6b7ddc1460bbc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c14c expref: 275 pid: 7203 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746065077.957595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065077.957709:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36000) 00010000:00010000:3.0:1746065077.957714:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.957721:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.957727:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065077.957793:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261315584 00000100:00100000:2.0:1746065077.957796:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261315584 00000100:00100000:2.0:1746065077.957829:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11885 00000100:00100000:2.0:1746065077.957835:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27843:x1830881261315584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065077.957852:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065077.957865:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460bd8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c15a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.957926:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.957933:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.957940:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.957980:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065077.958001:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.958009:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958014:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065077.958032:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+276:2004:x1830881261315328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 829us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.958037:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3525 00010000:00010000:3.0:1746065077.958084:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.958090:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958092:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065077.958098:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958103:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065077.958104:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00000004:00200000:2.0:1746065077.958108:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00010000:00010000:2.0:1746065077.958155:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958161:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958165:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958170:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.958173:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958179:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958185:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36000) 00010000:00010000:2.0:1746065077.958187:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065077.958189:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 2/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958193:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc1460bed lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00080000:3.0:1746065077.958203:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x346:0x0], index 0: 0 00000004:00080000:3.0:1746065077.958208:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x347:0x0], index 1: 0 00000004:00080000:3.0:1746065077.958211:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x348:0x0], index 1: 0 00000004:00080000:3.0:1746065077.958214:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x347:0x0], index 0: 0 00010000:00010000:2.0:1746065077.958220:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958224:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958231:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958235:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958243:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.958245:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958249:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958254:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065077.958256:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.958258:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958260:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958263:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460bdf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958265:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.958269:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958269:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958273:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835da00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.958273:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958276:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958277:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958280:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958281:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abace00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065077.958283:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958285:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36000) 00010000:00010000:3.0:1746065077.958287:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065077.958289:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958290:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065077.958293:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835da00/0xad6b7ddc1460bd1 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065077.958295:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065077.958297:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065077.958298:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958303:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abace00/0xad6b7ddc1460be6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065077.958329:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460bd8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c15a expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.958335:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460bd8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c15a expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.958343:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835cc00, rc 0) 00000100:00100000:2.0:1746065077.958362:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27843:x1830881261315584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 528us (768us total) trans 4294975281 rc 301/301 00000100:00100000:2.0:1746065077.958367:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11885 00010000:00010000:3.0:1746065077.958488:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460bca lrc: 1/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c153 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.958497:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460bca lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c153 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.958506:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:3.0:1746065077.958524:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27840:x1830881261315200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7686us (7969us total) trans 4294975282 rc 301/301 00000100:00100000:3.0:1746065077.958529:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11884 00000100:00100000:2.0:1746065077.961642:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.961706:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261315840 00000100:00100000:0.0:1746065077.961714:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261315840 00000100:00100000:0.0:1746065077.961754:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4089 00000100:00100000:0.0:1746065077.961761:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27840:x1830881261315840:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065077.962008:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27840:x1830881261315840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 247us (374us total) trans 4294975283 rc 0/0 00000100:00100000:0.0:1746065077.962015:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4089 00000100:00100000:0.0:1746065077.971337:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.973359:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.974033:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261316096 00000100:00100000:2.0:1746065077.974042:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261316096 00000100:00100000:0.0:1746065077.975137:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4090 00000100:00100000:0.0:1746065077.975148:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27840:x1830881261316096:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065077.975342:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27840:x1830881261316096:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 196us (4012us total) trans 4294975284 rc 0/0 00000100:00100000:0.0:1746065077.975348:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4090 00000100:00100000:3.0:1746065077.976213:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261316224 00000100:00100000:3.0:1746065077.976219:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261316224 00000100:00100000:3.0:1746065077.976251:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11886 00000100:00100000:3.0:1746065077.976256:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27843:x1830881261316224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.976266:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.976282:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460c02 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c161 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.976338:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c09 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065077.976349:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.976357:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065077.976376:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00000004:00200000:3.0:1746065077.976380:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065077.976389:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065077.976411:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1460c02 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c161 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.976421:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c09 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c161 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.976427:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065077.976429:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065077.976431:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96a00, rc 0) 00000100:00100000:3.0:1746065077.976457:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27843:x1830881261316224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 201us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.976461:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11886 00000100:00100000:0.0:1746065077.989087:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.989133:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.989205:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261316352 00000100:00100000:2.0:1746065077.989214:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261316352 00000100:00100000:3.0:1746065077.989236:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261316608 00000100:00100000:3.0:1746065077.989239:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261316608 00000100:00100000:2.0:1746065077.989253:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8348 00000100:00100000:2.0:1746065077.989260:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+77:2004:x1830881261316352:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065077.989264:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11887 00000100:00100000:3.0:1746065077.989268:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261316608:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065077.989274:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.989278:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.989292:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc1460c17 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c16f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065077.989292:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c168 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.989400:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.989411:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989420:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989432:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.989438:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989443:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00002000:00010000:2.0:1746065077.989468:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065077.989482:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c2c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065077.989482:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065077.989484:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065077.989488:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065077.989490:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 78 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065077.989494:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c2c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065077.989501:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00010000:00010000:2.0:1746065077.989502:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 78 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065077.989510:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:2.0:1746065077.989549:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+78:2004:x1830881261316352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 290us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065077.989554:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8348 00010000:00010000:3.0:1746065077.989561:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989567:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989584:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989589:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989593:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.989596:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989605:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989614:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:3.0:1746065077.989617:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.989619:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989624:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1460c1e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989633:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989638:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989642:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989645:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065077.989648:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989652:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989657:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:3.0:1746065077.989659:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065077.989661:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989664:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460c25 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.989693:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc1460c17 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c16f expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.989707:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c2c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c16f expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.989712:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065077.989714:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065077.989716:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2200, rc 0) 00000100:00100000:3.0:1746065077.989736:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261316608:12345-192.168.202.27@tcp:101:bash.0 Request processed in 467us (659us total) trans 4294975285 rc 0/0 00000100:00100000:3.0:1746065077.989741:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11887 00000100:00100000:0.0:1746065077.994023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.994058:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065077.994096:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065077.994447:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261316864 00000100:00100000:2.0:1746065077.994455:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261316864 00000100:00100000:2.0:1746065077.994497:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4091 00000100:00100000:2.0:1746065077.994503:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27843:x1830881261316864:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065077.994698:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27843:x1830881261316864:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 193us (682us total) trans 4294975286 rc 0/0 00000100:00100000:2.0:1746065077.994704:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4091 00000100:00100000:0.0:1746065077.995226:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261317120 00000100:00100000:0.0:1746065077.995232:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261317120 00000100:00100000:0.0:1746065077.995271:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 541 00000100:00100000:0.0:1746065077.995276:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+280:2004:x1830881261317120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065077.995284:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065077.995302:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c2c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c16f expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065077.995317:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:0.0:1746065077.995320:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065077.995336:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261317120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065077.995341:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 541 00000100:00100000:3.0:1746065077.996092:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261316992 00000100:00100000:3.0:1746065077.996100:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261316992 00000100:00100000:3.0:1746065077.996133:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11888 00000100:00100000:3.0:1746065077.996138:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261316992:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065077.996154:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.996164:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3800/0xad6b7ddc1460c3a lrc: 2/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c176 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.996190:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460c41 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065077.996198:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460c41 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.996207:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460c41 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065077.996281:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3800/0xad6b7ddc1460c3a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c176 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.996293:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460c41 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c176 expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065077.996299:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065077.996302:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065077.996304:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:3.0:1746065077.996332:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261316992:12345-192.168.202.27@tcp:101:bash.0 Request processed in 193us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065077.996338:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11888 00000100:00100000:0.0:1746065077.997224:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065077.998543:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261317376 00000100:00100000:3.0:1746065077.998550:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261317376 00000100:00100000:3.0:1746065077.998598:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11889 00000100:00100000:3.0:1746065077.998604:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27843:x1830881261317376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065077.998623:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065077.998634:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1460c48 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c17d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.000136:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460c4f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.000148:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460c4f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.000157:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460c4f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065078.000170:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00010000:00010000:3.0:1746065078.000254:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1460c48 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c17d expref: 283 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.000267:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460c4f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c17d expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.000273:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065078.000275:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065078.000278:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:0.0:1746065078.000281:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.000321:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+282:27843:x1830881261317376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1716us (3098us total) trans 4294975287 rc 0/0 00000100:00100000:3.0:1746065078.000328:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11889 00000100:00100000:3.0:1746065078.000985:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261317632 00000100:00100000:3.0:1746065078.000991:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261317632 00000100:00080000:0.0:1746065078.001042:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746065078.001765:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11890 00000100:00100000:1.0:1746065078.001789:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261317632:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065078.001817:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.001831:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c09 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c161 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.001856:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.001858:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.001968:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.001976:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.001982:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:1.0:1746065078.002012:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975288 00000004:00010000:1.0:1746065078.002029:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc9c00 reply state ffff88009a58e000 transno 4294975289 ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.002036:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.002041:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.002043:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065078.002045:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065078.002107:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261317632:12345-192.168.202.27@tcp:36:bash.0 Request processed in 335us (1825us total) trans 4294975289 rc 0/0 00000100:00100000:1.0:1746065078.002111:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11890 00000020:00080000:1.0:1746065078.002115:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065078.004742:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.004828:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.004961:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261317760 00000100:00100000:1.0:1746065078.004967:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261317760 00000100:00100000:1.0:1746065078.004999:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261318016 00000100:00100000:1.0:1746065078.005001:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261318016 00000100:00100000:1.0:1746065078.005014:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11891 00000100:00100000:1.0:1746065078.005020:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27843:x1830881261317760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.005038:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.005051:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460c64 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c184 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005119:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.005130:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.005138:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065078.005158:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 0 00000004:00200000:1.0:1746065078.005161:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065078.005172:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.005191:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460c64 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005212:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005218:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.005220:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065078.005222:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065078.005259:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27843:x1830881261317760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 239us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.005264:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11891 00000100:00100000:1.0:1746065078.005279:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11892 00000100:00100000:1.0:1746065078.005284:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261318016:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065078.005293:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.005295:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065078.005305:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460c4f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c17d expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005314:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.005316:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.005321:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1460c72 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c18b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005341:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.005349:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005358:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.005383:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.005393:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 285 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.005404:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262603776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.005460:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.009364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.009467:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.009527:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261318272 00000100:00100000:2.0:1746065078.009534:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261318272 00000100:00100000:1.0:1746065078.009559:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262603776:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.009569:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4092 00000100:00100000:2.0:1746065078.009586:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27843:x1830881261318272:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:1.0:1746065078.009587:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065078.009673:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261318400 00000100:00100000:3.0:1746065078.009677:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261318400 00010000:00010000:3.0:1746065078.009694:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 287 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.009711:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3526 00000100:00100000:3.0:1746065078.009717:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+287:2005:x1830881261318400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.009728:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.009733:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 287 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.009741:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 287 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.009759:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc1460c6b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c184 expref: 287 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.009793:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065078.009797:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.009805:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.009811:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.009825:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.009860:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+286:2005:x1830881261318400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 143us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.009866:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3526 00010000:00010000:1.0:1746065078.010040:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.010045:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065078.010157:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27843:x1830881261318272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 571us (803us total) trans 4294975290 rc 0/0 00000100:00100000:2.0:1746065078.010163:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4092 00000040:00080000:1.0:1746065078.010199:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2340, 88 off193976 00000004:00080000:1.0:1746065078.010207:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674028432674ns, next at 674466981116ns, rc = 0 00000040:00080000:1.0:1746065078.010231:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2344, 88 off194432 00000004:00080000:1.0:1746065078.010235:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674028461542ns, next at 674466957028ns, rc = 0 00000040:00080000:1.0:1746065078.010246:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2345, 88 off194520 00000004:00080000:1.0:1746065078.010249:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674028475094ns, next at 674466957028ns, rc = 0 00000040:00080000:1.0:1746065078.010256:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2341, 88 off194064 00000004:00080000:1.0:1746065078.010259:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674028485405ns, next at 674466981116ns, rc = 0 00000100:00100000:0.0:1746065078.013314:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.013531:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261318656 00000100:00100000:3.0:1746065078.013538:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261318656 00000100:00100000:3.0:1746065078.013587:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11893 00000100:00100000:3.0:1746065078.013594:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27843:x1830881261318656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.013611:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.013627:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3800/0xad6b7ddc1460c80 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c192 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.013690:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.013704:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.013713:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.013721:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.013726:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000001:00080000:0.0:1746065078.014029:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975291 is committed 00000004:00080000:0.0:1746065078.014034:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1575 committed 00000004:00080000:0.0:1746065078.014041:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1585 committed 00000004:00080000:0.0:1746065078.014049:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1584 committed 00000004:00080000:0.0:1746065078.014051:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1574 committed 00010000:00010000:1.0:1746065078.014160:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c18b expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.014167:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.014169:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065078.014180:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1460c72 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c18b expref: 274 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065078.014192:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c18b expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.014212:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.014214:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065078.014216:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:1.0:1746065078.014258:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261318016:12345-192.168.202.27@tcp:101:bash.0 Request processed in 8973us (9428us total) trans 4294975291 rc 0/0 00000100:00100000:1.0:1746065078.014264:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11892 00010000:00010000:3.0:1746065078.014524:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065078.014633:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262603904:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.014671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.014697:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262604416:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.014710:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.014725:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065078.014729:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262604288:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.014742:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.014758:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262604032:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.014791:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.014808:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262604544:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.014821:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.014832:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065078.014835:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262604160:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.014846:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.014862:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262603904 00000100:00100000:3.0:1746065078.014865:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262603904 00000100:00100000:3.0:1746065078.014889:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262604416 00000100:00100000:3.0:1746065078.014891:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262604416 00000100:00100000:3.0:1746065078.014900:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262604288 00000100:00100000:3.0:1746065078.014901:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262604288 00000100:00100000:3.0:1746065078.014909:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262604032 00000100:00100000:3.0:1746065078.014910:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262604032 00000100:00100000:3.0:1746065078.014919:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262604544 00000100:00100000:3.0:1746065078.014920:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262604544 00000100:00100000:3.0:1746065078.014925:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262604160 00000100:00100000:3.0:1746065078.014926:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262604160 00000100:00100000:3.0:1746065078.014933:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8349 00000100:00100000:3.0:1746065078.014938:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+230:3760:x1830881262603904:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.014952:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:835 count 1 00010000:00010000:3.0:1746065078.014967:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.014979:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 83 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.014984:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.014986:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.014989:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015007:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 83 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015016:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 83 pid: 9549 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.015026:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009576d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262604672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.015065:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065078.015080:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8350 00000100:00100000:3.0:1746065078.015084:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+230:3760:x1830881262604416:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.015188:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+231:3760:x1830881262604416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 103us (476us total) trans 17179872444 rc 0/0 00000100:00100000:3.0:1746065078.015193:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8350 00000100:00100000:3.0:1746065078.015204:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8351 00000100:00100000:3.0:1746065078.015208:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+230:3760:x1830881262604288:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.015216:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:838 count 1 00002000:00010000:3.0:1746065078.015229:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.015233:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015239:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.015240:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.015243:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015251:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015256:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015262:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015276:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065078.015380:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+231:3760:x1830881262604288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 171us (637us total) trans 17179872445 rc 0/0 00000100:00100000:3.0:1746065078.015385:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8351 00000100:00100000:3.0:1746065078.015394:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8352 00000100:00100000:3.0:1746065078.015398:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+230:3761:x1830881262604032:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.015406:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:836 count 1 00002000:00010000:3.0:1746065078.015416:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.015420:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015425:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.015426:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.015428:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015434:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015440:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015445:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015454:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065078.015520:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+231:3761:x1830881262604032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 121us (746us total) trans 17179872446 rc 0/0 00000100:00100000:3.0:1746065078.015525:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8352 00000100:00100000:3.0:1746065078.015533:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8353 00000100:00100000:3.0:1746065078.015536:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+230:3761:x1830881262604544:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.015596:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+231:3761:x1830881262604544:12345-0@lo:2:osp-syn-1-1.0 Request processed in 58us (773us total) trans 17179872447 rc 0/0 00000100:00100000:3.0:1746065078.015600:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8353 00000100:00100000:3.0:1746065078.015608:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8354 00000100:00100000:3.0:1746065078.015612:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009576c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+230:3761:x1830881262604160:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.015619:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:837 count 1 00010000:00010000:3.0:1746065078.015626:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015637:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 83 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015641:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.015642:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.015644:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015657:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 83 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015664:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 83 pid: 9549 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.015676:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262604800:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.015695:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065078.015708:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065078.015713:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015718:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.015721:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015728:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015739:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015745:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460c9c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015758:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065078.015760:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015765:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.015767:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015797:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015805:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015811:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ca3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.015820:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.015821:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.015823:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065078.015844:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54000/2, rc 0, transno 17179872446 00000100:00100000:3.0:1746065078.015849:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262604032:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065078.015856:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f57800/2, rc 0, transno 17179872447 00000100:00100000:3.0:1746065078.015858:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262604544:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065078.015869:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f57480/2, rc 0, transno 17179872445 00000100:00100000:3.0:1746065078.015872:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262604288:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065078.015877:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54380/2, rc 0, transno 17179872444 00000100:00100000:3.0:1746065078.015880:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262604416:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.015949:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.015957:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.015966:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065078.015974:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 2 00010000:00010000:3.0:1746065078.016032:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016038:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016042:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016046:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016050:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.016052:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016056:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016063:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e1fcf00) 00010000:00010000:3.0:1746065078.016065:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.016067:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.016071:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1460c87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.016125:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.016183:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016189:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016194:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016198:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.016200:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016205:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016213:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065078.016214:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.016216:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016220:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d600/0xad6b7ddc1460af1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.016231:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016235:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016243:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016246:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.016248:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016252:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016257:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:2.0:1746065078.016259:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.016260:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016264:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1460bb5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016272:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016275:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016278:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016281:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.016283:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016287:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016292:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:2.0:1746065078.016294:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.016295:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.016299:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2a00/0xad6b7ddc1460c5d lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065078.016393:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262604928:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.016417:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.016430:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262605440:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.016443:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.016454:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065078.016458:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262605312:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.016473:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.016494:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262604928 00000100:00100000:2.0:1746065078.016498:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262604928 00000100:00100000:0.0:1746065078.016516:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262605440 00000100:00100000:2.0:1746065078.016519:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262605312 00000100:00100000:2.0:1746065078.016520:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262605312 00000100:00100000:0.0:1746065078.016520:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262605440 00000100:00100000:2.0:1746065078.016530:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8355 00000100:00100000:2.0:1746065078.016534:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+193:3762:x1830881262604928:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.016538:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8356 00000100:00100000:0.0:1746065078.016542:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+193:3762:x1830881262605312:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065078.016544:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:834 count 1 00002000:00080000:0.0:1746065078.016550:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:837 count 1 00010000:00010000:2.0:1746065078.016557:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065078.016562:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065078.016565:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.016567:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 77 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.016583:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.016584:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.016587:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065078.016587:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.016588:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.016590:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.016595:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.016600:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.016603:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 77 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.016611:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 77 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.016611:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.016619:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137346a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262605696:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065078.016620:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065078.016653:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.016668:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8357 00000100:00100000:2.0:1746065078.016673:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+194:3762:x1830881262605440:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065078.016720:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.016723:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.016724:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.016726:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.016728:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065078.016728:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+195:3762:x1830881262605312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 186us (254us total) trans 21474839718 rc 0/0 00000100:00100000:0.0:1746065078.016734:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8356 00000100:00100000:2.0:1746065078.016742:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+194:3762:x1830881262605440:12345-0@lo:2:osp-syn-0-1.0 Request processed in 69us (298us total) trans 21474839719 rc 0/0 00000100:00100000:2.0:1746065078.016746:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8357 00000100:00080000:0.0:1746065078.016748:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065078.016750:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746065078.016766:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c527480/2, rc 0, transno 21474839718 00000100:00100000:2.0:1746065078.016769:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262605312:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065078.016791:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c524380/2, rc 0, transno 21474839719 00000100:00100000:2.0:1746065078.016794:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262605440:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065078.016856:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.016860:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.016866:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.016868:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.016874:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.016884:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.016889:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b0600/0xad6b7ddc1460cc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.016900:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.016901:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.016903:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065078.016913:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262605056:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.016934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.016957:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262605568:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.016971:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.016983:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065078.016987:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262605184:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.017000:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.017014:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262605056 00000100:00100000:1.0:1746065078.017017:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262605056 00000100:00100000:1.0:1746065078.017030:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262605568 00000100:00100000:1.0:1746065078.017032:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262605568 00000100:00100000:1.0:1746065078.017040:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262605184 00000100:00100000:1.0:1746065078.017041:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262605184 00000100:00100000:1.0:1746065078.017049:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8358 00000100:00100000:1.0:1746065078.017053:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+196:3759:x1830881262605056:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065078.017063:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:835 count 1 00002000:00010000:1.0:1746065078.017074:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.017078:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017084:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.017085:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.017088:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017094:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017100:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017104:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017112:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065078.017175:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+197:3759:x1830881262605056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 121us (240us total) trans 21474839720 rc 0/0 00000100:00100000:1.0:1746065078.017180:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8358 00000100:00100000:1.0:1746065078.017189:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8359 00000100:00100000:1.0:1746065078.017192:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+196:3759:x1830881262605568:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.017232:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+197:3759:x1830881262605568:12345-0@lo:2:osp-syn-0-1.0 Request processed in 39us (259us total) trans 21474839721 rc 0/0 00000100:00100000:1.0:1746065078.017236:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8359 00000100:00100000:1.0:1746065078.017243:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8360 00000100:00100000:1.0:1746065078.017246:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+196:3759:x1830881262605184:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065078.017253:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:836 count 1 00010000:00010000:1.0:1746065078.017259:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017267:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 77 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017272:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.017273:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.017275:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017308:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 77 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017315:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 77 pid: 9549 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.017321:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262605824:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.017351:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00010000:00010000:1.0:1746065078.017358:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.017361:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017366:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.017368:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017378:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017385:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017390:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1460ccd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.017398:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.017399:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.017400:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065078.017412:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c524a80/2, rc 0, transno 21474839720 00000100:00100000:1.0:1746065078.017415:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262605056:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065078.017420:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c526680/2, rc 0, transno 21474839721 00000100:00100000:1.0:1746065078.017423:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262605568:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065078.018036:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018045:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018051:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018054:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.018056:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018061:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018069:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:3.0:1746065078.018071:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.018073:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018077:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96a00/0xad6b7ddc1460c8e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.018141:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3800/0xad6b7ddc1460c80 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.018153:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 270 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.018158:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065078.018160:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.018162:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d400, rc 0) 00000100:00100000:3.0:1746065078.018184:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27843:x1830881261318656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4591us (4877us total) trans 4294975292 rc 0/0 00000100:00100000:3.0:1746065078.018190:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11893 00000100:00100000:2.0:1746065078.023511:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262604800:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.023535:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.023656:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137346a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262605696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.023671:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.023733:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009576d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262604672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.023746:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.026463:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262605824:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.026481:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.026555:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.026580:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.026608:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.026628:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319168 00000100:00100000:1.0:1746065078.026633:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319168 00010000:00010000:1.0:1746065078.026669:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 78 pid: 9549 timeout: 774 lvb_type: 0 00000100:00080000:0.0:1746065078.026686:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065078.026688:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261318784 00000100:00100000:1.0:1746065078.026691:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261318784 00000100:00100000:0.0:1746065078.026698:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261318912 00000100:00100000:0.0:1746065078.026702:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261318912 00010000:00010000:1.0:1746065078.026706:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.026717:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.026720:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3527 00000100:00100000:1.0:1746065078.026725:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+78:2005:x1830881261319168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.026735:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.026739:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 78 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.026752:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 78 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.026953:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc1460ab9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0ff expref: 78 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.026968:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.026970:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.026973:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.026980:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.027200:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3528 00000100:00100000:3.0:1746065078.027211:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+85:2005:x1830881261318784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065078.027213:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3529 00010000:00010000:3.0:1746065078.027219:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065078.027219:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+85:2005:x1830881261318912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.027223:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.027226:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.027230:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.027233:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.027239:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.027246:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1460ab2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0f8 expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.027250:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b0c00/0xad6b7ddc146091c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c06c expref: 85 pid: 9549 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.027257:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.027258:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.027260:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.027265:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027266:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.027268:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.027270:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027276:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027456:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065078.027492:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261318912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 273us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.027499:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3529 00000100:00080000:0.0:1746065078.027513:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065078.027532:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.027543:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319040 00000100:00100000:0.0:1746065078.027546:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319040 00010000:00010000:0.0:1746065078.027556:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 78 pid: 9550 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.027585:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3530 00000100:00100000:0.0:1746065078.027590:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+78:2005:x1830881261319040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.027596:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.027600:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 78 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.027607:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 78 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.027618:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1460a88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c0e3 expref: 78 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.027625:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.027626:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.027629:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027634:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027645:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065078.027657:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261319040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.027662:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3530 00000100:00100000:0.0:1746065078.027700:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.027763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.027788:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319552 00000100:00100000:0.0:1746065078.027791:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319552 00000100:00100000:0.0:1746065078.027808:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8361 00000100:00100000:0.0:1746065078.027812:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+77:26180:x1830881261319552:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065078.027825:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.027831:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.027833:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c199 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027847:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 78 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065078.027853:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+78:2005:x1830881261319168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1127us (1299us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065078.027857:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065078.027859:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3527 00010000:00010000:0.0:1746065078.027859:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.027862:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 78 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.027877:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 77 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065078.027886:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 77 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746065078.027895:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262605952:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065078.027934:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e540 going to sleep for 11 seconds 00010000:00010000:3.0:1746065078.028024:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.028046:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+82:2005:x1830881261318784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 836us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.028052:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3528 00010000:00010000:3.0:1746065078.028072:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.028074:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028079:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.028081:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028086:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.028087:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028093:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.028093:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028114:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1746065078.028120:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065078.028264:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+231:3760:x1830881262603904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13325us (13592us total) trans 17179872448 rc 0/0 00000100:00100000:3.0:1746065078.028269:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8349 00000004:00080000:3.0:1746065078.028298:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54700/2, rc 0, transno 17179872448 00000100:00100000:3.0:1746065078.028303:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262603904:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.028303:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+197:3762:x1830881262604928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11767us (11885us total) trans 21474839722 rc 0/0 00000100:00100000:2.0:1746065078.028309:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8355 00000004:00080000:2.0:1746065078.028334:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c527100/2, rc 0, transno 21474839722 00000100:00100000:2.0:1746065078.028337:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262604928:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065078.028348:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065078.028353:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028359:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552e000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.028362:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028369:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028379:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028388:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc1460c95 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028400:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.028403:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028407:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.028409:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028414:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028421:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028426:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1460cbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028435:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.028436:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.028438:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.028442:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.028494:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028500:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028507:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028513:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028680:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065078.028769:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.028796:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028802:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3ce00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.028805:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028810:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028819:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028825:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460caa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.028835:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.028837:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.028838:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065078.028892:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009576c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+231:3761:x1830881262604160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13278us (14043us total) trans 17179872449 rc 0/0 00000100:00100000:3.0:1746065078.028898:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8354 00010000:00010000:3.0:1746065078.028912:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.028918:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065078.028994:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f56680/2, rc 0, transno 17179872449 00000100:00100000:0.0:1746065078.028998:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262604160:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.029221:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.029227:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.029243:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065078.029266:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.029271:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.029277:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.029280:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.029286:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.029300:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.029305:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ccd400/0xad6b7ddc1460cd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.029316:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.029318:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.029319:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065078.029343:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+197:3759:x1830881262605184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12095us (12340us total) trans 21474839723 rc 0/0 00000100:00100000:3.0:1746065078.029349:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8360 00000004:00080000:0.0:1746065078.029352:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c524700/2, rc 0, transno 21474839723 00000100:00100000:0.0:1746065078.029356:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262605184:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.029368:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319424 00000100:00100000:3.0:1746065078.029371:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319424 00000100:00100000:3.0:1746065078.029405:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4093 00000100:00100000:3.0:1746065078.029411:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27843:x1830881261319424:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.029535:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27843:x1830881261319424:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 123us (1833us total) trans 4294975293 rc 0/0 00000100:00100000:3.0:1746065078.029540:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4093 00000100:00100000:2.0:1746065078.029877:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262605952:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.029888:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065078.029891:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 77 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.029901:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1800, rc 0) 00000100:00100000:2.0:1746065078.029921:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+77:26180:x1830881261319552:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2108us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.029927:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8361 00000100:00100000:3.0:1746065078.030041:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319680 00000100:00100000:3.0:1746065078.030045:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319680 00010000:00010000:3.0:1746065078.030057:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 77 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746065078.030085:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3531 00000100:00100000:3.0:1746065078.030090:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261319680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.030096:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.030099:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 77 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.030107:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 77 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.030119:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1460c10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c168 expref: 77 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.030127:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.030129:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.030133:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 76 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.030140:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 76 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.030164:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 76 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.030174:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881262606080:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065078.030228:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.032409:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.032485:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881262606080:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065078.032494:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065078.032500:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.032532:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+76:2005:x1830881261319680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2441us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.032540:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3531 00000100:00100000:3.0:1746065078.032602:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319808 00000100:00100000:3.0:1746065078.032607:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319808 00000100:00100000:3.0:1746065078.032631:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4094 00000100:00100000:3.0:1746065078.032636:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27843:x1830881261319808:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065078.032735:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27843:x1830881261319808:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 98us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.032740:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4094 00000100:00100000:2.0:1746065078.032893:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261319936 00000100:00100000:2.0:1746065078.032896:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261319936 00000100:00100000:2.0:1746065078.032930:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8362 00000100:00100000:2.0:1746065078.032936:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+82:26180:x1830881261319936:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.032945:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.032960:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1a0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.033196:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.033211:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.033213:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.033219:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 83 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.033232:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 83 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.033240:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835cc00, rc 0) 00000100:00100000:2.0:1746065078.033260:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+83:26180:x1830881261319936:12345-192.168.202.27@tcp:101:bash.0 Request processed in 324us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.033265:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8362 00000100:00100000:0.0:1746065078.036627:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.036675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.036845:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261320064 00000100:00100000:1.0:1746065078.036853:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261320064 00002000:00010000:1.0:1746065078.036884:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/838 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.036888:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed5f80 with x1830881261320064 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.036898:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aed5f80. 00000100:00100000:2.0:1746065078.037073:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261320192 00000100:00100000:2.0:1746065078.037077:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261320192 00002000:00010000:2.0:1746065078.037094:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/839 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.037097:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed4700 with x1830881261320192 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.037103:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed4700. 00000100:00100000:1.0:1746065078.037119:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1237 00000100:00100000:1.0:1746065078.037125:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+76:2005:x1830881261320064:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:2.0:1746065078.037170:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1238 00000100:00100000:2.0:1746065078.037175:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261320192:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065078.037259:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.037259:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.037262:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.037262:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.037264:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.037264:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.037266:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.037266:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.037268:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1746065078.037268:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.037306:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261320064:12345-192.168.202.27@tcp:10:bash.0 Request processed in 181us (686us total) trans 21474839724 rc 0/0 00000100:00100000:1.0:1746065078.037312:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1237 00002000:00010000:1.0:1746065078.037314:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/838 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.037316:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed5f80 with x1830881261320064 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.037319:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aed5f80. 00000100:00100000:2.0:1746065078.037604:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+84:2005:x1830881261320192:12345-192.168.202.27@tcp:10:bash.0 Request processed in 428us (927us total) trans 17179872450 rc 0/0 00000100:00100000:2.0:1746065078.037610:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1238 00002000:00010000:2.0:1746065078.037613:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/839 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.037614:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed4700 with x1830881261320192 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.037618:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aed4700. 00000100:00100000:1.0:1746065078.044461:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.044516:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261320448 00000100:00100000:0.0:1746065078.044524:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261320448 00000100:00100000:0.0:1746065078.045182:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4095 00000100:00100000:0.0:1746065078.045191:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261320448:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065078.045421:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261320448:12345-192.168.202.27@tcp:35:bash.0 Request processed in 231us (967us total) trans 4294975294 rc 0/0 00000100:00100000:0.0:1746065078.045427:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4095 00000100:00100000:0.0:1746065078.048547:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.049664:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261320704 00000100:00100000:3.0:1746065078.049674:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261320704 00000100:00100000:3.0:1746065078.049732:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11894 00000100:00100000:3.0:1746065078.049739:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:27844:x1830881261320704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.049756:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.049801:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460ce9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1a7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.049890:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460cf0 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.049901:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460cf0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.049912:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460cf0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065078.049921:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 5 00010000:00010000:3.0:1746065078.050003:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460ce9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a7 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.050035:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460cf0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a7 expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.050042:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065078.050045:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065078.050047:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ce00, rc 0) 00000100:00100000:3.0:1746065078.050090:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27844:x1830881261320704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 351us (1550us total) trans 4294975295 rc 0/0 00000100:00100000:3.0:1746065078.050096:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11894 00000100:00100000:0.0:1746065078.053513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.053683:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261320960 00000100:00100000:1.0:1746065078.053692:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261320960 00000100:00100000:0.0:1746065078.054055:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.054166:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11895 00000100:00100000:1.0:1746065078.054174:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27844:x1830881261320960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.054194:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.054211:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1460cfe lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1ae expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.054298:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.054309:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.054315:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.054338:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.054347:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 275 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.054357:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262606208:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.054432:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065078.055869:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261321216 00000100:00100000:3.0:1746065078.055876:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261321216 00000100:00100000:3.0:1746065078.056160:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4096 00000100:00100000:3.0:1746065078.056169:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27845:x1830881261321216:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:3.0:1746065078.057382:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27845:x1830881261321216:12345-192.168.202.27@tcp:35:rm.0 Request processed in 1208us (3321us total) trans 4294975296 rc 0/0 00000100:00100000:3.0:1746065078.057390:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4096 00000100:00100000:2.0:1746065078.058006:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.058217:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262606208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.058235:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065078.058442:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261321344 00000100:00100000:3.0:1746065078.058447:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261321344 00010000:00010000:3.0:1746065078.058471:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 277 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.058494:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3532 00000100:00100000:3.0:1746065078.058499:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+277:2005:x1830881261321344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.058508:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.058513:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 277 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.058523:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 277 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.058540:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460cb1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c192 expref: 277 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.058551:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065078.058554:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.058561:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.058567:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.058613:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.058642:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+276:2005:x1830881261321344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 142us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.058647:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3532 00010000:00010000:1.0:1746065078.058851:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.058856:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065078.058879:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 5 00010000:00010000:1.0:1746065078.058978:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1460cfe lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.059009:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.059015:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.059018:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065078.059020:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:1.0:1746065078.059052:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27844:x1830881261320960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4880us (5546us total) trans 4294975297 rc 0/0 00000100:00100000:1.0:1746065078.059057:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11895 00000100:00100000:0.0:1746065078.060369:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.060432:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261321728 00000100:00100000:1.0:1746065078.060436:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261321728 00000100:00100000:1.0:1746065078.060474:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11896 00000100:00100000:1.0:1746065078.060480:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27845:x1830881261321728:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065078.060515:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065078.060530:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460cf0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a7 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.060543:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1460c79 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c18b expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.060553:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460c41 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c176 expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.060559:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.060561:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.060589:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.060599:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.060605:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.060614:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.060618:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.060623:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.060686:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.060695:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.060700:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.060723:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.060733:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 273 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.060744:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262606336:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.060839:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065078.064799:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262606336:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.064819:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065078.065229:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.068667:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261321856 00000100:00100000:2.0:1746065078.068680:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261321856 00010000:00010000:2.0:1746065078.068716:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 274 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.068905:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3533 00000100:00100000:2.0:1746065078.068913:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261321856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.068927:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.068933:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 274 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.068944:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 274 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.068961:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1460d05 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x323:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ae expref: 274 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.068990:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:2.0:1746065078.068995:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.069003:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.069008:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.069025:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.069069:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+273:2004:x1830881261321856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 157us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.069074:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3533 00010000:00010000:1.0:1746065078.069282:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069288:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:1.0:1746065078.069482:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x323:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1746065078.069542:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069548:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069552:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069556:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.069560:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069565:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069583:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065078.069586:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065078.069588:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069592:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460d21 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069614:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069618:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069623:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069627:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069630:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.069632:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069635:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069641:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fa00) 00010000:00010000:1.0:1746065078.069642:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.069644:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069648:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489e00/0xad6b7ddc1460d13 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065078.069658:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed4380 reply state ffff88009a588000 transno 4294975298 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069665:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.069670:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:1.0:1746065078.069672:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065078.069675:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065078.069723:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27845:x1830881261321728:12345-192.168.202.27@tcp:36:rm.0 Request processed in 9243us (9359us total) trans 4294975298 rc 0/0 00000100:00100000:1.0:1746065078.069729:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11896 00000100:00100000:0.0:1746065078.072600:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.072703:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261321984 00000100:00100000:1.0:1746065078.072711:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261321984 00000100:00100000:1.0:1746065078.072757:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11897 00000100:00100000:1.0:1746065078.072763:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27844:x1830881261321984:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.073804:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.073824:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488a00/0xad6b7ddc1460d28 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1b5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.073883:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460d2f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.073892:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460d2f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.073900:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460d2f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065078.073939:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 5 00000004:00200000:1.0:1746065078.073942:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065078.073955:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460d2f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.073981:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488a00/0xad6b7ddc1460d28 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1b5 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.073994:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460d2f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1b5 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.074001:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065078.074004:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065078.074006:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488600, rc 0) 00000100:00100000:1.0:1746065078.074049:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27844:x1830881261321984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1286us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.074056:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11897 00000100:00100000:0.0:1746065078.076517:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.078040:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261322240 00000100:00100000:3.0:1746065078.078048:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261322240 00000100:00100000:3.0:1746065078.078111:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11898 00000100:00100000:3.0:1746065078.078118:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27844:x1830881261322240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.078135:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.078150:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d36 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1bc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.078240:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460d3d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.078251:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460d3d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.078260:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460d3d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065078.078270:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 5 00010000:00010000:3.0:1746065078.078360:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d36 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1bc expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.078385:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460d3d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1bc expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.078392:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065078.078394:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065078.078397:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c800, rc 0) 00000100:00100000:3.0:1746065078.078441:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27844:x1830881261322240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 322us (1928us total) trans 4294975299 rc 0/0 00000100:00100000:3.0:1746065078.078446:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11898 00000100:00100000:0.0:1746065078.082212:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.082295:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.082361:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261322496 00000100:00100000:1.0:1746065078.082369:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261322496 00000100:00100000:1.0:1746065078.082419:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11899 00000100:00100000:1.0:1746065078.082426:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27846:x1830881261322496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.082443:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.082458:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc1460d4b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1c3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.082510:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.082519:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082527:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082535:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.082540:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082545:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082590:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082596:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082600:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082604:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082609:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.082612:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082617:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082626:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f200) 00010000:00010000:1.0:1746065078.082628:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.082630:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082634:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d52 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082643:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082648:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082652:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082656:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.082658:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082663:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082667:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:1.0:1746065078.082669:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.082671:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082675:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d59 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.082697:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc1460d4b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1c3 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.082703:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc1460d4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1c3 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.082719:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:1.0:1746065078.082760:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27846:x1830881261322496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 335us (555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.082766:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11899 00000100:00100000:3.0:1746065078.083655:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261322368 00000100:00100000:3.0:1746065078.083661:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261322368 00000100:00100000:3.0:1746065078.083698:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8363 00000100:00100000:3.0:1746065078.083703:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2006:x1830881261322368:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065078.083728:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.083739:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 77 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.083746:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.083747:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.083749:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.083788:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 77 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.083798:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 77 pid: 10219 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.083809:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262606464:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.083864:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.086770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.086943:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261322624 00000100:00100000:2.0:1746065078.086949:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261322624 00002000:00100000:2.0:1746065078.086985:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x346:0x0] (0->4) req@ffff88009aed5180 x1830881261322624/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:749/0 lens 496/0 e 0 to 0 dl 1746065089 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065078.086993:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed5180 with x1830881261322624 ext(0->4) 00010000:00010000:2.0:1746065078.086999:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 78 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.087009:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 78 pid: 10219 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746065078.087014:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aed5180 00000100:00100000:2.0:1746065078.087041:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 212 00000100:00100000:2.0:1746065078.087048:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+78:2005:x1830881261322624:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:3.0:1746065078.087701:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262606464:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.087721:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.089249:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+80:2005:x1830881261322624:12345-192.168.202.27@tcp:4:bash.0 Request processed in 2197us (2483us total) trans 21474839725 rc 0/0 00000100:00100000:2.0:1746065078.089259:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 212 00002000:00100000:2.0:1746065078.089269:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x346:0x0] (0->4) req@ffff88009aed5180 x1830881261322624/t21474839725(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:749/0 lens 496/448 e 0 to 0 dl 1746065089 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065078.089278:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed5180 with x1830881261322624 ext(0->4) 00010000:00010000:2.0:1746065078.089285:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 80 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.089295:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 80 pid: 10219 timeout: 774 lvb_type: 0 00002000:00010000:2.0:1746065078.089301:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aed5180 00000100:00100000:0.0:1746065078.090508:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.090762:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261322752 00000100:00100000:2.0:1746065078.090769:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261322752 00000100:00100000:2.0:1746065078.090870:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11900 00000100:00100000:2.0:1746065078.090878:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27846:x1830881261322752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.090893:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.090909:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460d67 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1ca expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.090961:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.090971:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.090979:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.090987:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.090995:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.090999:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091033:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091037:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091042:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091047:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091052:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.091055:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091060:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091068:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065078.091070:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.091073:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091078:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835d400/0xad6b7ddc1460d6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091096:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091100:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091104:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091107:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.091109:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091113:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091118:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:2.0:1746065078.091120:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.091122:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091126:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c000/0xad6b7ddc1460d75 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.091150:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460d67 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ca expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.091156:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460d67 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ca expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.091166:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:2.0:1746065078.091199:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27846:x1830881261322752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 322us (695us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.091204:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11900 00000100:00100000:0.0:1746065078.093145:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.093551:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261322880 00000100:00100000:3.0:1746065078.093557:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261322880 00010000:00010000:3.0:1746065078.093598:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 80 pid: 10219 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.093632:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3534 00000100:00100000:3.0:1746065078.093638:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+80:2007:x1830881261322880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.093650:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065078.093664:0:7191:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1746065078.093667:0:7191:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1746065078.093672:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 80 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.093681:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 80 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.093698:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b1800/0xad6b7ddc1460cdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c199 expref: 80 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.093719:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.093722:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.093725:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093732:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093751:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.093814:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+79:2007:x1830881261322880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 174us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.093823:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3534 00010000:00010000:3.0:1746065078.093841:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093849:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093862:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093867:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093873:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093879:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.093882:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093888:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093895:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.093900:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d400/0xad6b7ddc1460d60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.093932:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+78:2006:x1830881261322368:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10229us (11637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.093938:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8363 00000100:00100000:2.0:1746065078.094881:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.094927:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261323008 00000100:00100000:1.0:1746065078.094931:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261323008 00000100:00100000:1.0:1746065078.094968:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11901 00000100:00100000:1.0:1746065078.094973:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27846:x1830881261323008:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.094989:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.095002:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d7c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1d1 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.095045:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d83 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.095056:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.095063:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065078.095095:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065078.095099:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065078.095120:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460d7c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1d1 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.095148:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1d1 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.095155:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f600) 00010000:00010000:1.0:1746065078.095157:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065078.095159:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488000, rc 0) 00000100:00100000:1.0:1746065078.095189:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27846:x1830881261323008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 215us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.095194:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11901 00000100:00100000:1.0:1746065078.101682:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.101733:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261323264 00000100:00100000:2.0:1746065078.101744:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261323264 00000100:00100000:2.0:1746065078.101801:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11902 00000100:00100000:2.0:1746065078.101808:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:27844:x1830881261323264:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065078.101846:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.101869:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460d2f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1b5 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.101883:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.101887:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.101911:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.101921:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065078.101921:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065078.101928:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065078.101937:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261323392 00000100:00100000:0.0:1746065078.101940:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261323392 00000100:00100000:0.0:1746065078.101965:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11903 00000100:00100000:0.0:1746065078.101969:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27846:x1830881261323392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.101976:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.101985:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460d91 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1d8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.102017:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.102023:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102028:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102034:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.102038:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102043:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102071:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102075:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102079:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102084:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102088:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.102091:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102096:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102101:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f600) 00010000:00010000:0.0:1746065078.102103:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.102106:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102110:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460d98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102127:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000040:00080000:2.0:1746065078.102166:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2342, 88 off194152 00000004:00080000:2.0:1746065078.102172:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674120397846ns, next at 674466981116ns, rc = 0 00000040:00080000:2.0:1746065078.102221:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2346, 88 off194608 00000004:00080000:2.0:1746065078.102225:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674120451543ns, next at 674466957028ns, rc = 0 00010000:00010000:0.0:1746065078.102411:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102417:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102421:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.102423:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102427:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102434:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:0.0:1746065078.102435:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.102437:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102441:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460d9f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.102638:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460d91 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1d8 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.102645:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460d91 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1d8 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.102652:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1400, rc 0) 00000100:00100000:0.0:1746065078.102940:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27846:x1830881261323392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 969us (1017us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065078.102947:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11903 00000040:00080000:2.0:1746065078.103087:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2347, 88 off194696 00000004:00080000:2.0:1746065078.103092:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674121318538ns, next at 674466957028ns, rc = 0 00000040:00080000:2.0:1746065078.103148:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2343, 88 off194240 00000004:00080000:2.0:1746065078.103151:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674121377898ns, next at 674466981116ns, rc = 0 00000100:00100000:1.0:1746065078.106159:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.106300:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261323648 00000100:00100000:0.0:1746065078.106307:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261323648 00000100:00100000:0.0:1746065078.106351:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11904 00000100:00100000:0.0:1746065078.106358:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27846:x1830881261323648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.106374:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.106376:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065078.106407:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460d83 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1d1 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.106421:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f600) 00010000:00010000:0.0:1746065078.106430:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.106439:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460da6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1df expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.106513:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.106522:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106529:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106536:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.106542:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106546:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106872:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.106883:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106889:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065078.106897:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x325:0x0]: returning size 0 00010000:00010000:0.0:1746065078.106917:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106922:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106927:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106932:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106936:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.106939:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106944:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106951:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:0.0:1746065078.106953:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.106955:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106959:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0200/0xad6b7ddc1460dad lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065078.106970:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c528380 reply state ffff8800940c6000 transno 4294975301 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106978:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.106982:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:0.0:1746065078.106984:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065078.106986:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065078.107004:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1800/0xad6b7ddc1460da6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.107016:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.107021:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065078.107022:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065078.107024:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f183800, rc 0) 00000100:00100000:0.0:1746065078.107079:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27846:x1830881261323648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 721us (927us total) trans 4294975301 rc 0/0 00000100:00100000:0.0:1746065078.107085:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11904 00000001:00080000:0.0:1746065078.107544:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975300 is committed 00000004:00080000:0.0:1746065078.107550:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1577 committed 00000004:00080000:0.0:1746065078.107565:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1587 committed 00000004:00080000:0.0:1746065078.107583:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1586 committed 00000004:00080000:0.0:1746065078.107585:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1576 committed 00010000:00010000:3.0:1746065078.107647:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.107654:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.107659:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.107664:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.107666:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.107674:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.107682:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:3.0:1746065078.107684:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.107686:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.107691:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460d1a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065078.107811:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065078.107823:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262606720:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.107857:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.107897:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262606592:0@lo:2:osp-syn-0-1.0 00000004:00010000:2.0:1746065078.107917:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c529c00 reply state ffff88008c52e000 transno 4294975300 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065078.107920:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065078.107931:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.107937:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.107938:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065078.107940:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065078.107953:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262606720 00000100:00100000:2.0:1746065078.107956:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262606720 00000100:00100000:3.0:1746065078.107969:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065078.107974:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262606976:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.107980:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262606592 00000100:00100000:2.0:1746065078.107982:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262606592 00000100:00100000:3.0:1746065078.107991:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.107993:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8364 00000100:00100000:2.0:1746065078.107997:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+198:3762:x1830881262606720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.108005:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262606976 00000100:00100000:3.0:1746065078.108008:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262606976 00000100:00100000:3.0:1746065078.108023:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8365 00000100:00100000:3.0:1746065078.108027:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+198:3760:x1830881262606592:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.108064:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8366 00000100:00100000:3.0:1746065078.108068:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+231:3760:x1830881262606976:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.108086:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+200:3762:x1830881262606720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 89us (229us total) trans 21474839727 rc 0/0 00000100:00100000:2.0:1746065078.108091:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8364 00000100:00100000:2.0:1746065078.108107:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009576d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262606848:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.108122:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065078.108146:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc8700/2, rc 0, transno 21474839727 00000100:00100000:0.0:1746065078.108184:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262606848 00000100:00100000:0.0:1746065078.108187:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262606848 00000100:00100000:0.0:1746065078.108203:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8367 00000100:00100000:0.0:1746065078.108208:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+233:3762:x1830881262606848:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.108252:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262606720:0@lo:2:osp-syn-0-1.0 00010000:00080000:2.0:1746065078.108853:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065078.108870:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27844:x1830881261323264:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 7055us (7190us total) trans 4294975300 rc 0/0 00000100:00100000:2.0:1746065078.108875:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11902 00010000:00010000:2.0:1746065078.108891:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.108898:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.108903:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.108907:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.108909:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.108914:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.108921:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.108923:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.108925:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.108929:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1460d8a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065078.109330:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+233:3760:x1830881262606976:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1260us (1336us total) trans 17179872451 rc 0/0 00000100:00100000:3.0:1746065078.109336:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8366 00002000:00010000:1.0:1746065078.109347:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.109351:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:1.0:1746065078.109353:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.109355:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:1.0:1746065078.109357:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.109376:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+199:3760:x1830881262606592:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1348us (1455us total) trans 21474839726 rc 0/0 00000100:00100000:1.0:1746065078.109378:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+233:3762:x1830881262606848:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1170us (1255us total) trans 17179872452 rc 0/0 00000100:00100000:3.0:1746065078.109381:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8365 00000100:00100000:1.0:1746065078.109383:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8367 00000004:00080000:2.0:1746065078.109530:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009576d500/2, rc 0, transno 17179872452 00000100:00100000:2.0:1746065078.109535:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009576d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262606848:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065078.109551:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2d80/2, rc 0, transno 17179872451 00000100:00100000:2.0:1746065078.109553:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262606976:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065078.109561:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137345180/2, rc 0, transno 21474839726 00000100:00100000:2.0:1746065078.109563:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262606592:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.110857:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.111251:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.111287:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261323904 00000100:00100000:0.0:1746065078.111292:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261323904 00000100:00100000:0.0:1746065078.111320:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261324032 00000100:00100000:0.0:1746065078.111322:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261324032 00000100:00100000:0.0:1746065078.111349:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11905 00000100:00100000:0.0:1746065078.111355:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27846:x1830881261323904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.111370:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.111382:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460dc9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1e6 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.111459:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.111469:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.111476:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.111500:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.111510:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 272 pid: 7204 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.111520:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262607104:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065078.111593:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.111706:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11906 00000100:00100000:2.0:1746065078.111713:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:27844:x1830881261324032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.111726:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.111733:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1ed expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.111760:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.111770:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.111815:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.111818:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.111821:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:2.0:1746065078.111845:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27844:x1830881261324032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 133us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.111850:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11906 00000001:00080000:0.0:1746065078.112074:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872452 is committed 00000001:00080000:0.0:1746065078.112082:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872450 is committed 00000100:00100000:2.0:1746065078.113095:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262607104:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.113112:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.113221:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.113281:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261324160 00000100:00100000:2.0:1746065078.113286:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261324160 00010000:00010000:2.0:1746065078.113305:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 273 pid: 7204 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.113587:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3535 00000100:00100000:2.0:1746065078.113592:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+273:2004:x1830881261324160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.113599:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.113604:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 273 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.113612:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 273 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.113625:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f183800/0xad6b7ddc1460dbb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1df expref: 273 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.113635:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff880097b72600) 00010000:00010000:2.0:1746065078.113639:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.113645:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.113649:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.113725:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.114028:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114033:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065078.114050:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x325:0x0]: returning size 0 00000004:00080000:0.0:1746065078.114180:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x349:0x0], index 1: 0 00000004:00080000:0.0:1746065078.114186:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x348:0x0], index 0: 0 00000004:00080000:0.0:1746065078.114189:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x349:0x0], index 0: 0 00000004:00080000:0.0:1746065078.114191:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x34a:0x0], index 1: 0 00010000:00010000:0.0:1746065078.114264:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114269:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114275:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114279:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.114283:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114288:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114296:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff880097b72600) 00010000:00010000:0.0:1746065078.114298:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065078.114301:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114308:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1000/0xad6b7ddc1460dd0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.114339:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460dc9 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1e6 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.114345:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b1400/0xad6b7ddc1460dc9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1e6 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.114360:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b1400, rc 0) 00000100:00100000:2.0:1746065078.114401:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+272:2004:x1830881261324160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 808us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.114408:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3535 00000100:00100000:0.0:1746065078.114509:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27846:x1830881261323904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3154us (3657us total) trans 4294975302 rc 301/301 00000100:00100000:0.0:1746065078.114515:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11905 00000100:00100000:0.0:1746065078.116930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.117026:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261324288 00000100:00100000:2.0:1746065078.117033:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261324288 00000100:00100000:2.0:1746065078.117075:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11907 00000100:00100000:2.0:1746065078.117081:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27844:x1830881261324288:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.117097:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.117108:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460de5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1f4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.117159:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460dec lrc: 3/1,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.117168:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460dec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.117175:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460dec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065078.117204:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x323:0x0]: returning size 5 00000004:00200000:2.0:1746065078.117207:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065078.117217:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460dec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.117233:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460de5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1f4 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.117244:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460dec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1f4 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.117251:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.117253:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065078.117255:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:2.0:1746065078.117290:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27844:x1830881261324288:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 208us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.117295:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11907 00000100:00100000:0.0:1746065078.117500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.117588:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261324544 00000100:00100000:3.0:1746065078.117592:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261324544 00000100:00100000:3.0:1746065078.117614:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4097 00000100:00100000:3.0:1746065078.117618:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27846:x1830881261324544:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.117750:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27846:x1830881261324544:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 131us (250us total) trans 4294975303 rc 0/0 00000100:00100000:3.0:1746065078.117756:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4097 00000100:00100000:0.0:1746065078.120286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.120346:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261324672 00000100:00100000:1.0:1746065078.120352:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261324672 00000100:00100000:1.0:1746065078.121197:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8368 00000100:00100000:1.0:1746065078.121205:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+78:2005:x1830881261324672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.121218:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.121233:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c1fb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065078.121253:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x346:0x0] initial LVB size: 5, mtime: 0x6812d6b6, atime: 0x0, ctime: 0x6812d6b6, blocks: 0x8 00010000:00010000:1.0:1746065078.121268:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.121270:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.121277:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 79 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.121289:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 79 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.121298:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:1.0:1746065078.121339:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+79:2005:x1830881261324672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 135us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.121345:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8368 00000100:00100000:0.0:1746065078.121956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.122217:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261324928 00000100:00100000:2.0:1746065078.122221:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261324928 00000100:00100000:2.0:1746065078.122255:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4098 00000100:00100000:2.0:1746065078.122261:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27846:x1830881261324928:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.122389:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27846:x1830881261324928:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 128us (434us total) trans 4294975304 rc 0/0 00000100:00100000:2.0:1746065078.122394:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4098 00000100:00100000:0.0:1746065078.126138:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.126197:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261325056 00000100:00100000:3.0:1746065078.126204:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261325056 00000100:00100000:3.0:1746065078.126239:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8369 00000100:00100000:3.0:1746065078.126245:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+79:2006:x1830881261325056:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065078.126326:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+79:2006:x1830881261325056:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.126333:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8369 00000100:00100000:0.0:1746065078.129507:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.129580:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261325312 00000100:00100000:3.0:1746065078.129586:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261325312 00000100:00100000:3.0:1746065078.129636:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11908 00000100:00100000:3.0:1746065078.129643:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261325312:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.129664:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.129682:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460dfa lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c202 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.129851:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.129861:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.129871:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.129877:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.129882:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.129886:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.129928:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460e0f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.129933:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460e0f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.129943:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460e0f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.129950:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x325:0x0]: returning size 0 00010000:00010000:3.0:1746065078.130011:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130017:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130022:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130026:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130030:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.130033:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130038:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130048:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065078.130050:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.130053:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130057:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c400/0xad6b7ddc1460e01 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130066:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130073:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130077:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130080:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.130082:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130644:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130653:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:3.0:1746065078.130655:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065078.130656:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.130658:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130662:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1460e08 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.130697:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460dfa lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c202 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.130711:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460e0f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c202 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.130717:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.130719:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1746065078.130720:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261325440 00010000:00010000:3.0:1746065078.130721:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ce00, rc 0) 00000100:00100000:0.0:1746065078.130724:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261325440 00000100:00100000:0.0:1746065078.130758:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8370 00000100:00100000:0.0:1746065078.130763:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+79:2007:x1830881261325440:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065078.130767:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261325312:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1124us (1268us total) trans 4294975305 rc 0/0 00000100:00100000:3.0:1746065078.130790:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11908 00000100:00100000:0.0:1746065078.131207:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+79:2007:x1830881261325440:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 441us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.131213:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8370 00000100:00100000:0.0:1746065078.132665:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.132851:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261325568 00000100:00100000:3.0:1746065078.132857:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261325568 00000100:00100000:3.0:1746065078.133326:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11909 00000100:00100000:3.0:1746065078.133334:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261325568:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.133357:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.133372:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1460e1d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c209 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.133398:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460e24 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.133408:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460e24 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.133418:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460e24 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.133497:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1460e1d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c209 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.133511:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460e24 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c209 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.133517:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.133519:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065078.133521:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:3.0:1746065078.134008:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261325568:12345-192.168.202.27@tcp:101:bash.0 Request processed in 672us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.134017:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11909 00000100:00100000:2.0:1746065078.138082:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.138135:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.138316:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261325824 00000100:00100000:3.0:1746065078.138324:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261325824 00000100:00100000:3.0:1746065078.138490:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261326080 00000100:00100000:3.0:1746065078.138494:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261326080 00000100:00100000:0.0:1746065078.138542:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11910 00000100:00100000:0.0:1746065078.138553:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27844:x1830881261325824:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065078.138602:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.138624:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460dec lrc: 0/0,0 mode: --/PR res: [0x240000403:0x323:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1f4 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.138639:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065078.138643:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.138667:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.138676:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.138683:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065078.138793:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099ccb480 reply state ffff880087e26000 transno 4294975306 ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.138802:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.138806:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065078.138808:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065078.138810:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065078.138886:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27844:x1830881261325824:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 335us (810us total) trans 4294975306 rc 0/0 00000100:00100000:0.0:1746065078.138893:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11910 00000100:00100000:0.0:1746065078.138909:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11911 00000100:00100000:0.0:1746065078.138913:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261326080:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:0.0:1746065078.138929:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.138938:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ce00/0xad6b7ddc1460e0f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c202 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.138946:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:0.0:1746065078.138948:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.139020:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.139026:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.139032:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:0.0:1746065078.139053:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975307 00000004:00010000:0.0:1746065078.139067:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925c8000 reply state ffff880087e25000 transno 4294975308 ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.139073:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.139077:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:0.0:1746065078.139079:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065078.139081:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065078.139109:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261326080:12345-192.168.202.27@tcp:36:bash.0 Request processed in 195us (974us total) trans 4294975308 rc 0/0 00000100:00100000:0.0:1746065078.139114:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11911 00000020:00080000:0.0:1746065078.139117:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065078.142190:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.142231:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.142363:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261326208 00000100:00100000:0.0:1746065078.142369:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261326208 00000100:00100000:0.0:1746065078.142410:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11912 00000100:00100000:0.0:1746065078.142417:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261326208:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065078.142433:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.142448:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1460e39 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c210 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.142490:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1460e39 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c210 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.142501:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1460e39 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c210 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.142514:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:0.0:1746065078.142517:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065078.142520:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4800, rc 0) 00000100:00100000:2.0:1746065078.143072:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261326336 00000100:00100000:2.0:1746065078.143077:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261326336 00000100:00100000:2.0:1746065078.143098:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8371 00000100:00100000:2.0:1746065078.143102:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+79:2006:x1830881261326336:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065078.143197:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065078.143200:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:2.0:1746065078.143202:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb atime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.143203:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:2.0:1746065078.143205:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065078.143602:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261326208:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1184us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.143609:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11912 00000100:00100000:2.0:1746065078.143787:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+80:2006:x1830881261326336:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 669us (1541us total) trans 21474839728 rc 0/0 00000100:00100000:2.0:1746065078.143793:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8371 00000100:00100000:0.0:1746065078.148207:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.148275:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.148406:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261326592 00000100:00100000:1.0:1746065078.148413:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261326592 00000100:00100000:1.0:1746065078.148449:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11913 00000100:00100000:1.0:1746065078.148454:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261326592:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065078.148474:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.148477:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065078.148498:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1460e39 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c210 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.148523:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:1.0:1746065078.148527:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.148535:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e40 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c217 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.148579:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460e47 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.148588:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460e47 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.148595:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460e47 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:1.0:1746065078.148755:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2348, 88 off194784 00000004:00080000:1.0:1746065078.148760:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674166985907ns, next at 674466957028ns, rc = 0 00000040:00080000:1.0:1746065078.148800:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2344, 88 off194328 00000004:00080000:1.0:1746065078.148803:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674167029270ns, next at 674466981116ns, rc = 0 00000100:00100000:2.0:1746065078.148919:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261326848 00000100:00100000:2.0:1746065078.148923:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261326848 00000100:00100000:2.0:1746065078.148944:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4099 00000100:00100000:2.0:1746065078.148949:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27844:x1830881261326848:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065078.148978:0:7207:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x323:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460d3d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1bc expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.148994:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:2.0:1746065078.149002:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.149007:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.149027:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.149035:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 282 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.149044:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262607232:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.149218:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1746065078.149696:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2345, 88 off194416 00000004:00080000:1.0:1746065078.149701:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674167927537ns, next at 674466981116ns, rc = 0 00000040:00080000:1.0:1746065078.149713:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2349, 88 off194872 00000004:00080000:1.0:1746065078.149716:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674167942780ns, next at 674466957028ns, rc = 0 00000100:00100000:3.0:1746065078.152180:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.152261:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261326976 00000100:00100000:2.0:1746065078.152269:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261326976 00010000:00010000:2.0:1746065078.152299:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 284 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.152331:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3536 00000100:00100000:2.0:1746065078.152338:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+284:2005:x1830881261326976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.152350:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.152355:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 284 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.152365:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 284 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.152387:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.152391:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.152399:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.152404:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.152418:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.152462:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+284:2005:x1830881261326976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.152468:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3536 00010000:00010000:2.0:1746065078.152499:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460dd7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1ed expref: 283 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.152516:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262607232:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.152527:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.152542:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.152547:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000001:00080000:0.0:1746065078.153310:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975309 is committed 00000004:00080000:0.0:1746065078.153316:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1589 committed 00000004:00080000:0.0:1746065078.153320:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1579 committed 00000004:00080000:0.0:1746065078.153329:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1578 committed 00000004:00080000:0.0:1746065078.153330:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1588 committed 00010000:00010000:1.0:1746065078.153466:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460e47 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c217 expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.153474:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:1.0:1746065078.153477:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065078.153486:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e40 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c217 expref: 274 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065078.153499:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460e47 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c217 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.153519:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:1.0:1746065078.153521:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065078.153523:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:1.0:1746065078.153546:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261326592:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5092us (5348us total) trans 4294975309 rc 0/0 00000100:00100000:1.0:1746065078.153553:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11913 00010000:00010000:3.0:1746065078.153613:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153620:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153625:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153630:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b0800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.153633:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153638:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153646:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:3.0:1746065078.153647:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.153650:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153653:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b0800/0xad6b7ddc1460db4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153673:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153680:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153685:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153688:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.153689:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153693:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153698:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065078.153699:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.153701:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153704:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460e2b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153710:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153713:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153717:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153721:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.153722:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153730:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153736:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.153737:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.153738:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.153742:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055000/0xad6b7ddc1460e32 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x325:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:3.0:1746065078.153836:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262607360:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.153868:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.153892:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262607488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.153904:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.153920:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262607360 00000100:00100000:3.0:1746065078.153923:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262607360 00000100:00100000:3.0:1746065078.153941:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262607488 00000100:00100000:3.0:1746065078.153942:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262607488 00000100:00100000:3.0:1746065078.153951:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8372 00000100:00100000:3.0:1746065078.153955:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3760:x1830881262607360:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.154041:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881262607360:12345-0@lo:2:osp-syn-1-1.0 Request processed in 85us (172us total) trans 17179872453 rc 0/0 00000100:00100000:3.0:1746065078.154045:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8372 00000100:00100000:3.0:1746065078.154053:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8373 00000100:00100000:3.0:1746065078.154056:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3761:x1830881262607488:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.154094:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262607488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 37us (190us total) trans 17179872454 rc 0/0 00000100:00100000:3.0:1746065078.154101:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8373 00000100:00100000:3.0:1746065078.154121:0:3761:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179872452 gen 2 00000004:00080000:3.0:1746065078.154125:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570f800, transno 17179872172 00000004:00080000:3.0:1746065078.154129:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570f480, transno 17179872173 00000004:00080000:3.0:1746065078.154131:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a5880, transno 17179872174 00000004:00080000:3.0:1746065078.154133:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c700, transno 17179872175 00000004:00080000:3.0:1746065078.154135:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd180, transno 17179872177 00000004:00080000:3.0:1746065078.154137:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a6a00, transno 17179872178 00000004:00080000:3.0:1746065078.154139:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df800, transno 17179872179 00000004:00080000:3.0:1746065078.154141:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a5180, transno 17179872180 00000004:00080000:3.0:1746065078.154143:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37c700, transno 17179872182 00000004:00080000:3.0:1746065078.154144:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ce00, transno 17179872183 00000004:00080000:3.0:1746065078.154146:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37d180, transno 17179872184 00000004:00080000:3.0:1746065078.154148:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ea00, transno 17179872185 00000004:00080000:3.0:1746065078.154149:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cd500, transno 17179872187 00000004:00080000:3.0:1746065078.154151:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cc000, transno 17179872188 00000004:00080000:3.0:1746065078.154153:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef26d80, transno 17179872189 00000004:00080000:3.0:1746065078.154155:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d0380, transno 17179872190 00000004:00080000:3.0:1746065078.154157:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24380, transno 17179872191 00000004:00080000:3.0:1746065078.154159:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24000, transno 17179872192 00000004:00080000:3.0:1746065078.154161:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef26680, transno 17179872194 00000004:00080000:3.0:1746065078.154162:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25f80, transno 17179872195 00000004:00080000:3.0:1746065078.154164:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f41f80, transno 17179872196 00000004:00080000:3.0:1746065078.154165:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25500, transno 17179872197 00000004:00080000:3.0:1746065078.154167:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24700, transno 17179872198 00000004:00080000:3.0:1746065078.154168:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24e00, transno 17179872199 00000004:00080000:3.0:1746065078.154170:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5de300, transno 17179872201 00000004:00080000:3.0:1746065078.154172:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dd180, transno 17179872202 00000004:00080000:3.0:1746065078.154175:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f56d80, transno 17179872203 00000004:00080000:3.0:1746065078.154177:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f56300, transno 17179872204 00000004:00080000:3.0:1746065078.154178:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed2300, transno 17179872205 00000004:00080000:3.0:1746065078.154180:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed0000, transno 17179872206 00000004:00080000:3.0:1746065078.154182:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ce00, transno 17179872208 00000004:00080000:3.0:1746065078.154184:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570e300, transno 17179872209 00000004:00080000:3.0:1746065078.154186:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d180, transno 17179872210 00000004:00080000:3.0:1746065078.154188:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8700, transno 17179872211 00000004:00080000:3.0:1746065078.154189:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb800, transno 17179872212 00000004:00080000:3.0:1746065078.154191:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c380, transno 17179872213 00000004:00080000:3.0:1746065078.154193:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2300, transno 17179872215 00000004:00080000:3.0:1746065078.154195:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2d80, transno 17179872216 00000004:00080000:3.0:1746065078.154197:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0a80, transno 17179872217 00000004:00080000:3.0:1746065078.154198:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0e00, transno 17179872218 00000004:00080000:3.0:1746065078.154200:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0000, transno 17179872219 00000004:00080000:3.0:1746065078.154201:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1180, transno 17179872220 00000004:00080000:3.0:1746065078.154203:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a7a0380, transno 17179872222 00000004:00080000:3.0:1746065078.154205:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a7a0a80, transno 17179872223 00000004:00080000:3.0:1746065078.154206:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a7a1880, transno 17179872224 00000004:00080000:3.0:1746065078.154208:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a7a1c00, transno 17179872225 00000004:00080000:3.0:1746065078.154209:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd180, transno 17179872226 00000004:00080000:3.0:1746065078.154211:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a7a2a00, transno 17179872227 00000004:00080000:3.0:1746065078.154213:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3100, transno 17179872229 00000004:00080000:3.0:1746065078.154214:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1f80, transno 17179872230 00000004:00080000:3.0:1746065078.154216:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009576ed80, transno 17179872231 00000004:00080000:3.0:1746065078.154218:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f480, transno 17179872232 00000004:00080000:3.0:1746065078.154219:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f42680, transno 17179872233 00000004:00080000:3.0:1746065078.154221:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f43480, transno 17179872234 00000004:00080000:3.0:1746065078.154223:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cea680, transno 17179872237 00000004:00080000:3.0:1746065078.154225:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce9f80, transno 17179872238 00000004:00080000:3.0:1746065078.154227:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce8380, transno 17179872239 00000004:00080000:3.0:1746065078.154229:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce8000, transno 17179872240 00000004:00080000:3.0:1746065078.154231:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce9180, transno 17179872241 00000004:00080000:3.0:1746065078.154233:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce9500, transno 17179872242 00000004:00080000:3.0:1746065078.154235:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858ca80, transno 17179872244 00000004:00080000:3.0:1746065078.154237:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858dc00, transno 17179872245 00000004:00080000:3.0:1746065078.154245:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bdf80, transno 17179872247 00000004:00080000:3.0:1746065078.154246:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bdc00, transno 17179872248 00000004:00080000:3.0:1746065078.154248:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bd180, transno 17179872249 00000004:00080000:3.0:1746065078.154250:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bca80, transno 17179872250 00000004:00080000:3.0:1746065078.154252:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bf800, transno 17179872251 00000004:00080000:3.0:1746065078.154253:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2be680, transno 17179872252 00000004:00080000:3.0:1746065078.154255:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cfb80, transno 17179872255 00000004:00080000:3.0:1746065078.154257:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1880, transno 17179872256 00000004:00080000:3.0:1746065078.154259:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3e680, transno 17179872258 00000004:00080000:3.0:1746065078.154261:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3c380, transno 17179872259 00000004:00080000:3.0:1746065078.154263:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3dc00, transno 17179872260 00000004:00080000:3.0:1746065078.154265:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ce00, transno 17179872261 00000004:00080000:3.0:1746065078.154267:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4fb800, transno 17179872263 00000004:00080000:3.0:1746065078.154269:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4faa00, transno 17179872264 00000004:00080000:3.0:1746065078.154270:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4fa680, transno 17179872265 00000004:00080000:3.0:1746065078.154272:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f8e00, transno 17179872266 00000004:00080000:3.0:1746065078.154274:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d17b80, transno 17179872267 00000004:00080000:3.0:1746065078.154275:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d16300, transno 17179872268 00000004:00080000:3.0:1746065078.154277:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098667100, transno 17179872270 00000004:00080000:3.0:1746065078.154279:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665f80, transno 17179872271 00000004:00080000:3.0:1746065078.154281:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09e300, transno 17179872272 00000004:00080000:3.0:1746065078.154283:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a0a80, transno 17179872273 00000004:00080000:3.0:1746065078.154284:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a1880, transno 17179872274 00000004:00080000:3.0:1746065078.154286:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221880, transno 17179872275 00000004:00080000:3.0:1746065078.154288:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed2a00, transno 17179872276 00000004:00080000:3.0:1746065078.154291:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c525c00, transno 17179872277 00000004:00080000:3.0:1746065078.154293:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91f80, transno 17179872279 00000004:00080000:3.0:1746065078.154302:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a93480, transno 17179872280 00000004:00080000:3.0:1746065078.154304:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a93b80, transno 17179872281 00000004:00080000:3.0:1746065078.154306:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed7b80, transno 17179872282 00000004:00080000:3.0:1746065078.154308:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ea00, transno 17179872284 00000004:00080000:3.0:1746065078.154310:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834df80, transno 17179872285 00000004:00080000:3.0:1746065078.154311:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ed80, transno 17179872286 00000004:00080000:3.0:1746065078.154313:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d500, transno 17179872287 00000004:00080000:3.0:1746065078.154315:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ccb800, transno 17179872289 00000004:00080000:3.0:1746065078.154317:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ccaa00, transno 17179872290 00000004:00080000:3.0:1746065078.154319:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52ad80, transno 17179872291 00000004:00080000:3.0:1746065078.154320:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c529180, transno 17179872292 00000004:00080000:3.0:1746065078.154322:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cff100, transno 17179872293 00000004:00080000:3.0:1746065078.154324:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528a80, transno 17179872294 00000004:00080000:3.0:1746065078.154326:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85df80, transno 17179872297 00000004:00080000:3.0:1746065078.154328:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ea00, transno 17179872298 00000004:00080000:3.0:1746065078.154330:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85c380, transno 17179872299 00000004:00080000:3.0:1746065078.154331:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ca80, transno 17179872300 00000004:00080000:3.0:1746065078.154333:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb8a80, transno 17179872302 00000004:00080000:3.0:1746065078.154335:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbb480, transno 17179872303 00000004:00080000:3.0:1746065078.154337:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835a300, transno 17179872304 00000004:00080000:3.0:1746065078.154338:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098359500, transno 17179872305 00000004:00080000:3.0:1746065078.154340:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bf800, transno 17179872307 00000004:00080000:3.0:1746065078.154342:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8000, transno 17179872308 00000004:00080000:3.0:1746065078.154344:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cc700, transno 17179872309 00000004:00080000:3.0:1746065078.154345:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cdc00, transno 17179872310 00000004:00080000:3.0:1746065078.154347:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bd500, transno 17179872311 00000004:00080000:3.0:1746065078.154349:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bca80, transno 17179872312 00000004:00080000:3.0:1746065078.154351:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec9500, transno 17179872315 00000004:00080000:3.0:1746065078.154353:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb480, transno 17179872316 00000004:00080000:3.0:1746065078.154355:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8380, transno 17179872318 00000004:00080000:3.0:1746065078.154356:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd500, transno 17179872319 00000004:00080000:3.0:1746065078.154359:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dce00, transno 17179872320 00000004:00080000:3.0:1746065078.154360:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a5c00, transno 17179872321 00000004:00080000:3.0:1746065078.154362:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb8000, transno 17179872323 00000004:00080000:3.0:1746065078.154363:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce8a80, transno 17179872324 00000004:00080000:3.0:1746065078.154365:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce8e00, transno 17179872325 00000004:00080000:3.0:1746065078.154366:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb9880, transno 17179872326 00000004:00080000:3.0:1746065078.154368:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbad80, transno 17179872327 00000004:00080000:3.0:1746065078.154370:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb9f80, transno 17179872328 00000004:00080000:3.0:1746065078.154372:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50a80, transno 17179872330 00000004:00080000:3.0:1746065078.154374:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858f480, transno 17179872331 00000004:00080000:3.0:1746065078.154375:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dc380, transno 17179872332 00000004:00080000:3.0:1746065078.154377:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dca80, transno 17179872333 00000004:00080000:3.0:1746065078.154379:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd880, transno 17179872335 00000004:00080000:3.0:1746065078.154381:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad880, transno 17179872336 00000004:00080000:3.0:1746065078.154382:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077d880, transno 17179872337 00000004:00080000:3.0:1746065078.154384:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d880, transno 17179872338 00000004:00080000:3.0:1746065078.154386:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179872339 00000004:00080000:3.0:1746065078.154388:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ca80, transno 17179872340 00000004:00080000:3.0:1746065078.154389:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ce00, transno 17179872341 00000004:00080000:3.0:1746065078.154391:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835b800, transno 17179872342 00000004:00080000:3.0:1746065078.154393:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd1880, transno 17179872345 00000004:00080000:3.0:1746065078.154395:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd2680, transno 17179872346 00000004:00080000:3.0:1746065078.154396:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd1500, transno 17179872347 00000004:00080000:3.0:1746065078.154398:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098583800, transno 17179872348 00000004:00080000:3.0:1746065078.154400:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb100, transno 17179872350 00000004:00080000:3.0:1746065078.154402:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3c000, transno 17179872351 00000004:00080000:3.0:1746065078.154404:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ea00, transno 17179872352 00000004:00080000:3.0:1746065078.154406:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cce00, transno 17179872353 00000004:00080000:3.0:1746065078.154407:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd1180, transno 17179872354 00000004:00080000:3.0:1746065078.154409:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd3b80, transno 17179872355 00000004:00080000:3.0:1746065078.154411:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9880, transno 17179872357 00000004:00080000:3.0:1746065078.154412:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957db480, transno 17179872358 00000004:00080000:3.0:1746065078.154414:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957daa00, transno 17179872359 00000004:00080000:3.0:1746065078.154416:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8a80, transno 17179872360 00000004:00080000:3.0:1746065078.154417:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da300, transno 17179872361 00000004:00080000:3.0:1746065078.154419:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8700, transno 17179872362 00000004:00080000:3.0:1746065078.154424:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077ca80, transno 17179872365 00000004:00080000:3.0:1746065078.154426:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077dc00, transno 17179872366 00000004:00080000:3.0:1746065078.154427:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c700, transno 17179872367 00000004:00080000:3.0:1746065078.154429:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c380, transno 17179872368 00000004:00080000:3.0:1746065078.154430:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f55c00, transno 17179872371 00000004:00080000:3.0:1746065078.154432:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f57100, transno 17179872372 00000004:00080000:3.0:1746065078.154434:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6300, transno 17179872374 00000004:00080000:3.0:1746065078.154436:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6680, transno 17179872375 00000004:00080000:3.0:1746065078.154437:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957db100, transno 17179872376 00000004:00080000:3.0:1746065078.154439:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221c00, transno 17179872377 00000004:00080000:3.0:1746065078.154441:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957dbb80, transno 17179872378 00000004:00080000:3.0:1746065078.154443:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e7800, transno 17179872379 00000004:00080000:3.0:1746065078.154445:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2680, transno 17179872381 00000004:00080000:3.0:1746065078.154446:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3b80, transno 17179872382 00000004:00080000:3.0:1746065078.154448:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2300, transno 17179872383 00000004:00080000:3.0:1746065078.154450:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0000, transno 17179872384 00000004:00080000:3.0:1746065078.154452:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077f100, transno 17179872386 00000004:00080000:3.0:1746065078.154453:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2a00, transno 17179872387 00000004:00080000:3.0:1746065078.154455:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09fb80, transno 17179872388 00000004:00080000:3.0:1746065078.154457:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e13100, transno 17179872389 00000004:00080000:3.0:1746065078.154459:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d0e00, transno 17179872390 00000004:00080000:3.0:1746065078.154461:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098359f80, transno 17179872391 00000004:00080000:3.0:1746065078.154463:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077ed80, transno 17179872392 00000004:00080000:3.0:1746065078.154465:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009576dc00, transno 17179872393 00000004:00080000:3.0:1746065078.154467:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5ddc00, transno 17179872395 00000004:00080000:3.0:1746065078.154468:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dce00, transno 17179872396 00000004:00080000:3.0:1746065078.154470:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5de680, transno 17179872397 00000004:00080000:3.0:1746065078.154472:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dfb80, transno 17179872398 00000004:00080000:3.0:1746065078.154473:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098660700, transno 17179872401 00000004:00080000:3.0:1746065078.154475:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661180, transno 17179872402 00000004:00080000:3.0:1746065078.154477:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1f80, transno 17179872404 00000004:00080000:3.0:1746065078.154478:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf0380, transno 17179872405 00000004:00080000:3.0:1746065078.154480:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed1880, transno 17179872406 00000004:00080000:3.0:1746065078.154482:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed2d80, transno 17179872407 00000004:00080000:3.0:1746065078.154483:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dea00, transno 17179872409 00000004:00080000:3.0:1746065078.154485:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dc000, transno 17179872410 00000004:00080000:3.0:1746065078.154486:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dc700, transno 17179872411 00000004:00080000:3.0:1746065078.154488:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f9180, transno 17179872412 00000004:00080000:3.0:1746065078.154490:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dd880, transno 17179872413 00000004:00080000:3.0:1746065078.154491:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dd500, transno 17179872414 00000004:00080000:3.0:1746065078.154493:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137344700, transno 17179872417 00000004:00080000:3.0:1746065078.154495:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137344a80, transno 17179872418 00000004:00080000:3.0:1746065078.154496:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137347480, transno 17179872420 00000004:00080000:3.0:1746065078.154498:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137344000, transno 17179872421 00000004:00080000:3.0:1746065078.154499:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345c00, transno 17179872422 00000004:00080000:3.0:1746065078.154501:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137344380, transno 17179872423 00000004:00080000:3.0:1746065078.154503:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661880, transno 17179872425 00000004:00080000:3.0:1746065078.154504:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098663480, transno 17179872426 00000004:00080000:3.0:1746065078.154506:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098662d80, transno 17179872427 00000004:00080000:3.0:1746065078.154508:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661c00, transno 17179872428 00000004:00080000:3.0:1746065078.154510:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098660a80, transno 17179872429 00000004:00080000:3.0:1746065078.154512:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098662a00, transno 17179872430 00000004:00080000:3.0:1746065078.154514:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137347800, transno 17179872432 00000004:00080000:3.0:1746065078.154515:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137346680, transno 17179872433 00000004:00080000:3.0:1746065078.154517:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345500, transno 17179872434 00000004:00080000:3.0:1746065078.154518:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345880, transno 17179872435 00000004:00080000:3.0:1746065078.154520:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54a80, transno 17179872437 00000004:00080000:3.0:1746065078.154522:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f57b80, transno 17179872438 00000004:00080000:3.0:1746065078.154524:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dea00, transno 17179872439 00000004:00080000:3.0:1746065078.154525:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dd500, transno 17179872440 00000004:00080000:3.0:1746065078.154527:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54e00, transno 17179872442 00000004:00080000:3.0:1746065078.154529:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f55880, transno 17179872443 00000004:00080000:3.0:1746065078.154530:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54380, transno 17179872444 00000004:00080000:3.0:1746065078.154532:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f57480, transno 17179872445 00000004:00080000:3.0:1746065078.154533:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54000, transno 17179872446 00000004:00080000:3.0:1746065078.154535:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f57800, transno 17179872447 00000004:00080000:3.0:1746065078.154537:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54700, transno 17179872448 00000004:00080000:3.0:1746065078.154538:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f56680, transno 17179872449 00000004:00080000:3.0:1746065078.154540:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2d80, transno 17179872451 00000004:00080000:3.0:1746065078.154542:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009576d500, transno 17179872452 00000100:00100000:3.0:1746065078.154547:0:3761:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c5f3100 x1830881262607488/t17179872454(17179872454) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065094 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 00000004:00080000:3.0:1746065078.154555:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3100/2, rc 0, transno 17179872454 00000100:00100000:3.0:1746065078.154559:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262607488:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065078.154586:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1500/2, rc 0, transno 17179872453 00000100:00100000:3.0:1746065078.154589:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262607360:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065078.155216:0:11455:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 226 done 00000100:00100000:2.0:1746065078.155321:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262607616:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.155347:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1746065078.155408:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2346, 88 off194504 00000004:00080000:2.0:1746065078.155412:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674173638704ns, next at 674466981116ns, rc = 0 00000040:00080000:2.0:1746065078.155438:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2350, 88 off194960 00000004:00080000:2.0:1746065078.155440:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674173666973ns, next at 674466957028ns, rc = 0 00000040:00080000:2.0:1746065078.155449:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2351, 88 off195048 00000004:00080000:2.0:1746065078.155451:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674173677649ns, next at 674466957028ns, rc = 0 00000040:00080000:2.0:1746065078.155458:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2347, 88 off194592 00000004:00080000:2.0:1746065078.155461:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674173687060ns, next at 674466981116ns, rc = 0 00000100:00100000:0.0:1746065078.155896:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262607744:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.155919:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.156483:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262607616 00000100:00100000:2.0:1746065078.156488:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262607616 00000100:00100000:2.0:1746065078.156512:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262607744 00000100:00100000:2.0:1746065078.156514:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262607744 00000100:00100000:2.0:1746065078.156524:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8374 00000100:00100000:2.0:1746065078.156529:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+200:3762:x1830881262607616:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.156630:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8375 00000100:00100000:0.0:1746065078.156638:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+201:3759:x1830881262607744:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.156718:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+202:3759:x1830881262607744:12345-0@lo:2:osp-syn-0-1.0 Request processed in 81us (798us total) trans 21474839730 rc 0/0 00000100:00100000:0.0:1746065078.156723:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8375 00000004:00080000:1.0:1746065078.156817:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dce00/2, rc 0, transno 21474839730 00000100:00100000:1.0:1746065078.156825:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262607744:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.156899:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+201:3762:x1830881262607616:12345-0@lo:2:osp-syn-0-1.0 Request processed in 369us (1551us total) trans 21474839729 rc 0/0 00000100:00100000:2.0:1746065078.156904:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8374 00000004:00080000:2.0:1746065078.156925:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cb100/2, rc 0, transno 21474839729 00000100:00100000:2.0:1746065078.156928:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262607616:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.159163:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.159264:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261327104 00000100:00100000:2.0:1746065078.159271:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261327104 00000100:00100000:2.0:1746065078.159383:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8376 00000100:00100000:2.0:1746065078.159391:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:26180:x1830881261327104:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.159405:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.159422:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c21e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.159443:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.159458:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.159460:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.159466:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.159477:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.159485:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ca00, rc 0) 00000100:00100000:2.0:1746065078.160561:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:26180:x1830881261327104:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1165us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.160569:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8376 00000001:00080000:2.0:1746065078.163036:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975310 is committed 00000004:00080000:2.0:1746065078.163045:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1581 committed 00000004:00080000:2.0:1746065078.163059:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1591 committed 00000004:00080000:2.0:1746065078.163070:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1590 committed 00000004:00080000:2.0:1746065078.163071:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1580 committed 00000100:00100000:1.0:1746065078.163231:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065078.163248:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262607872:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.163302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.163378:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262607872 00000100:00100000:0.0:1746065078.163385:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262607872 00000100:00100000:0.0:1746065078.163414:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8377 00000100:00100000:0.0:1746065078.163420:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+201:3759:x1830881262607872:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065078.163526:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065078.163530:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:0.0:1746065078.163532:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb atime from disk: 1746065078 -> 1746065078 00002000:00010000:0.0:1746065078.163534:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:0.0:1746065078.163535:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x346:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065078.163564:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+202:3759:x1830881262607872:12345-0@lo:2:osp-syn-0-1.0 Request processed in 144us (261us total) trans 21474839731 rc 0/0 00000100:00100000:0.0:1746065078.163579:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8377 00000100:00100000:2.0:1746065078.163839:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065078.163851:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608000:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.163875:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.163905:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608000 00000100:00100000:0.0:1746065078.163909:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608000 00000100:00100000:0.0:1746065078.163937:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8378 00000100:00100000:0.0:1746065078.163941:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+202:3762:x1830881262608000:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.164015:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+203:3762:x1830881262608000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (139us total) trans 21474839732 rc 0/0 00000100:00100000:0.0:1746065078.164020:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8378 00000004:00080000:2.0:1746065078.164035:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a648e00/2, rc 0, transno 21474839732 00000100:00100000:2.0:1746065078.164040:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608000:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.164071:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.164084:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261327232 00000100:00100000:0.0:1746065078.164087:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261327232 00000100:00100000:0.0:1746065078.164101:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8379 00000100:00100000:0.0:1746065078.164105:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+80:26180:x1830881261327232:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065078.164113:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.164125:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c225 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746065078.164175:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a64ad80/2, rc 0, transno 21474839731 00000100:00100000:1.0:1746065078.164179:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262607872:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065078.164219:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065078.164235:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.164238:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.164245:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 81 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.164257:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 81 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.164265:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054a00, rc 0) 00000100:00100000:2.0:1746065078.164742:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608128:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.164766:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.164818:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+81:26180:x1830881261327232:12345-192.168.202.27@tcp:101:bash.0 Request processed in 712us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.164823:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8379 00000004:00010000:3.0:1746065078.165092:0:7207:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a649500 reply state ffff8800957d7c00 transno 4294975310 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.165105:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.165111:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065078.165114:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065078.165116:0:7207:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065078.165120:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065078.165122:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065078.165125:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460d3d lrc: 0/0,0 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1bc expref: 269 pid: 7231 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746065078.165184:0:7207:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065078.165192:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+269:27844:x1830881261326848:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 16243us (16917us total) trans 4294975310 rc 0/0 00000100:00100000:3.0:1746065078.165199:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4099 00010000:00010000:2.0:1746065078.165325:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.165331:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.165336:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.165340:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.165344:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.165349:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.165357:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.165358:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.165361:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.165365:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460e4e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:2.0:1746065078.165392:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065078.165399:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262608256:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.165418:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.165476:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608128 00000100:00100000:0.0:1746065078.165480:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608128 00000100:00100000:0.0:1746065078.165495:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8380 00000100:00100000:0.0:1746065078.165500:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881262608128:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065078.165591:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065078.165594:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:0.0:1746065078.165596:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065078.165598:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:0.0:1746065078.165600:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x347:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065078.165624:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3762:x1830881262608128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 124us (856us total) trans 17179872455 rc 0/0 00000100:00100000:0.0:1746065078.165629:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8380 00000100:00100000:0.0:1746065078.165914:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608256 00000004:00080000:3.0:1746065078.165959:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834ea00/2, rc 0, transno 17179872455 00000100:00100000:3.0:1746065078.165964:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608128:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.165996:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608256 00000100:00100000:0.0:1746065078.166015:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8381 00000100:00100000:0.0:1746065078.166018:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3760:x1830881262608256:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.166077:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3760:x1830881262608256:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (658us total) trans 17179872456 rc 0/0 00000100:00100000:0.0:1746065078.166087:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8381 00000004:00080000:2.0:1746065078.166499:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834df80/2, rc 0, transno 17179872456 00000100:00100000:2.0:1746065078.166503:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262608256:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.167150:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.167179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.167206:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.167223:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261327488 00000100:00100000:0.0:1746065078.167226:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261327488 00002000:00010000:0.0:1746065078.167245:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/841 (0->18446744073709551615) 00000100:00100000:1.0:1746065078.167246:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261327360 00002000:00100000:0.0:1746065078.167248:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a649c00 with x1830881261327488 ext(0->18446744073709551615) 00000100:00100000:1.0:1746065078.167251:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261327360 00002000:00010000:0.0:1746065078.167254:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a649c00. 00000100:00100000:0.0:1746065078.167263:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261327616 00000100:00100000:0.0:1746065078.167265:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261327616 00002000:00010000:0.0:1746065078.167271:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/840 (0->18446744073709551615) 00002000:00100000:0.0:1746065078.167273:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a64bb80 with x1830881261327616 ext(0->18446744073709551615) 00000100:00100000:1.0:1746065078.167277:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11914 00002000:00010000:0.0:1746065078.167277:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a64bb80. 00000100:00100000:1.0:1746065078.167282:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+268:27844:x1830881261327360:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065078.167289:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1239 00000100:00100000:0.0:1746065078.167294:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881261327488:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:1.0:1746065078.167297:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1240 00000100:00100000:1.0:1746065078.167301:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+81:2006:x1830881261327616:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065078.167386:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x348:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065078.167386:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.167388:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x348:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:0.0:1746065078.167389:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x349:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.167390:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x348:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065078.167390:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x349:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.167392:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x348:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:0.0:1746065078.167392:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x349:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.167394:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x348:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746065078.167394:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x349:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.167680:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+82:2006:x1830881261327616:12345-192.168.202.27@tcp:10:bash.0 Request processed in 377us (472us total) trans 21474839733 rc 0/0 00000100:00100000:0.0:1746065078.167680:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261327488:12345-192.168.202.27@tcp:10:bash.0 Request processed in 384us (498us total) trans 17179872457 rc 0/0 00000100:00100000:0.0:1746065078.167685:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1239 00000100:00100000:1.0:1746065078.167688:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1240 00002000:00010000:0.0:1746065078.167688:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/841 (0->18446744073709551615) 00002000:00100000:0.0:1746065078.167689:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a649c00 with x1830881261327488 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065078.167693:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a649c00. 00002000:00010000:1.0:1746065078.167703:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/840 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.167705:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a64bb80 with x1830881261327616 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.167709:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a64bb80. 00010000:00010000:1.0:1746065078.167730:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.167743:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488c00/0xad6b7ddc1460e63 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c22c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.167961:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488c00/0xad6b7ddc1460e63 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c22c expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.167971:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488c00/0xad6b7ddc1460e63 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x323:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c22c expref: 269 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.167983:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88012edbda00) 00010000:00010000:1.0:1746065078.167985:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065078.167988:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488c00, rc 0) 00000100:00100000:1.0:1746065078.168005:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+269:27844:x1830881261327360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 723us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.168010:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11914 00000100:00100000:0.0:1746065078.173836:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.174335:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.174537:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261327872 00000100:00100000:3.0:1746065078.174545:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261327872 00000100:00100000:2.0:1746065078.174579:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261328128 00000100:00100000:2.0:1746065078.174583:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261328128 00000100:00100000:3.0:1746065078.174598:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4100 00000100:00100000:2.0:1746065078.174604:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4101 00000100:00100000:3.0:1746065078.174605:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27844:x1830881261327872:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.174608:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261328128:12345-192.168.202.27@tcp:35:bash.0 00000004:00080000:3.0:1746065078.174769:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x323:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1746065078.174825:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261328128:12345-192.168.202.27@tcp:35:bash.0 Request processed in 215us (490us total) trans 4294975311 rc 0/0 00000100:00100000:2.0:1746065078.174831:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4101 00000040:00080000:3.0:1746065078.174835:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2348, 64 off194656 00000040:00080000:3.0:1746065078.175269:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2352, 64 off195112 00000040:00080000:3.0:1746065078.175282:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2353, 64 off195176 00000040:00080000:3.0:1746065078.175291:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2349, 64 off194720 00010000:00010000:3.0:1746065078.175323:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065078.175336:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.175345:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.175352:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.175357:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.175361:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.175384:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065078.175406:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.175412:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.175428:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.175432:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.175438:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.175449:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x323:0x0].0x0 (ffff88012edbda00) 00010000:00010000:1.0:1746065078.175451:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065078.175454:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 1/0,0 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.175459:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460e6a lrc: 0/0,0 mode: --/PW res: [0x240000403:0x323:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.175483:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.175484:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.175486:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065078.175627:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27844:x1830881261327872:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1021us (1799us total) trans 4294975312 rc 0/0 00000100:00100000:3.0:1746065078.175633:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4100 00000100:00100000:0.0:1746065078.182541:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.182744:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261328256 00000100:00100000:1.0:1746065078.182753:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261328256 00000100:00100000:1.0:1746065078.182825:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11915 00000100:00100000:1.0:1746065078.182833:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27847:x1830881261328256:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:1.0:1746065078.182858:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.182880:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc1460e71 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c233 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.182936:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.182946:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.182955:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.182964:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.182969:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.182973:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183039:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.183045:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183050:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065078.183081:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x325:0x0]: returning size 5 00000004:00200000:1.0:1746065078.183085:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065078.183098:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183106:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183113:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183117:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183122:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183127:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183132:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.183135:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183140:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183149:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd800) 00010000:00010000:1.0:1746065078.183151:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.183154:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183158:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488600/0xad6b7ddc1460e78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183766:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183839:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183844:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183849:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.183851:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183856:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183863:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd900) 00010000:00010000:1.0:1746065078.183865:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.183867:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183870:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1460e7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.183905:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc1460e71 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c233 expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.183917:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c233 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.183923:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:1.0:1746065078.183926:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065078.183928:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:1.0:1746065078.183975:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27847:x1830881261328256:12345-192.168.202.27@tcp:101:rm.0 Request processed in 1143us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.183981:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11915 00000100:00100000:0.0:1746065078.186970:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.187027:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261328768 00000100:00100000:1.0:1746065078.187036:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261328768 00000100:00100000:1.0:1746065078.187084:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11916 00000100:00100000:1.0:1746065078.187090:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27847:x1830881261328768:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065078.187135:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065078.187157:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1460e47 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c217 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.187174:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1460e86 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c233 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.187189:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460e24 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x325:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c209 expref: 270 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.187196:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff8800929fd100) 00010000:00010000:1.0:1746065078.187204:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.187222:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.187231:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.187238:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.187249:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.187254:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.187258:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.187320:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.187326:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.187331:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065078.187701:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.187942:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261328512 00000100:00100000:0.0:1746065078.187946:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261328512 00000100:00100000:0.0:1746065078.188148:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11917 00000100:00100000:0.0:1746065078.188154:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27848:x1830881261328512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.188163:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.188172:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460ea2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c23a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.188231:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.188239:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.188243:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 4/1,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x5/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.188256:0:7204:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.188263:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x5/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:1.0:1746065078.188680:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2354, 64 off195240 00000040:00080000:1.0:1746065078.188696:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2350, 64 off194784 00000040:00080000:1.0:1746065078.188703:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2351, 64 off194848 00000040:00080000:1.0:1746065078.188710:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2355, 64 off195304 00010000:00010000:1.0:1746065078.188745:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x325:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.188753:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188759:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188765:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188789:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188795:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188819:0:7203:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065078.188834:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188838:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188843:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188848:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.188850:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188856:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188864:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff88012edbd500) 00010000:00010000:1.0:1746065078.188866:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065078.188868:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x5/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.188874:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.188878:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.188894:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 2/0,0 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188898:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460e9b lrc: 0/0,0 mode: --/EX res: [0x240000403:0x325:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188910:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188915:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188919:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188923:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188926:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.188928:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188932:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188937:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd700) 00010000:00010000:1.0:1746065078.188939:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.188941:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188946:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460e8d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065078.188959:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800727a3480 reply state ffff88012ec8f000 transno 4294975313 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188966:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.188971:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:1.0:1746065078.188973:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065078.188975:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065078.189285:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065078.189291:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.189296:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065078.189299:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.189304:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.189311:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff88012edbd500) 00010000:00010000:2.0:1746065078.189313:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065078.189315:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.189319:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1460eb0 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x325:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.189346:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.189347:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.189348:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.189363:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189370:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065078.189380:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x325:0x0]: returning size 5 00010000:00010000:0.0:1746065078.189395:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189400:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189404:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189408:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.189410:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189415:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189421:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x325:0x0].0x0 (ffff88012edbd500) 00010000:00010000:0.0:1746065078.189424:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065078.189426:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.189433:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1460ea9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065078.189808:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27847:x1830881261328768:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1943us (2070us total) trans 4294975313 rc 0/0 00000100:00100000:1.0:1746065078.189818:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11916 00010000:00010000:3.0:1746065078.190115:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460ea2 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c23a expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.190124:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1460ea2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x325:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c23a expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.190135:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054c00, rc 0) 00000100:00100000:3.0:1746065078.190162:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27848:x1830881261328512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2008us (2462us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065078.190168:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11917 00000100:00100000:0.0:1746065078.192352:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.192446:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261329024 00000100:00100000:3.0:1746065078.192453:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261329024 00000100:00100000:3.0:1746065078.192489:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11918 00000100:00100000:3.0:1746065078.192495:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27848:x1830881261329024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.192512:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.192525:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460eb7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c241 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.192598:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.192608:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192616:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192623:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.192629:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192634:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192664:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192669:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192673:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192682:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192686:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.192688:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192694:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192702:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065078.192705:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.192708:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192716:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460ebe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192725:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192730:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192734:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192737:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.192739:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192743:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192752:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:3.0:1746065078.192754:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.192756:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192760:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ec5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.192805:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460eb7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c241 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.192811:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460eb7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c241 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.192821:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:3.0:1746065078.192869:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27848:x1830881261329024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 374us (524us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065078.192874:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11918 00000100:00100000:0.0:1746065078.196416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.196620:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261329152 00000100:00100000:2.0:1746065078.196627:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261329152 00000100:00100000:2.0:1746065078.196702:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11919 00000100:00100000:2.0:1746065078.196709:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27848:x1830881261329152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.196727:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.196743:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460ecc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c248 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.196823:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.196832:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196840:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196847:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.196852:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196856:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196888:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196928:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196932:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196937:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196941:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.196944:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196949:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196957:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:2.0:1746065078.196959:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.196962:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196966:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460ed3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196978:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196983:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196987:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196990:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.196993:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.196997:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.197002:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:2.0:1746065078.197004:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.197006:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.197014:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460eda lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.197036:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460ecc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c248 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.197042:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460ecc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c248 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.197051:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:2.0:1746065078.197104:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27848:x1830881261329152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 395us (694us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.197110:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11919 00000100:00100000:0.0:1746065078.205095:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.205872:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261329280 00000100:00100000:2.0:1746065078.205881:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261329280 00000100:00100000:2.0:1746065078.205937:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11920 00000100:00100000:2.0:1746065078.205945:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27849:x1830881261329280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.205964:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.205981:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460ee1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c24f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.206035:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.206046:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206055:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206066:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.206071:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206076:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206157:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206162:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206166:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206171:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206175:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.206178:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206184:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206193:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34800) 00010000:00010000:2.0:1746065078.206195:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.206198:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206202:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2800/0xad6b7ddc1460ee8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206224:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206229:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206232:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206235:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.206237:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206241:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206245:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:2.0:1746065078.206247:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.206249:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206252:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1460eef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.206277:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460ee1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c24f expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.206284:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460ee1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c24f expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.206294:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:2.0:1746065078.206347:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27849:x1830881261329280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 402us (1262us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.206353:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11920 00000100:00100000:2.0:1746065078.212260:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.212331:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261329408 00000100:00100000:0.0:1746065078.212340:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261329408 00000100:00100000:0.0:1746065078.212393:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11921 00000100:00100000:0.0:1746065078.212442:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27849:x1830881261329408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.212458:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.212475:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460ef6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c256 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.212589:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065078.212599:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212608:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212616:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065078.212621:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212626:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212669:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212674:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212678:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212683:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212687:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.212691:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212695:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212703:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561500) 00010000:00010000:0.0:1746065078.212706:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.212709:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212713:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1460efd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212736:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212741:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212746:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212750:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.212752:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212755:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212760:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:0.0:1746065078.212762:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.212764:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212768:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc1460f04 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.212809:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460ef6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c256 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.212816:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc1460ef6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c256 expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.212827:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055e00, rc 0) 00000100:00100000:0.0:1746065078.212880:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27849:x1830881261329408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 439us (627us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065078.212886:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11921 00000100:00100000:0.0:1746065078.216533:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.217691:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261329536 00000100:00100000:1.0:1746065078.217699:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261329536 00000100:00100000:1.0:1746065078.217747:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11922 00000100:00100000:1.0:1746065078.217753:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27849:x1830881261329536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.217770:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.217803:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460f0b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c25d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.217854:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460f12 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065078.217864:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460f12 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.217873:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460f12 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065078.217907:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065078.217911:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065078.217938:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1460f0b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c25d expref: 273 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.217959:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460f12 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c25d expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.217965:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd500) 00010000:00010000:1.0:1746065078.217968:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065078.217970:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489600, rc 0) 00000100:00100000:1.0:1746065078.218011:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27849:x1830881261329536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 257us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.218017:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11922 00000100:00100000:2.0:1746065078.218703:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.218800:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261329792 00000100:00100000:3.0:1746065078.218805:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261329792 00000100:00100000:3.0:1746065078.218829:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11923 00000100:00100000:3.0:1746065078.218835:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27850:x1830881261329792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.218843:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.218850:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460f19 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c264 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.218888:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.218898:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218905:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218912:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.218917:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218921:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218947:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218952:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218957:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218962:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218966:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.218970:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218975:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218982:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd500) 00010000:00010000:3.0:1746065078.218985:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.218987:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.218992:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1460f20 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219016:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219021:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219025:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219029:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.219031:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219035:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219041:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:3.0:1746065078.219043:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.219045:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219049:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f27 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.219066:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460f19 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c264 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.219075:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460f19 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c264 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.219082:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:3.0:1746065078.219106:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27850:x1830881261329792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 272us (405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065078.219111:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11923 00000100:00100000:0.0:1746065078.226513:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.226602:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261330048 00000100:00100000:2.0:1746065078.226610:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261330048 00000100:00100000:2.0:1746065078.226943:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11924 00000100:00100000:2.0:1746065078.226950:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27849:x1830881261330048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.226965:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.226967:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065078.226988:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1460f12 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c25d expref: 272 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.227005:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd500) 00010000:00010000:2.0:1746065078.227012:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.227022:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460f2e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c26b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.227107:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.227116:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227124:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227132:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.227138:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227143:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227386:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.227392:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227397:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.227403:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 0 00010000:00010000:2.0:1746065078.227420:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227425:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227429:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227434:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227438:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.227441:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227445:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227451:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:2.0:1746065078.227453:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.227455:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227459:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2400/0xad6b7ddc1460f35 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:2.0:1746065078.227465:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800727a0e00 reply state ffff88012f0ea000 transno 4294975314 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227471:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.227476:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:2.0:1746065078.227477:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.227479:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065078.227497:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1460f2e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.227508:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.227513:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff880097e34300) 00010000:00010000:2.0:1746065078.227514:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.227516:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2000, rc 0) 00000100:00100000:2.0:1746065078.227564:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27849:x1830881261330048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 615us (1059us total) trans 4294975314 rc 0/0 00000100:00100000:2.0:1746065078.227578:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11924 00000100:00100000:0.0:1746065078.231565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.231626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.231908:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261330304 00000100:00100000:3.0:1746065078.231915:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261330304 00000100:00100000:3.0:1746065078.232189:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261330560 00000100:00100000:3.0:1746065078.232192:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261330560 00000100:00100000:2.0:1746065078.232228:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11925 00000100:00100000:2.0:1746065078.232236:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27849:x1830881261330304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.232255:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.232270:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460f51 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c272 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.232350:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.232362:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.232367:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.232390:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.232400:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 276 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.232409:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131899f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262608384:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.232983:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11926 00000100:00100000:3.0:1746065078.232991:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27851:x1830881261330560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.232998:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.233004:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460f5f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c279 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.233041:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.233049:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233057:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065078.233066:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 0 00010000:00010000:3.0:1746065078.233116:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233122:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233126:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233130:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.233134:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233139:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233147:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff880097e34300) 00010000:00010000:3.0:1746065078.233150:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065078.233152:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.233156:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1460f66 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.234420:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460f5f lrc: 1/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c279 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.234429:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460f5f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c279 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.234438:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00000100:00100000:2.0:1746065078.234586:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065078.234830:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27851:x1830881261330560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1839us (3203us total) trans 4294975315 rc 301/301 00000100:00100000:3.0:1746065078.234836:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11926 00000100:00100000:0.0:1746065078.236978:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.237051:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261330688 00000100:00100000:3.0:1746065078.237059:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261330688 00010000:00010000:3.0:1746065078.237086:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 277 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.237108:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3537 00000100:00100000:3.0:1746065078.237113:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+277:2005:x1830881261330688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.237122:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.237127:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 277 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.237135:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 277 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.237191:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131899f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262608384:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.237209:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.237337:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc1460f43 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c26b expref: 277 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.237348:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff880097e34300) 00010000:00010000:3.0:1746065078.237352:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.237358:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.237363:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.237388:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.237422:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+276:2005:x1830881261330688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 308us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.237432:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3537 00010000:00010000:2.0:1746065078.237559:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237565:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.237596:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 0 00000004:00080000:2.0:1746065078.237721:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x34a:0x0], index 0: 0 00000004:00080000:2.0:1746065078.237726:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x34b:0x0], index 1: 0 00000004:00080000:2.0:1746065078.237729:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x34c:0x0], index 1: 0 00000004:00080000:2.0:1746065078.237732:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x34b:0x0], index 0: 0 00010000:00010000:2.0:1746065078.237842:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237849:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237853:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237858:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.237860:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237865:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237872:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff880097e34300) 00010000:00010000:2.0:1746065078.237874:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.237877:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237881:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1460f58 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.237916:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460f51 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c272 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.237922:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1460f51 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c272 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.237936:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:2.0:1746065078.237973:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27849:x1830881261330304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5737us (6414us total) trans 4294975316 rc 301/301 00000100:00100000:2.0:1746065078.237979:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11925 00000100:00100000:0.0:1746065078.240232:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.240324:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261330944 00000100:00100000:3.0:1746065078.240331:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261330944 00000100:00100000:3.0:1746065078.240373:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4102 00000100:00100000:3.0:1746065078.240379:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27849:x1830881261330944:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.240551:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27849:x1830881261330944:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 172us (325us total) trans 4294975317 rc 0/0 00000100:00100000:3.0:1746065078.240557:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4102 00000100:00100000:0.0:1746065078.242991:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.243330:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.243403:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261331200 00000100:00100000:2.0:1746065078.243409:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261331200 00000100:00100000:2.0:1746065078.243439:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4103 00000100:00100000:2.0:1746065078.243445:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27849:x1830881261331200:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.243613:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27849:x1830881261331200:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 167us (626us total) trans 4294975318 rc 0/0 00000100:00100000:2.0:1746065078.243619:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4103 00000100:00100000:3.0:1746065078.243678:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261331328 00000100:00100000:3.0:1746065078.243682:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261331328 00000100:00100000:3.0:1746065078.243716:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11927 00000100:00100000:3.0:1746065078.243721:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27851:x1830881261331328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.243729:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.243745:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460f7b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c280 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.243826:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f82 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.243836:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f82 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.243846:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f82 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.243866:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 0 00000004:00200000:3.0:1746065078.243870:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065078.243880:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f82 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.243898:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1460f7b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c280 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.243908:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f82 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c280 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.243913:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.243915:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.243918:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:3.0:1746065078.243936:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27851:x1830881261331328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 216us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.243940:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11927 00000100:00100000:0.0:1746065078.248403:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.250230:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261331456 00000100:00100000:0.0:1746065078.250232:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.250237:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261331456 00000100:00100000:2.0:1746065078.250265:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261331840 00000100:00100000:2.0:1746065078.250268:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261331840 00000100:00100000:2.0:1746065078.250312:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11928 00000100:00100000:2.0:1746065078.250319:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261331840:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.250339:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.250355:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8000/0xad6b7ddc1460f89 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c295 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.250455:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.250464:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250473:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250480:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.250486:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250490:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250522:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460f9e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.250527:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460f9e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250531:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460f9e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065078.250538:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 0 00010000:00010000:2.0:1746065078.250603:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250608:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250613:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250618:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250622:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.250626:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250635:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250643:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:2.0:1746065078.250645:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.250648:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250652:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460f90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250663:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250667:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250671:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250674:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d9000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.250676:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250679:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250684:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:2.0:1746065078.250685:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.250687:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250691:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460f97 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.250717:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8000/0xad6b7ddc1460f89 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c295 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.250728:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460f9e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c295 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.250734:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:2.0:1746065078.250735:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.250737:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8a00, rc 0) 00000100:00100000:2.0:1746065078.250800:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261331840:12345-192.168.202.27@tcp:101:bash.0 Request processed in 481us (572us total) trans 4294975319 rc 0/0 00000100:00100000:2.0:1746065078.250805:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11928 00000100:00100000:1.0:1746065078.251004:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8382 00000100:00100000:1.0:1746065078.251009:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881261331456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.251016:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.251025:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c287 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065078.251040:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.251049:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.251051:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.251055:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.251065:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.251075:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488200, rc 0) 00000100:00100000:1.0:1746065078.251091:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881261331456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 82us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.251096:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8382 00000100:00100000:0.0:1746065078.253588:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.253676:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261331584 00000100:00100000:3.0:1746065078.253683:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261331584 00000100:00100000:3.0:1746065078.253717:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8383 00000100:00100000:3.0:1746065078.253723:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+82:2005:x1830881261331584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.253739:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.253753:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c28e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065078.253789:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.253804:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.253805:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.253916:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.253931:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065078.253936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.253941:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d200, rc 0) 00000100:00100000:2.0:1746065078.253984:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261331968 00000100:00100000:2.0:1746065078.253988:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261331968 00000100:00100000:2.0:1746065078.254089:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11929 00000100:00100000:2.0:1746065078.254094:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261331968:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.254105:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.254114:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8400/0xad6b7ddc1460fba lrc: 2/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c29c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.254135:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1460fc1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.254143:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1460fc1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.254150:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1460fc1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065078.254167:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261331584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 443us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.254173:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8383 00000100:00100000:1.0:1746065078.254327:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.254491:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261332096 00000100:00100000:3.0:1746065078.254494:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261332096 00000100:00100000:3.0:1746065078.254515:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 542 00000100:00100000:3.0:1746065078.254519:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+282:2007:x1830881261332096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.254526:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.254538:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460f9e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c295 expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.254550:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.254553:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.254585:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+281:2007:x1830881261332096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.254590:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 542 00010000:00010000:2.0:1746065078.255305:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8400/0xad6b7ddc1460fba lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c29c expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.255318:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1460fc1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c29c expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.255324:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:2.0:1746065078.255326:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065078.255328:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00000100:00100000:2.0:1746065078.255354:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261331968:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1260us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.255359:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11929 00000100:00100000:0.0:1746065078.257496:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.257606:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261332352 00000100:00100000:2.0:1746065078.257612:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261332352 00000100:00100000:2.0:1746065078.257649:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4104 00000100:00100000:2.0:1746065078.257654:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27851:x1830881261332352:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.259518:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27851:x1830881261332352:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1856us (2021us total) trans 4294975320 rc 0/0 00000100:00100000:2.0:1746065078.259528:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4104 00000100:00100000:0.0:1746065078.259884:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.259922:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261332608 00000100:00100000:3.0:1746065078.259928:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261332608 00000100:00100000:3.0:1746065078.259954:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11930 00000100:00100000:3.0:1746065078.259959:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261332608:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065078.259990:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.260010:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1460f82 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c280 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.260029:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.260032:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.260154:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.260164:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.260171:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:3.0:1746065078.260196:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975321 00000004:00010000:3.0:1746065078.260210:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800727a0000 reply state ffff880097df6000 transno 4294975322 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.260217:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.260221:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.260223:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065078.260224:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065078.260278:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261332608:12345-192.168.202.27@tcp:36:bash.0 Request processed in 318us (395us total) trans 4294975322 rc 0/0 00000100:00100000:3.0:1746065078.260282:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11930 00000020:00080000:3.0:1746065078.260285:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065078.262408:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.262685:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.262730:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261332736 00000100:00100000:3.0:1746065078.262736:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261332736 00000100:00100000:2.0:1746065078.262753:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261332992 00000100:00100000:2.0:1746065078.262757:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261332992 00000100:00100000:3.0:1746065078.262769:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11931 00000100:00100000:3.0:1746065078.262795:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261332736:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:2.0:1746065078.262810:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11932 00000100:00100000:2.0:1746065078.262815:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27851:x1830881261332992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.262831:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.262846:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460fcf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2aa expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.262906:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.262916:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.262924:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.262931:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.262936:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.262941:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263014:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1460fe4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.263021:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1460fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263027:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1460fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065078.263034:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 0 00010000:00010000:2.0:1746065078.263090:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263096:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263104:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263109:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263113:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.263116:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263122:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263129:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34300) 00010000:00010000:2.0:1746065078.263132:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.263135:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263139:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8800/0xad6b7ddc1460fd6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263147:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263151:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263155:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263159:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.263161:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263168:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263174:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:2.0:1746065078.263176:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.263178:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263182:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8a00/0xad6b7ddc1460fdd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.263209:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d9000/0xad6b7ddc1460fcf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2aa expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.263223:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1460fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2aa expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.263228:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:2.0:1746065078.263230:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.263232:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25800, rc 0) 00000100:00100000:2.0:1746065078.263280:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27851:x1830881261332992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 464us (594us total) trans 4294975323 rc 0/0 00000100:00100000:2.0:1746065078.263286:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11932 00010000:00010000:3.0:1746065078.263375:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.263389:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ff2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2a3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.263414:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ff2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2a3 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.263422:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ff2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2a3 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.263433:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.263435:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065078.263437:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c800, rc 0) 00000100:00100000:3.0:1746065078.263557:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261332736:12345-192.168.202.27@tcp:101:bash.0 Request processed in 764us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.263563:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11931 00000100:00100000:0.0:1746065078.266949:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.268364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.268498:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261333248 00000100:00100000:2.0:1746065078.268506:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261333248 00000100:00100000:2.0:1746065078.268545:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4105 00000100:00100000:2.0:1746065078.268552:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27851:x1830881261333248:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.268707:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261333504 00000100:00100000:3.0:1746065078.268712:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261333504 00000100:00100000:2.0:1746065078.268737:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27851:x1830881261333248:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 185us (376us total) trans 4294975324 rc 0/0 00000100:00100000:3.0:1746065078.268738:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11933 00000100:00100000:3.0:1746065078.268743:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261333504:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:2.0:1746065078.268744:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4105 00010000:00010000:3.0:1746065078.268754:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.268756:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746065078.268802:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1460ff2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2a3 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.268821:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1460fe4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2aa expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.268830:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.268834:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.268843:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1460ff9 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2b1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.268878:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461000 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.268888:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461000 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.268896:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461000 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:3.0:1746065078.269260:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2352, 88 off194936 00000004:00080000:3.0:1746065078.269265:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674287490998ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065078.269299:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2356, 88 off195392 00000004:00080000:3.0:1746065078.269302:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674287528020ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065078.269326:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2357, 88 off195480 00000004:00080000:3.0:1746065078.269329:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674287555350ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065078.269338:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2353, 88 off195024 00000004:00080000:3.0:1746065078.269640:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674287866540ns, next at 674466981116ns, rc = 0 00000100:00100000:2.0:1746065078.272808:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.272880:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261333760 00000100:00100000:0.0:1746065078.272887:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261333760 00000100:00100000:0.0:1746065078.272927:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11934 00000100:00100000:0.0:1746065078.272934:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27851:x1830881261333760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.272959:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.272974:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1461007 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2b8 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.273036:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065078.273045:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.273054:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.273064:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065078.273074:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.273079:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065078.273454:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975325 is committed 00000004:00080000:2.0:1746065078.273461:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1583 committed 00000004:00080000:2.0:1746065078.273477:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1593 committed 00000004:00080000:2.0:1746065078.273483:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1592 committed 00000004:00080000:2.0:1746065078.273485:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1582 committed 00000100:00100000:2.0:1746065078.273592:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013189bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262608512:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.273629:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.273665:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262609024:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.273676:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.273691:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065078.273694:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262608896:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.273705:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.273719:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608768:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.273730:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.273739:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065078.273741:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608640:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.273750:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.273757:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262609152:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.273766:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.273802:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608512 00000100:00100000:2.0:1746065078.273805:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608512 00000100:00100000:2.0:1746065078.273822:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262609024 00000100:00100000:2.0:1746065078.273823:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262609024 00000100:00100000:2.0:1746065078.273830:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608896 00000100:00100000:2.0:1746065078.273832:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608896 00000100:00100000:2.0:1746065078.273838:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608768 00000100:00100000:2.0:1746065078.273839:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608768 00000100:00100000:2.0:1746065078.273845:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262608640 00000100:00100000:2.0:1746065078.273846:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262608640 00000100:00100000:2.0:1746065078.273851:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262609152 00000100:00100000:2.0:1746065078.273852:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262609152 00000100:00100000:2.0:1746065078.273858:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8384 00000100:00100000:2.0:1746065078.273862:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3760:x1830881262608512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065078.273875:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:839 count 1 00010000:00010000:2.0:1746065078.273889:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.273901:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.273907:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.273908:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.273911:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.273926:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.273934:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 25 pid: 10219 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.273942:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098664700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262609280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.273987:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.273999:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8385 00000100:00100000:2.0:1746065078.274003:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3760:x1830881262609024:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.274099:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262609024:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (421us total) trans 17179872458 rc 0/0 00000100:00100000:2.0:1746065078.274105:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8385 00000100:00100000:2.0:1746065078.274117:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8386 00000100:00100000:2.0:1746065078.274121:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3760:x1830881262608896:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065078.274129:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:842 count 1 00002000:00010000:2.0:1746065078.274143:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.274147:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274153:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.274154:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.274157:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274165:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274171:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274177:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274188:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065078.274279:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262608896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 158us (572us total) trans 17179872459 rc 0/0 00000100:00100000:2.0:1746065078.274284:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8386 00000100:00100000:2.0:1746065078.274292:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8387 00000100:00100000:2.0:1746065078.274295:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3762:x1830881262608768:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065078.274302:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:841 count 1 00010000:00010000:2.0:1746065078.274309:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274317:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274322:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.274323:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.274325:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274335:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274341:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 25 pid: 12258 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.274348:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262609408:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.274364:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.274374:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8388 00000100:00100000:2.0:1746065078.274378:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3762:x1830881262608640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065078.274385:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:840 count 1 00002000:00010000:2.0:1746065078.274394:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.274397:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274402:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.274403:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.274405:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274411:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274416:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274421:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274428:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065078.274486:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3762:x1830881262608640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 107us (734us total) trans 17179872460 rc 0/0 00000100:00100000:2.0:1746065078.274490:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8388 00000100:00100000:2.0:1746065078.274498:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8389 00000100:00100000:2.0:1746065078.274501:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3762:x1830881262609152:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065078.274531:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.274533:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.274535:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.274536:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.274538:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065078.274550:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+15:3762:x1830881262609152:12345-0@lo:2:osp-syn-1-1.0 Request processed in 49us (783us total) trans 17179872461 rc 0/0 00000100:00100000:2.0:1746065078.274555:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8389 00010000:00010000:2.0:1746065078.274568:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1746065078.274585:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274590:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065078.274593:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274599:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274609:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274614:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc1461023 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274623:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065078.274625:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274630:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fe00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065078.274632:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274641:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274648:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274653:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580fe00/0xad6b7ddc1461031 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.274661:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.274662:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.274664:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065078.274683:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098667100/2, rc 0, transno 17179872460 00000100:00100000:2.0:1746065078.274687:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608640:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065078.274694:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098666300/2, rc 0, transno 17179872461 00000100:00100000:2.0:1746065078.274696:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262609152:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065078.274708:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098665880/2, rc 0, transno 17179872459 00000100:00100000:2.0:1746065078.274710:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262608896:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065078.274716:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098665500/2, rc 0, transno 17179872458 00000100:00100000:2.0:1746065078.274719:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262609024:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065078.274815:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065078.274823:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274830:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065078.274838:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 2 00010000:00010000:0.0:1746065078.274888:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274893:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274898:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274901:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.274904:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274908:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274915:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:0.0:1746065078.274918:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065078.274921:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274925:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1461038 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274940:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274945:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274949:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274953:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274957:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.274959:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274963:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274968:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561600) 00010000:00010000:0.0:1746065078.274970:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.274971:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274976:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055400/0xad6b7ddc146100e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274982:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274987:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274991:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.274994:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.274996:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.275000:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.275005:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:0.0:1746065078.275006:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.275008:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.275012:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1461015 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.275041:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1461007 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2b8 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.275047:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1461007 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2b8 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.275056:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054c00, rc 0) 00000100:00100000:0.0:1746065078.275077:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27851:x1830881261333760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2145us (2278us total) trans 4294975326 rc 301/301 00000100:00100000:0.0:1746065078.275083:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11934 00010000:00010000:3.0:1746065078.275235:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275242:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275246:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275250:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.275252:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275256:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275263:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:3.0:1746065078.275264:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.275266:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275270:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1460e94 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.275279:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275282:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275286:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275289:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.275291:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275294:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275298:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd400) 00010000:00010000:3.0:1746065078.275300:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.275301:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275305:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1460f3c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.275317:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275321:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275324:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275327:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.275329:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275332:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275336:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.275338:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.275339:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275343:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1460fc8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.275374:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461000 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x327:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2b1 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.275379:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.275380:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065078.275386:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1460ff9 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2b1 expref: 271 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065078.275398:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461000 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x327:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2b1 expref: 270 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.275409:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.275410:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065078.275412:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51bc00, rc 0) 00000100:00100000:3.0:1746065078.275431:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261333504:12345-192.168.202.27@tcp:101:bash.0 Request processed in 6688us (8490us total) trans 4294975325 rc 0/0 00000100:00100000:3.0:1746065078.275436:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11933 00010000:00010000:1.0:1746065078.275601:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065078.275672:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262609664:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.275697:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.275710:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262610176:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.275722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.275732:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065078.275735:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262609792:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.275747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.275762:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262609664 00000100:00100000:1.0:1746065078.275766:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262609664 00000100:00100000:1.0:1746065078.275805:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262610176 00000100:00100000:1.0:1746065078.275808:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262610176 00000100:00100000:1.0:1746065078.275816:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262609792 00000100:00100000:1.0:1746065078.275818:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262609792 00000100:00100000:1.0:1746065078.275828:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8390 00000100:00100000:1.0:1746065078.275832:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+205:3759:x1830881262609664:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065078.275845:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:839 count 1 00002000:00010000:1.0:1746065078.275863:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.275866:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.275873:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.275875:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.275877:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.275884:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.275889:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.275894:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.275903:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065078.276007:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+206:3759:x1830881262609664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 174us (309us total) trans 21474839734 rc 0/0 00000100:00100000:1.0:1746065078.276012:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8390 00000100:00100000:1.0:1746065078.276022:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8391 00000100:00100000:1.0:1746065078.276026:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+205:3759:x1830881262610176:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065078.276068:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.276071:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.276072:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.276074:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.276075:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.276090:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+206:3759:x1830881262610176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 64us (367us total) trans 21474839735 rc 0/0 00000100:00100000:1.0:1746065078.276095:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8391 00000100:00100000:1.0:1746065078.276103:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8392 00000100:00100000:1.0:1746065078.276107:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+205:3759:x1830881262609792:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065078.276115:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:840 count 1 00010000:00010000:1.0:1746065078.276122:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276132:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 82 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276136:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.276137:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.276139:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276155:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 82 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276164:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 82 pid: 12258 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.276172:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262610304:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.276199:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065078.276208:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.276212:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276221:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.276224:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276230:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276239:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276244:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1461046 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.276253:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.276254:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.276255:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065078.276274:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c529500/2, rc 0, transno 21474839734 00000100:00100000:1.0:1746065078.276278:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262609664:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065078.276284:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52ad80/2, rc 0, transno 21474839735 00000100:00100000:1.0:1746065078.276286:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262610176:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.276500:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262609920:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.276522:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.276550:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065078.276555:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262609536:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.276580:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.276591:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262610048:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.276603:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.276619:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262609920 00000100:00100000:3.0:1746065078.276622:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262609920 00000100:00100000:3.0:1746065078.276635:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262609536 00000100:00100000:3.0:1746065078.276637:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262609536 00000100:00100000:3.0:1746065078.276641:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262610048 00000100:00100000:3.0:1746065078.276643:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262610048 00000100:00100000:3.0:1746065078.276649:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8393 00000100:00100000:3.0:1746065078.276654:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+208:3761:x1830881262609920:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065078.276663:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:841 count 1 00002000:00010000:3.0:1746065078.276675:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.276680:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.276686:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.276687:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.276689:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.276696:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.276702:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.276708:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.276717:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065078.276814:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+209:3761:x1830881262609920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 159us (291us total) trans 21474839736 rc 0/0 00000100:00100000:3.0:1746065078.276819:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8393 00000100:00100000:3.0:1746065078.276829:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8394 00000100:00100000:3.0:1746065078.276833:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+208:3761:x1830881262609536:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065078.276841:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:838 count 1 00010000:00010000:3.0:1746065078.276849:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.276857:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 82 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.276872:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.276874:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.276876:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.277016:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8395 00000100:00100000:0.0:1746065078.277023:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+208:3761:x1830881262610048:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.277082:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+209:3761:x1830881262610048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 60us (478us total) trans 21474839737 rc 0/0 00000100:00100000:0.0:1746065078.277086:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8395 00010000:00010000:3.0:1746065078.277140:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 82 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.277148:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 82 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746065078.277155:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262610432:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.277186:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065078.277194:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065078.277197:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.277203:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.277205:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.277210:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.277219:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.277228:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1461054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.277236:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.277238:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.277239:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065078.277257:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52a300/2, rc 0, transno 21474839737 00000100:00100000:3.0:1746065078.277261:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262610048:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065078.277267:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52b480/2, rc 0, transno 21474839736 00000100:00100000:3.0:1746065078.277270:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262609920:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.279809:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262609408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.279827:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.279859:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.279872:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.279913:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.279976:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334016 00000100:00100000:3.0:1746065078.279982:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334016 00010000:00010000:3.0:1746065078.280005:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 26 pid: 12258 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.280024:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261333888 00000100:00100000:3.0:1746065078.280026:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261333888 00010000:00010000:3.0:1746065078.280035:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 27 pid: 10219 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.280048:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3538 00000100:00100000:3.0:1746065078.280054:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261334016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.280063:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.280066:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 27 pid: 12258 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.280079:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 27 pid: 12258 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.280097:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc1460e55 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c21e expref: 27 pid: 12258 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.280108:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.280110:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.280113:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280120:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280135:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.280166:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261334016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.280172:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3538 00000100:00100000:3.0:1746065078.280185:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3539 00000100:00100000:3.0:1746065078.280189:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261333888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.280195:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.280198:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 25 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.280205:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 25 pid: 10219 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.280218:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.280219:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.280221:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280227:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280234:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.280246:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261333888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.280250:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3539 00010000:00010000:3.0:1746065078.280271:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835cc00/0xad6b7ddc1460ce2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1a0 expref: 24 pid: 10219 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.280278:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098664700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262609280:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.280288:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280294:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280299:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280307:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280314:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280325:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065078.280484:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262608512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6621us (6854us total) trans 17179872462 rc 0/0 00000100:00100000:3.0:1746065078.280491:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8384 00010000:00010000:3.0:1746065078.280508:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065078.280512:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280518:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.280521:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280526:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280535:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280540:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8400/0xad6b7ddc146101c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.280554:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.280555:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.280557:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065078.280588:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013189bb80/2, rc 0, transno 17179872462 00000100:00100000:3.0:1746065078.280592:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013189bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262608512:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.280805:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334272 00000100:00100000:0.0:1746065078.280810:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334272 00000100:00100000:0.0:1746065078.280834:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4106 00000100:00100000:0.0:1746065078.280839:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27851:x1830881261334272:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065078.280948:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27851:x1830881261334272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 108us (1034us total) trans 4294975327 rc 0/0 00000100:00100000:0.0:1746065078.280954:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4106 00010000:00010000:2.0:1746065078.281391:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.281520:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.281527:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.281533:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.281555:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065078.281620:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.281626:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.281634:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9ce00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.281637:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.281644:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.281655:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.281660:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146102a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.281672:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3762:x1830881262608768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7375us (7939us total) trans 17179872463 rc 0/0 00010000:00010000:1.0:1746065078.281672:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.281673:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.281674:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065078.281679:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8387 00000004:00080000:0.0:1746065078.282314:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098665f80/2, rc 0, transno 17179872463 00000100:00100000:0.0:1746065078.282319:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262608768:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.283871:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.283997:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334400 00000100:00100000:2.0:1746065078.284002:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334400 00000100:00100000:2.0:1746065078.284031:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8396 00000100:00100000:2.0:1746065078.284037:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+83:26180:x1830881261334400:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.284050:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.284066:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2bf expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.284090:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.284106:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.284107:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.284114:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 84 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.284127:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 84 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.284136:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9dc00, rc 0) 00000100:00100000:2.0:1746065078.284177:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+84:26180:x1830881261334400:12345-192.168.202.27@tcp:101:bash.0 Request processed in 141us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.284182:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8396 00000100:00100000:3.0:1746065078.284385:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262610432:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.284402:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.285917:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.286036:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262610304:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.286053:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.286141:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334528 00000100:00100000:2.0:1746065078.286146:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334528 00010000:00010000:2.0:1746065078.286169:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 84 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746065078.286326:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3540 00000100:00100000:2.0:1746065078.286333:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+84:2005:x1830881261334528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.286344:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.286348:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 84 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746065078.286811:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 84 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746065078.286834:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1460df3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x346:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c1fb expref: 84 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746065078.286845:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.286846:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.286850:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.286857:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.286889:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.286934:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261334528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 602us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.286941:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3540 00010000:00010000:3.0:1746065078.287135:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.287140:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.287144:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287151:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287156:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.287171:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334656 00000100:00100000:1.0:1746065078.287175:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334656 00010000:00010000:3.0:1746065078.287176:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065078.287191:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 83 pid: 12258 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.287207:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3541 00000100:00100000:1.0:1746065078.287212:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+83:2006:x1830881261334656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.287219:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.287222:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 83 pid: 12258 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.287230:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 83 pid: 12258 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.287240:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131054a00/0xad6b7ddc1460e5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c225 expref: 83 pid: 12258 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.287248:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.287249:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.287252:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.287257:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.287282:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.287303:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+82:2006:x1830881261334656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.287309:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3541 00010000:00010000:0.0:1746065078.287357:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.287376:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+209:3761:x1830881262609536:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10542us (10805us total) trans 21474839738 rc 0/0 00010000:00010000:2.0:1746065078.287379:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1746065078.287384:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8394 00010000:00010000:2.0:1746065078.287384:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.287389:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ba00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065078.287392:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.287400:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065078.287413:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528700/2, rc 0, transno 21474839738 00010000:00010000:2.0:1746065078.287414:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.287417:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262609536:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065078.287420:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51ba00/0xad6b7ddc146105b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.287434:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.287435:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.287437:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.287471:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.287477:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.287483:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.287703:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065078.287851:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065078.287856:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287863:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.287865:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287871:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287879:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287884:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc146104d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.287897:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.287899:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.287900:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065078.287956:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.288149:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+209:3759:x1830881262609792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12038us (12398us total) trans 21474839739 rc 0/0 00000100:00100000:0.0:1746065078.288155:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8392 00000100:00100000:0.0:1746065078.288167:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334784 00000100:00100000:0.0:1746065078.288170:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334784 00000100:00100000:0.0:1746065078.288189:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8397 00000100:00100000:0.0:1746065078.288194:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:26180:x1830881261334784:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065078.288205:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.288216:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2c6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065078.288233:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065078.288244:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.288245:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.288251:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 25 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.288261:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 25 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.288268:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2400, rc 0) 00000100:00100000:0.0:1746065078.288284:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+25:26180:x1830881261334784:12345-192.168.202.27@tcp:101:bash.0 Request processed in 90us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.288289:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8397 00000004:00080000:1.0:1746065078.288413:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52aa00/2, rc 0, transno 21474839739 00000100:00100000:1.0:1746065078.288418:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262609792:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.288700:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.289804:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261334912 00000100:00100000:3.0:1746065078.289809:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261334912 00000100:00100000:3.0:1746065078.289976:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4107 00000100:00100000:3.0:1746065078.289983:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27851:x1830881261334912:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065078.290107:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27851:x1830881261334912:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 123us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.290112:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4107 00000100:00100000:0.0:1746065078.290362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.290397:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.290552:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261335040 00000100:00100000:1.0:1746065078.290557:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261335040 00002000:00010000:1.0:1746065078.290584:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/842 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.290588:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53ed80 with x1830881261335040 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.290595:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53ed80. 00000100:00100000:1.0:1746065078.290607:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261335168 00000100:00100000:1.0:1746065078.290610:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261335168 00002000:00010000:1.0:1746065078.290618:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/843 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.290619:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53ea00 with x1830881261335168 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.290624:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53ea00. 00000100:00100000:1.0:1746065078.290644:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1241 00000100:00100000:1.0:1746065078.290649:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+82:2004:x1830881261335040:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065078.290769:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.290795:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34a:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.290797:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.290799:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34a:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.290801:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.290823:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+83:2004:x1830881261335040:12345-192.168.202.27@tcp:10:bash.0 Request processed in 173us (461us total) trans 21474839740 rc 0/0 00000100:00100000:1.0:1746065078.290828:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1241 00002000:00010000:1.0:1746065078.290831:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/842 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.290832:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53ed80 with x1830881261335040 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.290835:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53ed80. 00000100:00100000:1.0:1746065078.290846:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1242 00000100:00100000:1.0:1746065078.290850:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261335168:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065078.290917:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.290919:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34b:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.290921:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.290922:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34b:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.290924:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.290939:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881261335168:12345-192.168.202.27@tcp:10:bash.0 Request processed in 88us (542us total) trans 17179872464 rc 0/0 00000100:00100000:1.0:1746065078.290946:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1242 00002000:00010000:1.0:1746065078.290948:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/843 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.290950:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53ea00 with x1830881261335168 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.290953:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53ea00. 00000100:00100000:0.0:1746065078.294310:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.294385:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261335424 00000100:00100000:2.0:1746065078.294393:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261335424 00000100:00100000:2.0:1746065078.294877:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4108 00000100:00100000:2.0:1746065078.294884:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261335424:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065078.295098:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261335424:12345-192.168.202.27@tcp:35:bash.0 Request processed in 215us (796us total) trans 4294975328 rc 0/0 00000100:00100000:2.0:1746065078.295104:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4108 00000100:00100000:0.0:1746065078.299172:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.299531:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261335680 00000100:00100000:3.0:1746065078.299540:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261335680 00000100:00100000:3.0:1746065078.299620:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11935 00000100:00100000:3.0:1746065078.299627:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27852:x1830881261335680:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.299643:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.299659:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1461070 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2cd expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.299723:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.299732:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.299740:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.299748:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.299752:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.299756:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300161:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461085 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.300168:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461085 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300173:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461085 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.300181:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 5 00010000:00010000:3.0:1746065078.300245:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300252:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300257:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300262:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300266:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.300270:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300275:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300283:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.300286:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.300289:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300294:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc1461077 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300587:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300592:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300596:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300599:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.300602:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300606:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300612:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:3.0:1746065078.300614:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.300616:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300619:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146107e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.300652:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc1461070 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2cd expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.300663:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461085 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2cd expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.300667:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.300669:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.300671:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ba00, rc 0) 00000100:00100000:3.0:1746065078.301680:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27852:x1830881261335680:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2049us (2511us total) trans 4294975329 rc 0/0 00000100:00100000:3.0:1746065078.301688:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11935 00000100:00100000:0.0:1746065078.311031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.311078:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.311235:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261335936 00000100:00100000:3.0:1746065078.311244:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261335936 00000100:00100000:3.0:1746065078.311294:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336064 00000100:00100000:3.0:1746065078.311296:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336064 00000100:00100000:3.0:1746065078.311313:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11936 00000100:00100000:3.0:1746065078.311319:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27853:x1830881261335936:12345-192.168.202.27@tcp:36:rm.0 00000100:00100000:2.0:1746065078.311357:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11937 00000100:00100000:2.0:1746065078.311363:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27852:x1830881261336064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.311367:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065078.311371:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.311384:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc1461093 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2d4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311387:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461000 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2b1 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311404:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461085 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2cd expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311413:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1460fc1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c29c expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311422:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.311425:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.311438:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.311441:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.311447:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.311447:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.311454:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.311454:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.311463:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.311466:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.311470:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.311475:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x327:0x0]: returning size 5 00000004:00200000:2.0:1746065078.311478:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065078.311489:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.311505:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc1461093 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x327:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.311519:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311524:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.311525:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:2.0:1746065078.311527:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.311529:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25c00, rc 0) 00010000:00010000:3.0:1746065078.311531:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311536:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 4/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.311561:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.311582:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 273 pid: 7204 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.311592:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262610560:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.311595:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27852:x1830881261336064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 232us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.311600:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11937 00000100:00100000:3.0:1746065078.311644:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.315769:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.315907:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262610560:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.315929:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065078.316069:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336320 00000100:00100000:3.0:1746065078.316264:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336320 00000100:00100000:3.0:1746065078.316314:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4109 00000100:00100000:3.0:1746065078.316320:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27852:x1830881261336320:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.316966:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27852:x1830881261336320:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 644us (1204us total) trans 4294975330 rc 0/0 00000100:00100000:3.0:1746065078.316972:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4109 00000100:00100000:0.0:1746065078.318602:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.318732:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336448 00000100:00100000:3.0:1746065078.318739:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336448 00010000:00010000:3.0:1746065078.318767:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 274 pid: 7204 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.320054:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3542 00000100:00100000:3.0:1746065078.320066:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261336448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.320079:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.320086:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 274 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.320097:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 274 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.320115:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14610a1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x327:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2d4 expref: 274 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.320129:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065078.320133:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.320140:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.320146:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.320496:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.320801:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.320807:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065078.321030:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2354, 64 off195088 00000040:00080000:2.0:1746065078.321048:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2358, 64 off195544 00000040:00080000:2.0:1746065078.321056:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2359, 64 off195608 00000040:00080000:2.0:1746065078.321063:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2355, 64 off195152 00010000:00010000:2.0:1746065078.321104:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x327:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.321116:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321122:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321128:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321132:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321137:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321159:0:7205:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065078.321176:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321180:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321185:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321191:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.321195:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321200:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321207:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:2.0:1746065078.321210:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065078.321213:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 2/0,0 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.321217:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14610af lrc: 0/0,0 mode: --/EX res: [0x240000403:0x327:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065078.321264:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261336448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1200us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.321271:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3542 00010000:00010000:1.0:1746065078.321323:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.321328:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.321333:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51bc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.321336:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.321340:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.321347:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x327:0x0].0x0 (ffff8800929fd100) 00010000:00010000:1.0:1746065078.321350:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065078.321352:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.321356:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610b6 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x327:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.321371:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.321373:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.321374:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.322163:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322171:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322175:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322180:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322188:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.322191:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322196:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322204:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:2.0:1746065078.322206:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.322208:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322212:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc146109a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:2.0:1746065078.322222:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c53df80 reply state ffff880097df2000 transno 4294975331 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322234:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.322238:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:2.0:1746065078.322240:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.322243:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065078.322500:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27853:x1830881261335936:12345-192.168.202.27@tcp:36:rm.0 Request processed in 11178us (11475us total) trans 4294975331 rc 0/0 00000100:00100000:2.0:1746065078.322505:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11936 00000100:00100000:0.0:1746065078.326016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.326117:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336576 00000100:00100000:2.0:1746065078.326126:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336576 00000100:00100000:2.0:1746065078.326599:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11938 00000100:00100000:2.0:1746065078.326606:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27852:x1830881261336576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.326626:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.326641:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14610bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2db expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.326694:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.326704:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326714:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326722:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.326727:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326732:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326769:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326804:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326809:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326813:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326818:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.326821:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326827:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326836:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009867e300) 00010000:00010000:2.0:1746065078.326838:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.326841:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326844:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326852:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326856:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326860:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326863:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.326864:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326868:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326873:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:2.0:1746065078.326875:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.326877:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326880:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610cb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.326903:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14610bd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2db expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.326909:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14610bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2db expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.326919:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51be00, rc 0) 00000100:00100000:2.0:1746065078.326965:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27852:x1830881261336576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 360us (956us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.326971:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11938 00000100:00100000:0.0:1746065078.332362:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.332433:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336704 00000100:00100000:1.0:1746065078.332441:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336704 00000100:00100000:1.0:1746065078.332488:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11939 00000100:00100000:1.0:1746065078.332495:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27854:x1830881261336704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.332513:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.332530:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc14610d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2e2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.332594:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.332604:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332613:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332621:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.332627:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332632:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332665:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332671:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332676:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332681:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332686:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.332689:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332695:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332704:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd600) 00010000:00010000:1.0:1746065078.332706:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.332710:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332715:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc14610d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332726:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332731:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332735:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332738:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.332741:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332745:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332750:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:1.0:1746065078.332752:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.332755:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332762:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14610e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.332807:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc14610d2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2e2 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.332814:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc14610d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2e2 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.332823:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:1.0:1746065078.332864:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27854:x1830881261336704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 369us (513us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.332870:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11939 00000100:00100000:0.0:1746065078.335363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.335482:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336832 00000100:00100000:2.0:1746065078.335489:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336832 00000100:00100000:2.0:1746065078.335543:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11940 00000100:00100000:2.0:1746065078.335549:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27854:x1830881261336832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.335566:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.335593:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2e9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.335750:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.335760:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335769:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335806:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.335812:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335816:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335845:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335850:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335854:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335859:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335864:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.335866:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335871:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335879:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009867e300) 00010000:00010000:2.0:1746065078.335882:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.335885:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335889:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc14610ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335905:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335909:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335913:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335916:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.335918:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335922:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335928:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:2.0:1746065078.335930:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.335933:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335937:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ac00/0xad6b7ddc14610f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.335962:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2e9 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.335968:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc14610e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2e9 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.335979:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b200, rc 0) 00000100:00100000:2.0:1746065078.336523:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27854:x1830881261336832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 973us (1167us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.336529:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11940 00000100:00100000:0.0:1746065078.339809:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.339976:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261336960 00000100:00100000:3.0:1746065078.339984:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261336960 00000100:00100000:3.0:1746065078.340030:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11941 00000100:00100000:3.0:1746065078.340037:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27854:x1830881261336960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.340052:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.340069:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc14610fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2f0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.340118:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.340195:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461103 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.340205:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.340213:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461103 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.340251:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065078.340255:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1746065078.340280:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261337216 00010000:00010000:3.0:1746065078.340282:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc14610fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2f0 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.340284:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261337216 00000100:00100000:1.0:1746065078.340311:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11942 00000100:00100000:1.0:1746065078.340316:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27855:x1830881261337216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.340323:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.340329:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146110a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2f7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.340365:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.340372:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340377:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340387:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.340392:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340397:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340426:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.340429:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461103 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2f0 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.340432:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340436:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.340505:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:1.0:1746065078.340505:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.340507:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065078.340510:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00010000:00010000:1.0:1746065078.340511:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.340514:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340519:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340526:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:1.0:1746065078.340528:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.340530:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340534:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1461111 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065078.340546:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27854:x1830881261336960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 510us (774us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065078.340547:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340551:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065078.340552:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11941 00010000:00010000:1.0:1746065078.340555:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340559:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.340561:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340565:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340583:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:1.0:1746065078.340585:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.340587:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340592:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461118 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.340610:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146110a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2f7 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.340617:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146110a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2f7 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.340623:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:1.0:1746065078.340644:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27855:x1830881261337216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 328us (526us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.340649:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11942 00000100:00100000:2.0:1746065078.343928:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.344137:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261337472 00000100:00100000:1.0:1746065078.344144:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261337472 00000100:00100000:1.0:1746065078.344677:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11943 00000100:00100000:1.0:1746065078.344684:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27854:x1830881261337472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.344700:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.344703:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065078.344725:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461103 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2f0 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.344740:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:1.0:1746065078.344747:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.344756:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc146111f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c2fe expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.344862:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.344872:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.344879:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.344888:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.344894:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.344898:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345168:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065078.345175:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345181:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065078.345189:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00010000:00010000:1.0:1746065078.345208:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345214:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345219:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345224:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345228:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.345231:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345236:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345243:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbdc00) 00010000:00010000:1.0:1746065078.345245:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.345247:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345256:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc1461126 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065078.345266:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ef24380 reply state ffff8800b19ec000 transno 4294975332 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345273:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.345278:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:1.0:1746065078.345279:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065078.345281:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065078.345299:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc146111f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.345311:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.345316:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff88012edbdf00) 00010000:00010000:1.0:1746065078.345319:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065078.345320:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d400, rc 0) 00000100:00100000:1.0:1746065078.345363:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27854:x1830881261337472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 680us (1442us total) trans 4294975332 rc 0/0 00000100:00100000:1.0:1746065078.345368:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11943 00000100:00100000:0.0:1746065078.357564:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.357616:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.357691:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261337728 00000100:00100000:3.0:1746065078.357698:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261337728 00000100:00100000:3.0:1746065078.357730:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261337984 00000100:00100000:3.0:1746065078.357732:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261337984 00000100:00100000:3.0:1746065078.357756:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11944 00000100:00100000:3.0:1746065078.357762:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27854:x1830881261337728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.357814:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.357830:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461142 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c305 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.357918:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.357929:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.357936:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.357959:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.357969:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 279 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.357979:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262610688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.358050:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065078.358076:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11945 00000100:00100000:3.0:1746065078.358081:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27856:x1830881261337984:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.358090:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.358095:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc1461150 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c30c expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.358126:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.358133:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358142:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065078.358150:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00010000:00010000:3.0:1746065078.358209:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358216:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358221:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358225:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.358229:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358234:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358242:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff88012edbdf00) 00010000:00010000:3.0:1746065078.358245:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065078.358247:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358252:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461157 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.358293:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc1461150 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c30c expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.358298:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc1461150 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c30c expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.358304:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4c00, rc 0) 00000100:00100000:3.0:1746065078.358323:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27856:x1830881261337984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 242us (707us total) trans 4294975333 rc 301/301 00000100:00100000:3.0:1746065078.358329:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11945 00000100:00100000:0.0:1746065078.363501:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.363596:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261338112 00000100:00100000:2.0:1746065078.363609:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261338112 00010000:00010000:2.0:1746065078.363639:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 280 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.363678:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3543 00000100:00100000:2.0:1746065078.363685:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+280:2007:x1830881261338112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.363699:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.363704:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 280 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.363717:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 280 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.363738:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff88012edbdf00) 00010000:00010000:2.0:1746065078.363743:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.363750:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.363756:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.363769:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.363836:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+280:2007:x1830881261338112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 151us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.363842:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3543 00010000:00010000:3.0:1746065078.364019:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461134 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2fe expref: 279 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.364033:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262610688:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.364047:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364054:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364058:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.364077:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00000004:00080000:3.0:1746065078.364198:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x34d:0x0], index 1: 0 00000004:00080000:3.0:1746065078.364202:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x34c:0x0], index 0: 0 00000004:00080000:3.0:1746065078.364206:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x34d:0x0], index 0: 0 00000004:00080000:3.0:1746065078.364208:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x34e:0x0], index 1: 0 00010000:00010000:3.0:1746065078.364278:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364283:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364288:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364292:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.364295:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364300:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364306:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff88012edbdf00) 00010000:00010000:3.0:1746065078.364308:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065078.364310:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364313:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5000/0xad6b7ddc1461149 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.364348:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461142 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c305 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.364353:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc1461142 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c305 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.364363:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000100:00100000:3.0:1746065078.364387:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27854:x1830881261337728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6625us (6830us total) trans 4294975334 rc 301/301 00000100:00100000:3.0:1746065078.364392:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11944 00000100:00100000:2.0:1746065078.370959:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.371109:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261338368 00000100:00100000:3.0:1746065078.371117:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261338368 00000100:00100000:3.0:1746065078.371150:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4110 00000100:00100000:3.0:1746065078.371156:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27854:x1830881261338368:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.371345:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27854:x1830881261338368:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 188us (392us total) trans 4294975335 rc 0/0 00000100:00100000:3.0:1746065078.371351:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4110 00000100:00100000:0.0:1746065078.378397:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.378495:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261338624 00000100:00100000:2.0:1746065078.378502:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261338624 00000100:00100000:2.0:1746065078.378545:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4111 00000100:00100000:2.0:1746065078.378551:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27854:x1830881261338624:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.378721:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27854:x1830881261338624:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 170us (331us total) trans 4294975336 rc 0/0 00000100:00100000:2.0:1746065078.378727:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4111 00000100:00100000:0.0:1746065078.380284:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.380465:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261338752 00000100:00100000:3.0:1746065078.380470:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261338752 00000100:00100000:3.0:1746065078.380502:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11946 00000100:00100000:3.0:1746065078.380508:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27856:x1830881261338752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.380521:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.380541:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc146116c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c313 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.380612:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461173 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.380623:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461173 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.380633:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461173 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.380654:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00000004:00200000:3.0:1746065078.380657:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065078.380668:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461173 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.380687:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc146116c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c313 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.380715:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461173 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c313 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.380722:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.380725:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.380727:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4400, rc 0) 00000100:00100000:3.0:1746065078.381421:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27856:x1830881261338752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 912us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.381427:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11946 00000100:00100000:0.0:1746065078.388879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.388922:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.388942:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.389058:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261339136 00000100:00100000:1.0:1746065078.389066:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261339136 00000100:00100000:2.0:1746065078.389083:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261339264 00000100:00100000:2.0:1746065078.389086:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261339264 00000100:00100000:1.0:1746065078.389099:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8398 00000100:00100000:2.0:1746065078.389130:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8399 00000100:00100000:2.0:1746065078.389135:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881261339264:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065078.389138:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261339008 00000100:00100000:3.0:1746065078.389141:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261339008 00010000:00010000:2.0:1746065078.389151:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065078.389163:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11947 00000100:00100000:3.0:1746065078.389166:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261339008:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.389168:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c328 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.389176:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.389185:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc1461181 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c31a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.389187:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.389201:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.389202:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.389207:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.389218:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.389226:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51bc00, rc 0) 00000100:00100000:2.0:1746065078.389263:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261339264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.389268:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8399 00010000:00010000:3.0:1746065078.389276:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.389285:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389292:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389299:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.389304:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389309:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389345:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1461196 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.389352:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1461196 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389357:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1461196 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065078.389399:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261339136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.389408:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.389418:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c321 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065078.389428:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.389436:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.389437:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.389441:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 84 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.389449:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 84 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.389455:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:1.0:1746065078.389474:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+84:2005:x1830881261339136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 369us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.389478:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8398 00000004:00200000:3.0:1746065078.389918:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00010000:00010000:3.0:1746065078.389981:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389987:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389992:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.389997:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390002:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.390005:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390014:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390022:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973100) 00010000:00010000:3.0:1746065078.390025:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.390027:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390032:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1461188 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390056:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390062:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390066:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390069:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.390071:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390076:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390082:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:3.0:1746065078.390084:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.390086:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390089:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc146118f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.390119:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc1461181 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c31a expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.390132:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1461196 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c31a expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.390137:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.390139:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.390140:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:3.0:1746065078.390161:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261339008:12345-192.168.202.27@tcp:101:bash.0 Request processed in 993us (1290us total) trans 4294975337 rc 0/0 00000100:00100000:3.0:1746065078.390166:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11947 00000100:00100000:0.0:1746065078.393033:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.393364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.393409:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.393510:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261339776 00000100:00100000:2.0:1746065078.393517:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261339776 00000100:00100000:2.0:1746065078.393555:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4112 00000100:00100000:2.0:1746065078.393561:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27856:x1830881261339776:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.393736:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27856:x1830881261339776:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 174us (326us total) trans 4294975338 rc 0/0 00000100:00100000:2.0:1746065078.393742:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4112 00000100:00100000:3.0:1746065078.394267:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261339520 00000100:00100000:3.0:1746065078.394271:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261339520 00000100:00100000:3.0:1746065078.394294:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11948 00000100:00100000:3.0:1746065078.394300:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261339520:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.394309:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.394322:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14611ab lrc: 2/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c32f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.394349:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14611b2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.394360:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14611b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.394369:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14611b2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065078.394498:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261339392 00000100:00100000:1.0:1746065078.394503:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261339392 00000100:00100000:1.0:1746065078.394527:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 543 00000100:00100000:1.0:1746065078.394531:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+286:2006:x1830881261339392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.394538:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.394551:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5c00/0xad6b7ddc1461196 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c31a expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.394577:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:1.0:1746065078.394581:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.394603:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+285:2006:x1830881261339392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.394610:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 543 00010000:00010000:3.0:1746065078.395066:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14611ab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c32f expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.395077:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14611b2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c32f expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.395083:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.395086:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065078.395088:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000100:00100000:3.0:1746065078.395435:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261339520:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1133us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.395440:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11948 00000100:00100000:1.0:1746065078.401287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.401315:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.401479:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261340288 00000100:00100000:3.0:1746065078.401487:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261340288 00000100:00100000:3.0:1746065078.401524:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261340032 00000100:00100000:3.0:1746065078.401526:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261340032 00000100:00100000:3.0:1746065078.401549:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11949 00000100:00100000:3.0:1746065078.401556:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261340288:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065078.401613:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.401634:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1461173 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c313 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.401649:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.401653:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.401695:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11950 00000100:00100000:2.0:1746065078.401703:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27856:x1830881261340032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.401712:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.401723:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14611b9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c336 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.401824:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.401834:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.401842:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.402435:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14611c7 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.402446:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14611c7 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x329:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.402452:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14611c7 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x329:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065078.402460:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00000001:00080000:3.0:1746065078.402462:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975339 00000004:00010000:3.0:1746065078.402481:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925cb480 reply state ffff880097df3000 transno 4294975340 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.402490:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.402495:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.402497:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065078.402500:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065078.402510:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14611b9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c336 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.402522:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14611c7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x329:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c336 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.402528:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:2.0:1746065078.402530:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065078.402532:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51a800, rc 0) 00000100:00100000:2.0:1746065078.402553:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27856:x1830881261340032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 852us (1240us total) trans 4294975341 rc 0/0 00000100:00100000:2.0:1746065078.402558:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11950 00000100:00100000:3.0:1746065078.402567:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261340288:12345-192.168.202.27@tcp:36:bash.0 Request processed in 1011us (1286us total) trans 4294975340 rc 0/0 00000100:00100000:3.0:1746065078.402583:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11949 00000020:00080000:3.0:1746065078.402587:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065078.405003:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.405123:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261340416 00000100:00100000:3.0:1746065078.405130:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261340416 00000100:00100000:3.0:1746065078.405399:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11951 00000100:00100000:3.0:1746065078.405406:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27856:x1830881261340416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.405424:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.405438:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14611d5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c33d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.405511:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.405521:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.405533:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065078.405553:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 0 00000004:00200000:3.0:1746065078.405557:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065078.405579:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.405599:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a529400/0xad6b7ddc14611d5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.405611:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.405618:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.405620:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.405622:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bd3800, rc 0) 00000100:00100000:3.0:1746065078.405660:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27856:x1830881261340416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 255us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.405665:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11951 00000100:00100000:0.0:1746065078.406744:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.407936:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261340672 00000100:00100000:2.0:1746065078.407943:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261340672 00000100:00100000:2.0:1746065078.407986:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11952 00000100:00100000:2.0:1746065078.407992:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261340672:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.408007:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.408010:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065078.408265:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc14611c7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c336 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.408278:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:2.0:1746065078.408282:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.408289:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc14611e3 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c344 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.408330:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.408497:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.408505:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 4/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.408530:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.408539:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 289 pid: 7204 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.408550:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef24000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262610816:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.409525:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.409748:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef24000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262610816:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.409762:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065078.410054:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.410189:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261340928 00000100:00100000:2.0:1746065078.410193:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261340928 00000100:00100000:2.0:1746065078.410218:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4113 00000100:00100000:2.0:1746065078.410224:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27856:x1830881261340928:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.411186:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27856:x1830881261340928:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 958us (1129us total) trans 4294975342 rc 0/0 00000100:00100000:2.0:1746065078.411193:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4113 00000100:00100000:2.0:1746065078.411478:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.411709:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261341056 00000100:00100000:1.0:1746065078.411714:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261341056 00010000:00010000:1.0:1746065078.411735:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 291 pid: 7204 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.411769:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3544 00000100:00100000:1.0:1746065078.411795:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+291:2007:x1830881261341056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.411804:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.411809:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 291 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.411819:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 291 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.411836:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14611dc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c33d expref: 291 pid: 7204 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.411854:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:1.0:1746065078.411859:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.411866:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.411872:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065078.411900:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.411924:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+290:2007:x1830881261341056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 150us (447us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065078.411929:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065078.411930:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3544 00010000:00010000:3.0:1746065078.411938:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:3.0:1746065078.412110:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2360, 88 off195696 00000004:00080000:3.0:1746065078.412115:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674430341327ns, next at 674466957028ns, rc = 0 00000040:00080000:3.0:1746065078.412152:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2356, 88 off195240 00000004:00080000:3.0:1746065078.412155:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674430381737ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065078.412186:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2357, 88 off195328 00000004:00080000:3.0:1746065078.412189:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674430415539ns, next at 674466981116ns, rc = 0 00000040:00080000:3.0:1746065078.412197:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2361, 88 off195784 00000004:00080000:3.0:1746065078.412200:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674430426027ns, next at 674466957028ns, rc = 0 00000100:00100000:1.0:1746065078.415158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:2.0:1746065078.415267:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975343 is committed 00000004:00080000:2.0:1746065078.415274:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1595 committed 00000004:00080000:2.0:1746065078.415281:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1585 committed 00000004:00080000:2.0:1746065078.415295:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1584 committed 00000004:00080000:2.0:1746065078.415297:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1594 committed 00010000:00010000:0.0:1746065078.415317:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415326:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415332:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415337:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.415341:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415346:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415359:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:0.0:1746065078.415362:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.415365:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415369:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ae00/0xad6b7ddc14610a8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.415387:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.415390:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.415394:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065078.415396:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262610944:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065078.415401:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.415403:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.415407:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.415411:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:0.0:1746065078.415413:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.415414:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.415418:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc146112d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.415429:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065078.415432:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065078.415433:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415436:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415439:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.415441:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415445:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415450:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:0.0:1746065078.415452:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.415454:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065078.415457:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1746065078.415458:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14611c0 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x329:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065078.415461:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262611328:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.415473:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262611200:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.415476:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.415496:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262610944 00000100:00100000:0.0:1746065078.415496:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.415502:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262610944 00000100:00100000:0.0:1746065078.415513:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065078.415518:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262611072:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.415529:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611328 00000100:00100000:2.0:1746065078.415531:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611328 00000100:00100000:0.0:1746065078.415532:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.415541:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611200 00000100:00100000:2.0:1746065078.415543:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611200 00000100:00100000:0.0:1746065078.415553:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611072 00000100:00100000:0.0:1746065078.415556:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611072 00000100:00100000:0.0:1746065078.415587:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8400 00000100:00100000:0.0:1746065078.415593:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3760:x1830881262610944:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.415615:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261341312 00002000:00080000:0.0:1746065078.415615:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:843 count 1 00000100:00100000:3.0:1746065078.415619:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261341312 00010000:00010000:0.0:1746065078.415632:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.415643:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11953 00000100:00100000:3.0:1746065078.415647:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27856:x1830881261341312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.415648:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.415654:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065078.415655:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.415657:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.415658:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.415669:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14611f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c34b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.415679:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.415693:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 26 pid: 9548 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.415702:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262611456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.415724:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.415733:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.415746:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.415746:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e480 going to sleep for 11 seconds 00010000:00010000:3.0:1746065078.415755:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.415760:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.415760:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8401 00010000:00010000:3.0:1746065078.415764:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.415765:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3760:x1830881262611328:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.415866:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00002000:00010000:0.0:1746065078.415875:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34e:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1746065078.415876:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00002000:00010000:0.0:1746065078.415877:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065078.415879:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065078.415880:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34e:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:3.0:1746065078.415882:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00002000:00010000:0.0:1746065078.415882:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34e:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00200000:3.0:1746065078.415890:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 2 00000100:00100000:0.0:1746065078.415907:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3760:x1830881262611328:12345-0@lo:2:osp-syn-1-1.0 Request processed in 142us (430us total) trans 17179872465 rc 0/0 00000100:00100000:0.0:1746065078.415912:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8401 00000100:00100000:0.0:1746065078.415925:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8402 00000100:00100000:0.0:1746065078.415929:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3762:x1830881262611072:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065078.415937:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:844 count 1 00010000:00010000:3.0:1746065078.415938:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.415943:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415944:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.415947:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.415950:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.415953:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415953:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.415958:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415958:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.415960:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.415962:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.415964:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.415967:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746065078.415969:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.415973:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146120d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.415975:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065078.415982:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 26 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.415984:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.415991:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.415991:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262611584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.415995:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.415999:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416003:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.416005:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416009:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416014:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:3.0:1746065078.416016:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.416018:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.416019:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ef00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065078.416022:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14611ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416029:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416033:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416037:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416041:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa0f21690) 00000004:00080000:0.0:1746065078.416042:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef24700/2, rc 0, transno 17179872465 00010000:00010000:3.0:1746065078.416043:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065078.416047:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262611328:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.416048:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416053:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bccc00) 00010000:00010000:3.0:1746065078.416054:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.416056:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416060:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461206 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.416089:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14611f8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c34b expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.416094:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14611f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c34b expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.416101:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:3.0:1746065078.416122:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27856:x1830881261341312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 474us (971us total) trans 4294975344 rc 301/301 00000100:00100000:3.0:1746065078.416127:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11953 00000100:00100000:1.0:1746065078.416143:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262611840:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065078.416162:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c344 expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.416166:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065078.416167:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.416168:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065078.416175:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc14611e3 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c344 expref: 271 pid: 7203 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1746065078.416178:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065078.416181:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262611968:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065078.416189:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c344 expref: 270 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.416192:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065078.416200:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.416202:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065078.416204:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fe00, rc 0) 00000100:00100000:1.0:1746065078.416204:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611840 00000100:00100000:1.0:1746065078.416207:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611840 00000100:00100000:3.0:1746065078.416220:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261340672:12345-192.168.202.27@tcp:101:bash.0 Request processed in 8228us (9479us total) trans 4294975343 rc 0/0 00000100:00100000:3.0:1746065078.416227:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11952 00000100:00100000:1.0:1746065078.416227:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611968 00000100:00100000:1.0:1746065078.416229:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611968 00000100:00100000:1.0:1746065078.416237:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8403 00000100:00100000:1.0:1746065078.416241:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+210:3761:x1830881262611840:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.416243:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8404 00000100:00100000:3.0:1746065078.416248:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+210:3761:x1830881262611968:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:1.0:1746065078.416250:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:843 count 1 00010000:00010000:1.0:1746065078.416260:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.416269:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.416273:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.416274:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.416276:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.416293:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065078.416297:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8405 00000100:00100000:2.0:1746065078.416303:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:3762:x1830881262611200:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065078.416314:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746065078.416322:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+211:3761:x1830881262611968:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (128us total) trans 21474839741 rc 0/0 00000100:00100000:1.0:1746065078.416323:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262612224:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.416328:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8404 00000100:00100000:1.0:1746065078.416343:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000004:00080000:1.0:1746065078.416361:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098666a00/2, rc 0, transno 21474839741 00000100:00100000:1.0:1746065078.416365:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262611968:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.416370:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+19:3762:x1830881262611200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 67us (872us total) trans 17179872466 rc 0/0 00000100:00100000:1.0:1746065078.416373:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262612096:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.416375:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8405 00000100:00100000:1.0:1746065078.416390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.416405:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262612096 00000100:00100000:2.0:1746065078.416409:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262612096 00000100:00100000:1.0:1746065078.416411:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065078.416415:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262611712:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.416428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.416433:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611712 00000100:00100000:2.0:1746065078.416435:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611712 00000100:00100000:2.0:1746065078.416445:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8406 00000100:00100000:2.0:1746065078.416450:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+212:3759:x1830881262612096:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065078.416491:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.416494:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.416495:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.416497:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.416498:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065078.416518:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+213:3759:x1830881262612096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 68us (127us total) trans 21474839742 rc 0/0 00000100:00100000:1.0:1746065078.416837:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8407 00000100:00100000:2.0:1746065078.416843:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8406 00000100:00100000:1.0:1746065078.416844:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+213:3759:x1830881262611712:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065078.416856:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:842 count 1 00010000:00010000:1.0:1746065078.416864:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.416873:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 83 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.416882:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.416883:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.416885:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.416898:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 83 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.416906:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 83 pid: 9550 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.416913:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262612352:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.416943:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe540 going to sleep for 11 seconds 00000004:00080000:1.0:1746065078.416964:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dea00/2, rc 0, transno 21474839742 00000100:00100000:1.0:1746065078.416967:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262612096:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065078.417051:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef25500/2, rc 0, transno 17179872466 00000100:00100000:0.0:1746065078.417055:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262611200:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.420661:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.420749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.420800:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261341696 00000100:00100000:0.0:1746065078.420808:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261341696 00000100:00100000:0.0:1746065078.420851:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4114 00000100:00100000:0.0:1746065078.420858:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+270:27856:x1830881261341696:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065078.421025:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27856:x1830881261341696:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 167us (276us total) trans 4294975345 rc 0/0 00000100:00100000:0.0:1746065078.421031:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4114 00000100:00100000:3.0:1746065078.421303:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261341440 00000100:00100000:3.0:1746065078.421313:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261341440 00010000:00010000:3.0:1746065078.421331:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 27 pid: 9548 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.421351:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3545 00000100:00100000:3.0:1746065078.421361:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261341440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.421370:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.421374:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 27 pid: 9548 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.421388:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 27 pid: 9548 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.421409:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.421411:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.421415:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.421422:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.421436:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.421442:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262612224:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.421459:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.421464:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261341440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.421470:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3545 00000100:00100000:1.0:1746065078.421481:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262611584:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.421492:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.421509:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262612352:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.421518:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.421606:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc1461069 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2c6 expref: 26 pid: 9548 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.421616:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262611456:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.421626:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.421632:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.421637:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.421645:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.421651:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.421664:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065078.421839:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+19:3760:x1830881262610944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6246us (6405us total) trans 17179872467 rc 0/0 00000100:00100000:2.0:1746065078.421847:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8400 00000004:00080000:1.0:1746065078.423421:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef26680/2, rc 0, transno 17179872467 00000100:00100000:1.0:1746065078.423429:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262610944:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065078.423898:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.423905:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.423913:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.423917:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.423927:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.423941:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.423946:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc14611f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.423960:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.423961:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.423962:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065078.424110:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.424140:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.424161:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261341952 00000100:00100000:2.0:1746065078.424162:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.424166:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261341952 00000100:00100000:2.0:1746065078.424190:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.424194:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261341824 00000100:00100000:1.0:1746065078.424197:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261341824 00000100:00100000:2.0:1746065078.424204:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261342208 00000100:00100000:2.0:1746065078.424207:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261342208 00010000:00010000:1.0:1746065078.424216:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 27 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746065078.424228:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8408 00000100:00100000:1.0:1746065078.424233:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261342080 00000100:00100000:2.0:1746065078.424234:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:26180:x1830881261342208:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065078.424235:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261342080 00010000:00010000:1.0:1746065078.424244:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 85 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.424245:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.424256:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c352 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.424256:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3546 00000100:00100000:1.0:1746065078.424261:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261341824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.424269:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.424273:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 27 pid: 3067 timeout: 774 lvb_type: 1 00002000:00010000:2.0:1746065078.424274:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.424282:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 28 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746065078.424286:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.424287:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.424293:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424294:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488200/0xad6b7ddc1460fac lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c287 expref: 28 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:2.0:1746065078.424303:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.424310:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8200, rc 0) 00010000:00010000:1.0:1746065078.424310:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.424311:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.424314:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424320:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424333:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.424340:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:26180:x1830881261342208:12345-192.168.202.27@tcp:101:bash.0 Request processed in 106us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.424345:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8408 00000100:00100000:1.0:1746065078.424349:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261341824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.424354:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3546 00000100:00100000:1.0:1746065078.424363:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3547 00000100:00100000:1.0:1746065078.424368:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+85:2007:x1830881261342080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.424373:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.424377:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 85 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.424384:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 85 pid: 9550 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.424395:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc1461062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c2bf expref: 85 pid: 9550 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.424397:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065078.424403:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.424404:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.424407:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.424412:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261342336 00010000:00010000:1.0:1746065078.424413:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.424414:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261342336 00010000:00010000:1.0:1746065078.424422:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.424433:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+84:2007:x1830881261342080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.424438:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3547 00000100:00100000:2.0:1746065078.424441:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4115 00000100:00100000:2.0:1746065078.424448:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27856:x1830881261342336:12345-192.168.202.27@tcp:33:lfs.0 00010000:00010000:1.0:1746065078.424453:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424459:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424466:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424473:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424483:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065078.424529:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27856:x1830881261342336:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 84us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.424534:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4115 00000100:00100000:1.0:1746065078.424644:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3762:x1830881262611072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8714us (9110us total) trans 17179872468 rc 0/0 00000100:00100000:1.0:1746065078.424650:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8402 00010000:00010000:1.0:1746065078.424665:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.424669:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424674:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a528400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.424677:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424682:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424690:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424694:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a528400/0xad6b7ddc146121b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424703:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.424704:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.424705:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.424712:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424718:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424723:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424729:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.424738:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1746065078.424743:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef25f80/2, rc 0, transno 17179872468 00000100:00100000:0.0:1746065078.424748:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262611072:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.424825:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746065078.424839:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3548 00000100:00100000:3.0:1746065078.424843:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+83:2007:x1830881261341952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.424849:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.424852:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.424864:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.424874:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1460fb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c28e expref: 83 pid: 12260 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.424881:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.424882:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.424885:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.424889:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.424902:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.424920:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+82:2007:x1830881261341952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.424925:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3548 00000100:00100000:1.0:1746065078.425052:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+213:3759:x1830881262611712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8208us (8622us total) trans 21474839743 rc 0/0 00000100:00100000:1.0:1746065078.425058:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8407 00010000:00010000:1.0:1746065078.425073:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.425077:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425082:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.425084:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425089:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425097:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425101:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc1461229 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425111:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.425311:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.425313:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065078.425332:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925ca300/2, rc 0, transno 21474839743 00000100:00100000:1.0:1746065078.425336:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262611712:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065078.425351:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425629:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425635:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425641:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.425663:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065078.425686:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.425691:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.425697:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.425700:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.425710:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.425720:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.425726:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1461222 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.425736:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.425737:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.425739:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065078.426279:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+213:3761:x1830881262611840:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10035us (10110us total) trans 21474839744 rc 0/0 00000100:00100000:1.0:1746065078.426285:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8403 00000004:00080000:2.0:1746065078.426304:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098664a80/2, rc 0, transno 21474839744 00000100:00100000:2.0:1746065078.426309:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262611840:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.426599:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.427107:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261342464 00000100:00100000:2.0:1746065078.427112:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261342464 00000100:00100000:2.0:1746065078.427152:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8409 00000100:00100000:2.0:1746065078.427158:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+82:26180:x1830881261342464:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.427171:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.427186:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c359 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.427206:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.427220:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.427221:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.427226:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 83 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.427237:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 83 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.427244:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:2.0:1746065078.427284:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+83:26180:x1830881261342464:12345-192.168.202.27@tcp:101:bash.0 Request processed in 126us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.427289:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8409 00000100:00100000:0.0:1746065078.435940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.436555:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.436839:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261342592 00000100:00100000:2.0:1746065078.436846:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261342592 00002000:00010000:2.0:1746065078.436877:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/845 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.436881:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ce9500 with x1830881261342592 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.436890:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ce9500. 00000100:00100000:2.0:1746065078.436903:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261342720 00000100:00100000:2.0:1746065078.436905:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261342720 00002000:00010000:2.0:1746065078.436911:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/844 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.436913:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ce8a80 with x1830881261342720 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.436917:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ce8a80. 00000100:00100000:2.0:1746065078.437430:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1243 00000100:00100000:2.0:1746065078.437438:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881261342592:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065078.437578:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.437581:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34d:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.437583:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.437585:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34d:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.437586:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065078.437629:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261342592:12345-192.168.202.27@tcp:10:bash.0 Request processed in 192us (1698us total) trans 17179872469 rc 0/0 00000100:00100000:2.0:1746065078.437635:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1243 00002000:00010000:2.0:1746065078.437639:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/845 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.437640:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ce9500 with x1830881261342592 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.437644:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ce9500. 00000100:00100000:2.0:1746065078.437656:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1244 00000100:00100000:2.0:1746065078.437660:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+83:2005:x1830881261342720:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065078.437721:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.437723:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.437725:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.437726:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.437728:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065078.437742:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+84:2005:x1830881261342720:12345-192.168.202.27@tcp:10:bash.0 Request processed in 82us (1189us total) trans 21474839745 rc 0/0 00000100:00100000:2.0:1746065078.437747:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1244 00002000:00010000:2.0:1746065078.437749:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/844 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.437751:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ce8a80 with x1830881261342720 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.437753:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ce8a80. 00000100:00100000:0.0:1746065078.452629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.452726:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.452755:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261343232 00000100:00100000:2.0:1746065078.452761:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261343232 00000100:00100000:2.0:1746065078.452807:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4116 00000100:00100000:2.0:1746065078.452813:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261343232:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065078.453035:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261343232:12345-192.168.202.27@tcp:35:bash.0 Request processed in 220us (307us total) trans 4294975346 rc 0/0 00000100:00100000:2.0:1746065078.453041:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4116 00000100:00100000:3.0:1746065078.453668:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261343104 00000100:00100000:3.0:1746065078.453673:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261343104 00000100:00100000:3.0:1746065078.453699:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11954 00000100:00100000:3.0:1746065078.453704:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27857:x1830881261343104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.453713:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.453729:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146123e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c360 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.453801:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.453811:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453820:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453831:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.453836:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453841:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453903:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461253 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.453911:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461253 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453917:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461253 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065078.453925:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x329:0x0]: returning size 5 00010000:00010000:3.0:1746065078.453962:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453967:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453974:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453979:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453983:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1bd3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.453987:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453992:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.453999:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:3.0:1746065078.454001:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.454004:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454008:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc1461245 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454020:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454025:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454028:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454031:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.454033:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454039:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454044:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bccc00) 00010000:00010000:3.0:1746065078.454045:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.454047:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454051:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc146124c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.454075:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc146123e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c360 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.454085:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461253 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c360 expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.454091:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:3.0:1746065078.454093:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.454095:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:3.0:1746065078.454119:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27857:x1830881261343104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 415us (1499us total) trans 4294975347 rc 0/0 00000100:00100000:3.0:1746065078.454125:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11954 00000100:00100000:2.0:1746065078.460345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.460494:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261343488 00000100:00100000:0.0:1746065078.460502:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261343488 00000100:00100000:0.0:1746065078.460541:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4117 00000100:00100000:0.0:1746065078.460547:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27857:x1830881261343488:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065078.461940:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27857:x1830881261343488:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1388us (1599us total) trans 4294975348 rc 0/0 00000100:00100000:1.0:1746065078.461948:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4117 00000100:00100000:0.0:1746065078.462723:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.462792:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261343744 00000100:00100000:2.0:1746065078.462798:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261343744 00000100:00100000:2.0:1746065078.462846:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11955 00000100:00100000:2.0:1746065078.462853:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27858:x1830881261343744:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065078.462889:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065078.462910:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc14611ea lrc: 0/0,0 mode: --/CR res: [0x240000403:0x329:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c344 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.462944:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461253 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c360 expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.462957:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14611b2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x329:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c32f expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.462965:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff8800a9973700) 00010000:00010000:2.0:1746065078.462972:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.462990:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.463000:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463007:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463016:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.463021:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463025:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463091:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.463097:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463103:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:2.0:1746065078.463280:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2362, 64 off195848 00000004:00080000:2.0:1746065078.463286:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674481512070ns, next at 675481510748ns, rc = 0 00000040:00080000:2.0:1746065078.463306:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2358, 64 off195392 00000004:00080000:2.0:1746065078.463308:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674481534931ns, next at 675481534386ns, rc = 0 00000040:00080000:2.0:1746065078.463315:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2359, 64 off195456 00000040:00080000:2.0:1746065078.463323:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2363, 64 off195912 00010000:00010000:2.0:1746065078.463356:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x329:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.463362:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463367:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463376:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463380:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463384:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463407:0:7231:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065078.463422:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463427:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463431:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463435:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.463439:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463444:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463450:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:2.0:1746065078.463453:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065078.463456:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463459:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7600/0xad6b7ddc146126f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x329:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463545:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463550:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463554:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463558:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463561:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.463563:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463567:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463584:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.463586:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.463588:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463592:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc1461261 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065078.463600:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099ceb480 reply state ffff88008d938000 transno 4294975349 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463605:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.463610:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065078.463612:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.463614:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065078.463664:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27858:x1830881261343744:12345-192.168.202.27@tcp:36:rm.0 Request processed in 812us (941us total) trans 4294975349 rc 0/0 00000100:00100000:2.0:1746065078.463670:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11955 00010000:00010000:1.0:1746065078.464248:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.464253:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.464258:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580ea00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.464260:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.464265:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.464274:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x329:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:1.0:1746065078.464276:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065078.464279:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.464283:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1461276 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x329:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065078.464308:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.464309:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.464311:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065078.469318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.469425:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261343872 00000100:00100000:2.0:1746065078.469433:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261343872 00000100:00100000:2.0:1746065078.469483:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11956 00000100:00100000:2.0:1746065078.469491:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27857:x1830881261343872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.469512:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.469529:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146127d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c367 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.469592:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.469602:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469614:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469624:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.469629:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469634:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469670:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469676:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469680:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469684:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469689:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.469692:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469698:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469706:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c900) 00010000:00010000:2.0:1746065078.469709:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.469711:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469715:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461284 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469724:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469727:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469730:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469734:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.469736:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469740:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469745:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065078.469746:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.469748:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469751:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9c00/0xad6b7ddc146128b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.469797:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146127d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c367 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.469804:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146127d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c367 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.469814:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fc00, rc 0) 00000100:00100000:2.0:1746065078.469855:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27857:x1830881261343872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 365us (545us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.469861:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11956 00000100:00100000:0.0:1746065078.480593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.480988:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261344000 00000100:00100000:2.0:1746065078.480995:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261344000 00000100:00100000:2.0:1746065078.481205:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11957 00000100:00100000:2.0:1746065078.481213:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27859:x1830881261344000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.481231:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.481248:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1461292 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c36e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.481303:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.481314:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481324:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481332:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.481338:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481342:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481374:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481379:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481384:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481390:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481395:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.481398:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481407:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481416:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065078.481418:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.481421:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481425:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9a00/0xad6b7ddc1461299 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481457:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481462:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481466:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481470:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.481472:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481477:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481483:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065078.481485:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.481487:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481491:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612a0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.481517:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1461292 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c36e expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.481524:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc1461292 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c36e expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.481534:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8c00, rc 0) 00000100:00100000:2.0:1746065078.483522:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27859:x1830881261344000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2300us (2927us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.483532:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11957 00000100:00100000:0.0:1746065078.486117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.486866:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261344256 00000100:00100000:2.0:1746065078.486875:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261344256 00000100:00100000:2.0:1746065078.486926:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11958 00000100:00100000:2.0:1746065078.486933:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27860:x1830881261344256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.486949:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.486966:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8000/0xad6b7ddc14612a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c375 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.487036:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.487047:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487056:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487064:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.487073:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487078:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487105:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487110:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487115:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487120:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487124:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.487127:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487132:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487140:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.487142:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.487145:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487149:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487175:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487181:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487185:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487189:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.487191:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487195:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487201:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065078.487203:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.487205:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487209:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.487230:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8000/0xad6b7ddc14612a7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c375 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.487237:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8000/0xad6b7ddc14612a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c375 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.488417:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8000, rc 0) 00000100:00100000:2.0:1746065078.488483:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27860:x1830881261344256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1549us (2372us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.488490:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11958 00000100:00100000:0.0:1746065078.490595:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.490677:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261344384 00000100:00100000:2.0:1746065078.490684:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261344384 00000100:00100000:2.0:1746065078.490793:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11959 00000100:00100000:2.0:1746065078.490801:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27859:x1830881261344384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.490816:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.490832:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc14612bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c37c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.490880:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.490890:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490898:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490905:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.490911:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490915:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490944:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490947:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490950:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490957:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490960:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.490963:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490968:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490975:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:2.0:1746065078.490978:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.490980:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490984:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14612c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490992:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.490996:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.491000:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.491004:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.491006:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.491010:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.491018:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065078.491020:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.491022:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.491026:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14612ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.491048:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc14612bc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c37c expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.491054:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc14612bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c37c expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.491063:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8200, rc 0) 00000100:00100000:2.0:1746065078.491103:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27859:x1830881261344384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 303us (513us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.491108:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11959 00000100:00100000:0.0:1746065078.492217:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.492258:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.492318:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261344512 00000100:00100000:3.0:1746065078.492321:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261344640 00000100:00100000:2.0:1746065078.492322:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261344512 00000100:00100000:3.0:1746065078.492325:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261344640 00000100:00100000:2.0:1746065078.492346:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11960 00000100:00100000:2.0:1746065078.492352:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27859:x1830881261344512:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065078.492355:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11961 00000100:00100000:3.0:1746065078.492361:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27860:x1830881261344640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.492361:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.492368:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.492370:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14612d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c383 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.492399:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.492412:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.492419:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065078.492456:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065078.492462:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065078.492482:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14612d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c383 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.492494:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c383 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.492500:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cc00) 00010000:00010000:2.0:1746065078.492502:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065078.492504:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8e00, rc 0) 00000100:00100000:2.0:1746065078.492540:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27859:x1830881261344512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 188us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.492545:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11960 00010000:00010000:3.0:1746065078.492630:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14612d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c38a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.492660:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.492666:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492672:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492677:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.492681:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492686:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492703:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492708:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492711:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492715:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492719:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.492721:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492727:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492733:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cc00) 00010000:00010000:3.0:1746065078.492734:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.492736:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492740:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14612e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492920:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492925:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492930:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492934:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.492936:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492940:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492946:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065078.492948:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.492950:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492954:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14612ed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.492973:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14612d8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c38a expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.492979:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14612d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c38a expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.492985:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00000100:00100000:3.0:1746065078.493014:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27860:x1830881261344640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 653us (755us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065078.493019:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11961 00000100:00100000:0.0:1746065078.495527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.495642:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261344896 00000100:00100000:3.0:1746065078.495648:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261344896 00000100:00100000:3.0:1746065078.495686:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11962 00000100:00100000:3.0:1746065078.495697:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27859:x1830881261344896:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.495711:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.495714:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065078.495735:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14612df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c383 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.495749:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cc00) 00010000:00010000:3.0:1746065078.495758:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.495766:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc14612f4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c391 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.495940:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.495950:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.495958:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.495965:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.495971:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.495975:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496251:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.496257:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496263:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065078.496270:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 0 00010000:00010000:3.0:1746065078.496290:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496295:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496299:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496303:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496308:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.496312:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496317:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496323:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bcc400) 00010000:00010000:3.0:1746065078.496326:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.496328:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496333:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9200/0xad6b7ddc14612fb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065078.496341:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f09ce00 reply state ffff8801373f4000 transno 4294975350 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496347:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.496352:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065078.496354:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065078.496356:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065078.496373:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc14612f4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.496384:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.496389:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:3.0:1746065078.496391:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.496392:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:3.0:1746065078.496439:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27859:x1830881261344896:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 746us (918us total) trans 4294975350 rc 0/0 00000100:00100000:3.0:1746065078.496445:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11962 00000100:00100000:0.0:1746065078.499528:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.499688:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261345152 00000100:00100000:3.0:1746065078.499695:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261345152 00000100:00100000:3.0:1746065078.499727:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11963 00000100:00100000:3.0:1746065078.499733:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27859:x1830881261345152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.499750:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.499764:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc1461317 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c398 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.499866:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.499876:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.499882:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.499905:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.499913:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 278 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.499922:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262612480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.499998:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.506961:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.507081:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.507105:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261345536 00000100:00100000:0.0:1746065078.507111:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261345536 00010000:00010000:0.0:1746065078.507142:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 279 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.507165:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3549 00000100:00100000:0.0:1746065078.507171:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261345536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.507182:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.507187:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 279 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.507197:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 279 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.507200:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262612480:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065078.507216:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61200/0xad6b7ddc1461309 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c391 expref: 279 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.507218:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065078.507337:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261345408 00000100:00100000:1.0:1746065078.507341:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261345408 00000100:00100000:1.0:1746065078.507363:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11964 00000100:00100000:1.0:1746065078.507368:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27861:x1830881261345408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.507382:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.507392:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461325 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c39f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.507469:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.507478:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507486:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065078.507494:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 0 00010000:00010000:1.0:1746065078.507556:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507565:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507580:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507585:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.507588:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507594:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507603:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:1.0:1746065078.507605:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065078.507608:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507612:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51a800/0xad6b7ddc146132c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.507641:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461325 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c39f expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.507648:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51ba00/0xad6b7ddc1461325 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c39f expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.507654:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ba00, rc 0) 00000100:00100000:1.0:1746065078.507690:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27861:x1830881261345408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 321us (737us total) trans 4294975351 rc 301/301 00000100:00100000:1.0:1746065078.507696:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11964 00010000:00010000:0.0:1746065078.508081:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:0.0:1746065078.508086:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.508092:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.508097:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.508433:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.508447:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508454:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065078.508460:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261345536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1288us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.508466:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3549 00000004:00200000:2.0:1746065078.508467:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 0 00000004:00080000:2.0:1746065078.508593:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x34e:0x0], index 0: 0 00000004:00080000:2.0:1746065078.508599:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x34f:0x0], index 1: 0 00000004:00080000:2.0:1746065078.508602:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x350:0x0], index 1: 0 00000004:00080000:2.0:1746065078.508606:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x34f:0x0], index 0: 0 00010000:00010000:2.0:1746065078.508683:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508688:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508693:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508696:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.508698:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508703:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508710:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800a9bcc000) 00010000:00010000:2.0:1746065078.508712:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.508715:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508719:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc146131e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.508745:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc1461317 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c398 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.508750:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc1461317 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c398 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.508760:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61c00, rc 0) 00000100:00100000:2.0:1746065078.508812:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27859:x1830881261345152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9078us (9290us total) trans 4294975352 rc 301/301 00000100:00100000:2.0:1746065078.508818:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11963 00000100:00100000:0.0:1746065078.516869:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.516931:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261345792 00000100:00100000:1.0:1746065078.516939:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261345792 00000100:00100000:1.0:1746065078.516982:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4118 00000100:00100000:1.0:1746065078.516989:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27859:x1830881261345792:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065078.517181:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27859:x1830881261345792:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 193us (319us total) trans 4294975353 rc 0/0 00000100:00100000:1.0:1746065078.517187:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4118 00000100:00100000:0.0:1746065078.521715:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.521756:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.521844:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261345920 00000100:00100000:2.0:1746065078.521851:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261345920 00000100:00100000:2.0:1746065078.521890:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11965 00000100:00100000:2.0:1746065078.521896:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27861:x1830881261345920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.521915:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.521930:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc1461341 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3a6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.522000:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1461348 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.522010:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1461348 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.522019:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1461348 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065078.522037:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 0 00000004:00200000:2.0:1746065078.522041:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065078.522053:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1461348 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.522071:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8200/0xad6b7ddc1461341 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3a6 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.522091:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1461348 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3a6 expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.522097:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065078.522100:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.522102:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9400, rc 0) 00000100:00100000:2.0:1746065078.522137:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27861:x1830881261345920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 241us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.522142:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11965 00000100:00100000:3.0:1746065078.522336:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261346176 00000100:00100000:3.0:1746065078.522340:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261346176 00000100:00100000:3.0:1746065078.522426:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4119 00000100:00100000:3.0:1746065078.522432:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27859:x1830881261346176:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.522643:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27859:x1830881261346176:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 210us (886us total) trans 4294975354 rc 0/0 00000100:00100000:3.0:1746065078.522649:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4119 00000100:00100000:0.0:1746065078.528754:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.530042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.530062:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261346304 00000100:00100000:1.0:1746065078.530071:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261346304 00000100:00100000:1.0:1746065078.530115:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8410 00000100:00100000:1.0:1746065078.530122:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261346304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.530136:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.530151:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3ad expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065078.530171:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.530186:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.530188:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.530193:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.530206:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.530214:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ae00, rc 0) 00000100:00100000:1.0:1746065078.530263:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261346304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 141us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.530271:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8410 00000100:00100000:0.0:1746065078.532400:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.532554:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261346432 00000100:00100000:2.0:1746065078.532560:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261346432 00000100:00100000:1.0:1746065078.533127:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261346688 00000100:00100000:1.0:1746065078.533131:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261346688 00000100:00100000:1.0:1746065078.533168:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11966 00000100:00100000:1.0:1746065078.533174:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261346688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065078.533193:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.533209:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc1461356 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3bb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.533324:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.533335:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533344:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533351:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.533357:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533362:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533396:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc146136b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.533402:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc146136b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533411:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc146136b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065078.533419:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 0 00010000:00010000:1.0:1746065078.533473:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533479:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533484:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533490:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533495:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.533498:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533504:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533513:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd300) 00010000:00010000:1.0:1746065078.533515:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.533518:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533523:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc146135d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533552:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533560:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533565:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533577:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.533579:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533583:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533589:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:1.0:1746065078.533591:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.533593:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533597:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1461364 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.533624:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc1461356 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3bb expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.533640:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc146136b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3bb expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.533646:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065078.533648:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065078.533650:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:1.0:1746065078.533689:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261346688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 515us (1296us total) trans 4294975355 rc 0/0 00000100:00100000:1.0:1746065078.533695:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11966 00000100:00100000:2.0:1746065078.533881:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8411 00000100:00100000:2.0:1746065078.533888:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+84:2004:x1830881261346432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.533895:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.533905:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3b4 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.533921:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.533930:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.533932:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.533938:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 85 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.533947:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 85 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.533955:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8000, rc 0) 00000100:00100000:2.0:1746065078.533971:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+85:2004:x1830881261346432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 85us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.533976:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8411 00000100:00100000:2.0:1746065078.538468:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.538533:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.538635:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261346816 00000100:00100000:0.0:1746065078.538642:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261346816 00000100:00100000:0.0:1746065078.538679:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 544 00000100:00100000:0.0:1746065078.538686:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+283:2007:x1830881261346816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.538696:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.538716:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc146136b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3bb expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.538735:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065078.538739:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065078.538800:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+282:2007:x1830881261346816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.538806:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 544 00000100:00100000:3.0:1746065078.538887:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261346944 00000100:00100000:3.0:1746065078.538891:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261346944 00000100:00100000:3.0:1746065078.538915:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11967 00000100:00100000:3.0:1746065078.538919:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261346944:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.538936:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.538945:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461380 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3c2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.538969:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461387 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.538979:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461387 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.538987:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461387 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.539059:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461380 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3c2 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.539084:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461387 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3c2 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.539091:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:3.0:1746065078.539093:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065078.539095:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:2.0:1746065078.539203:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.539372:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261346944:12345-192.168.202.27@tcp:101:bash.0 Request processed in 451us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.539377:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11967 00000100:00100000:3.0:1746065078.539392:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261347200 00000100:00100000:3.0:1746065078.539394:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261347200 00000100:00100000:3.0:1746065078.539421:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4120 00000100:00100000:3.0:1746065078.539425:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27861:x1830881261347200:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.539685:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27861:x1830881261347200:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 258us (481us total) trans 4294975356 rc 0/0 00000100:00100000:3.0:1746065078.539691:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4120 00000100:00100000:0.0:1746065078.543741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.543849:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261347456 00000100:00100000:3.0:1746065078.543857:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261347456 00000100:00100000:3.0:1746065078.543901:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11968 00000100:00100000:3.0:1746065078.543907:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261347456:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065078.543945:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.543966:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1461348 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3a6 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.543980:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:3.0:1746065078.543984:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.544112:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.544127:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.544135:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065078.544161:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975357 00000004:00010000:3.0:1746065078.544175:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f09d180 reply state ffff880097df5000 transno 4294975358 ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.544182:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.544188:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:3.0:1746065078.544190:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065078.544192:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065078.545821:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261347456:12345-192.168.202.27@tcp:36:bash.0 Request processed in 1905us (2078us total) trans 4294975358 rc 0/0 00000100:00100000:3.0:1746065078.545830:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11968 00000020:00080000:3.0:1746065078.545837:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065078.546141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.546255:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261347712 00000100:00100000:3.0:1746065078.546260:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261347712 00000100:00100000:3.0:1746065078.546290:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11969 00000100:00100000:3.0:1746065078.546295:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27861:x1830881261347712:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.546312:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.546329:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc1461395 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3c9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.546382:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.546394:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546401:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546407:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.546412:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546416:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546481:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc14613aa lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.546486:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc14613aa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546491:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc14613aa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065078.546497:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 0 00010000:00010000:3.0:1746065078.546542:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546546:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546550:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546555:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546560:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.546564:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546580:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546587:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccd00) 00010000:00010000:3.0:1746065078.546590:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.546592:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546597:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166800/0xad6b7ddc146139c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546604:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546607:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546611:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546614:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.546616:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546620:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546624:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065078.546626:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.546628:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546632:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166600/0xad6b7ddc14613a3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.546654:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166c00/0xad6b7ddc1461395 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3c9 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.546665:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc14613aa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3c9 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.546671:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:3.0:1746065078.546672:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.546674:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167c00, rc 0) 00000100:00100000:3.0:1746065078.546703:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27861:x1830881261347712:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 409us (564us total) trans 4294975359 rc 0/0 00000100:00100000:3.0:1746065078.546708:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11969 00000100:00100000:0.0:1746065078.550884:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.551084:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261347968 00000100:00100000:3.0:1746065078.551092:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261347968 00000100:00100000:3.0:1746065078.551127:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4121 00000100:00100000:3.0:1746065078.551133:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27861:x1830881261347968:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.551830:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.555667:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27861:x1830881261347968:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 4521us (4778us total) trans 4294975360 rc 0/0 00000100:00100000:3.0:1746065078.555679:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4121 00000100:00100000:3.0:1746065078.555718:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261348224 00000100:00100000:3.0:1746065078.555725:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261348224 00000100:00100000:0.0:1746065078.563894:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.564356:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261348480 00000100:00100000:3.0:1746065078.564364:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261348480 00000100:00100000:1.0:1746065078.564414:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11970 00000100:00100000:1.0:1746065078.564423:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261348224:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065078.564444:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.564447:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065078.564469:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc14613aa lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3c9 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.564487:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065078.564490:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.564499:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14613b8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3d0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.564536:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14613bf lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.564546:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14613bf lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.564553:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14613bf lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:1.0:1746065078.564762:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2360, 88 off195544 00000004:00080000:1.0:1746065078.564768:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674582993508ns, next at 675481534386ns, rc = 0 00000040:00080000:1.0:1746065078.564829:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2364, 88 off196000 00000004:00080000:1.0:1746065078.564833:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674583059580ns, next at 675481510748ns, rc = 0 00000040:00080000:1.0:1746065078.564858:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2365, 88 off196088 00000004:00080000:1.0:1746065078.564861:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674583087371ns, next at 675481510748ns, rc = 0 00000040:00080000:1.0:1746065078.564869:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2361, 88 off195632 00000004:00080000:1.0:1746065078.564872:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674583098158ns, next at 675481534386ns, rc = 0 00000100:00100000:0.0:1746065078.565194:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11971 00000100:00100000:0.0:1746065078.565203:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27861:x1830881261348480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.565212:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.565221:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14613c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3d7 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.565275:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.565281:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.565287:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.565294:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.565299:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.565303:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.565360:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.565367:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.565372:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065078.565385:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 2 00010000:00010000:0.0:1746065078.568765:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568806:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568812:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568816:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.568820:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568825:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568838:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065078.568840:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065078.568843:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568847:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5a00/0xad6b7ddc14613db lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568872:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568877:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568880:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568888:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568891:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.568893:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568897:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568903:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561500) 00010000:00010000:0.0:1746065078.568904:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.568906:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568910:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc14613cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568916:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568920:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568924:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568928:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.568930:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568934:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568942:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:0.0:1746065078.568943:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.568946:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568949:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14613d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.568988:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14613c6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3d7 expref: 293 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.568995:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14613c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3d7 expref: 293 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.569005:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4600, rc 0) 00000100:00100000:0.0:1746065078.569071:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27861:x1830881261348480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3869us (5184us total) trans 4294975362 rc 301/301 00000100:00100000:0.0:1746065078.569078:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11971 00000100:00100000:2.0:1746065078.571313:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.571390:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261348736 00000100:00100000:3.0:1746065078.571397:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261348736 00000100:00100000:3.0:1746065078.571439:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4122 00000100:00100000:3.0:1746065078.571445:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27861:x1830881261348736:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.571622:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27861:x1830881261348736:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 176us (316us total) trans 4294975363 rc 0/0 00000100:00100000:3.0:1746065078.571629:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4122 00000001:00080000:2.0:1746065078.573429:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975361 is committed 00000004:00080000:2.0:1746065078.573438:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1588 committed 00000004:00080000:2.0:1746065078.573451:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1598 committed 00000004:00080000:2.0:1746065078.573459:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1597 committed 00000004:00080000:2.0:1746065078.573461:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1587 committed 00000004:00080000:2.0:1746065078.573477:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1586 committed 00000004:00080000:2.0:1746065078.573478:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1596 committed 00010000:00010000:0.0:1746065078.573560:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14613bf lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3d0 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.573579:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065078.573581:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1746065078.573589:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262612736:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065078.573593:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14613b8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3d0 expref: 275 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065078.573613:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14613bf lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3d0 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.573639:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262612864:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065078.573641:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.573740:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262612608:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.573807:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573815:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573820:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573825:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.573828:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573834:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573843:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065078.573845:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.573848:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573852:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1461268 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.573865:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573870:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573874:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573878:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.573879:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573883:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573889:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065078.573891:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.573892:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573896:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1461302 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573909:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573913:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573917:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573920:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6556800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.573922:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573927:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573932:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:3.0:1746065078.573934:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.573936:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.573940:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a6556800/0xad6b7ddc146138e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065078.573962:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262612992:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.574044:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065078.574070:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065078.574073:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065078.574075:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51be00, rc 0) 00000100:00100000:2.0:1746065078.574079:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262613248:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.574089:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262613376:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.574097:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.574111:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262612736 00000100:00100000:0.0:1746065078.574117:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262612736 00000100:00100000:2.0:1746065078.574118:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262612864 00000100:00100000:2.0:1746065078.574120:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262612864 00000100:00100000:0.0:1746065078.574140:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262613248 00000100:00100000:0.0:1746065078.574141:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262613248 00000100:00100000:2.0:1746065078.574143:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8412 00000100:00100000:2.0:1746065078.574148:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+20:3761:x1830881262612736:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.574152:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8413 00000100:00100000:0.0:1746065078.574155:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3762:x1830881262612864:12345-0@lo:2:osp-syn-1-1.0 00002000:00080000:2.0:1746065078.574167:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:846 count 1 00010000:00010000:2.0:1746065078.574180:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.574192:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.574198:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.574200:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.574203:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.574220:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.574230:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746065078.574238:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098662d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262613632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.574286:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.574300:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8414 00000100:00100000:2.0:1746065078.574305:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+213:3761:x1830881262613248:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065078.574317:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:845 count 1 00010000:00010000:2.0:1746065078.574329:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.574338:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 84 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.574344:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.574345:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.574347:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.574362:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 84 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.574373:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 84 pid: 12260 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746065078.574381:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262613760:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065078.574453:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3762:x1830881262612864:12345-0@lo:2:osp-syn-1-1.0 Request processed in 296us (408us total) trans 17179872470 rc 0/0 00000100:00100000:0.0:1746065078.574459:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8413 00000100:00100000:0.0:1746065078.574475:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065078.574497:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098660700/2, rc 0, transno 17179872470 00000100:00100000:0.0:1746065078.574502:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262612864:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.574513:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262613376 00000100:00100000:0.0:1746065078.574516:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262613376 00000100:00100000:3.0:1746065078.574526:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.574538:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262612992 00000100:00100000:0.0:1746065078.574540:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262612992 00000100:00100000:0.0:1746065078.574552:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8415 00000100:00100000:0.0:1746065078.574556:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+214:3762:x1830881262613376:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.574565:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.574589:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8416 00000100:00100000:2.0:1746065078.574594:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3759:x1830881262612992:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.574630:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+215:3762:x1830881262613376:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (154us total) trans 21474839746 rc 0/0 00000100:00100000:0.0:1746065078.574635:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8415 00002000:00010000:2.0:1746065078.574639:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.574641:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.574643:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.574645:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.574646:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:0.0:1746065078.574657:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6a00/2, rc 0, transno 21474839746 00000100:00100000:0.0:1746065078.574661:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262613376:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.574663:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+22:3759:x1830881262612992:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (138us total) trans 17179872471 rc 0/0 00000100:00100000:2.0:1746065078.574668:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8416 00000100:00100000:0.0:1746065078.574678:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261348224:12345-192.168.202.27@tcp:101:bash.0 Request processed in 10257us (22849us total) trans 4294975361 rc 0/0 00000100:00100000:0.0:1746065078.574683:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11970 00000004:00080000:3.0:1746065078.574720:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098661180/2, rc 0, transno 17179872471 00000100:00100000:3.0:1746065078.574723:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262612992:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.574727:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262613504:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.574743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.574760:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262613504 00000100:00100000:3.0:1746065078.574762:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262613504 00000100:00100000:3.0:1746065078.574809:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8417 00000100:00100000:3.0:1746065078.574814:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+215:3759:x1830881262613504:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065078.574857:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.574859:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.574861:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.574862:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.574864:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.574885:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+216:3759:x1830881262613504:12345-0@lo:2:osp-syn-0-1.0 Request processed in 70us (140us total) trans 21474839747 rc 0/0 00000100:00100000:3.0:1746065078.574890:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8417 00000004:00080000:3.0:1746065078.574910:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5880/2, rc 0, transno 21474839747 00000100:00100000:3.0:1746065078.574913:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262613504:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.575093:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.575109:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262613120:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.575125:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.575143:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262612608 00000100:00100000:1.0:1746065078.575145:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262612608 00000100:00100000:1.0:1746065078.575168:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262613120 00000100:00100000:1.0:1746065078.575170:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262613120 00000100:00100000:1.0:1746065078.575180:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8418 00000100:00100000:1.0:1746065078.575184:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+22:3760:x1830881262612608:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065078.575194:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:845 count 1 00010000:00010000:1.0:1746065078.575204:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.575215:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.575220:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.575221:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.575224:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.575238:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.575245:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 27 pid: 11461 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.575253:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262613888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.575287:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.575377:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8419 00000100:00100000:2.0:1746065078.575383:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+216:3760:x1830881262613120:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065078.575392:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:844 count 1 00010000:00010000:2.0:1746065078.575401:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.575411:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.575415:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.575417:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065078.575419:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.575432:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.575439:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.575447:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098660a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262614016:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.575501:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.579723:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.580520:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261348864 00000100:00100000:1.0:1746065078.580529:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261348864 00000100:00100000:1.0:1746065078.580582:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4123 00000100:00100000:1.0:1746065078.580589:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27861:x1830881261348864:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065078.580711:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27861:x1830881261348864:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 122us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.580717:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4123 00000100:00100000:0.0:1746065078.580938:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.581000:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261348992 00000100:00100000:0.0:1746065078.581000:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.581004:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261348992 00000100:00100000:0.0:1746065078.581012:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349248 00000100:00100000:0.0:1746065078.581014:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349248 00010000:00010000:3.0:1746065078.581023:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 85 pid: 12260 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746065078.581026:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 28 pid: 11461 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.581041:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3550 00000100:00100000:3.0:1746065078.581046:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+85:2006:x1830881261348992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.581058:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.581062:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 85 pid: 12260 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.581070:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 85 pid: 12260 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746065078.581083:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262613888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.581091:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.581092:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.581096:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.581099:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.581103:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.581116:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.581137:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+85:2006:x1830881261348992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.581143:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3550 00000100:00100000:3.0:1746065078.581153:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3551 00000100:00100000:1.0:1746065078.581154:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.581157:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881261349248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.581163:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.581170:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 28 pid: 11461 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.581178:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 28 pid: 11461 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.581189:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d8200/0xad6b7ddc1461230 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c352 expref: 28 pid: 11461 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.581197:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.581198:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.581200:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.581206:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.581220:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.581231:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261349248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.581235:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3551 00000100:00100000:2.0:1746065078.581279:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262613632:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.581294:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.581310:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098660a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262614016:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.581319:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.581373:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc146119d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c321 expref: 84 pid: 12260 timeout: 774 lvb_type: 1 00000100:00100000:2.0:1746065078.581384:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262613760:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.581392:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.581403:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.581408:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.581414:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.581420:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.581430:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065078.581689:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+217:3761:x1830881262613248:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7383us (7589us total) trans 21474839748 rc 0/0 00000100:00100000:2.0:1746065078.581710:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8414 00000100:00100000:3.0:1746065078.582012:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349376 00000100:00100000:3.0:1746065078.582027:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349376 00010000:00010000:3.0:1746065078.582040:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.582057:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3552 00000100:00100000:3.0:1746065078.582061:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+84:2007:x1830881261349376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065078.582066:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.582069:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.582075:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.582086:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc1461237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c359 expref: 84 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.582103:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.582105:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.582107:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582113:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582124:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.582142:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+83:2007:x1830881261349376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.582146:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3552 00010000:00010000:3.0:1746065078.582158:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582163:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582169:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582174:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582182:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065078.582217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.582230:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349120 00000100:00100000:0.0:1746065078.582233:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349120 00010000:00010000:0.0:1746065078.582244:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746065078.582258:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3553 00000100:00100000:0.0:1746065078.582262:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261349120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.582267:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.582270:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746065078.582282:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746065078.582283:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+217:3760:x1830881262613120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6901us (7157us total) trans 21474839749 rc 0/0 00000100:00100000:3.0:1746065078.582288:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8419 00010000:00010000:0.0:1746065078.582292:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c51bc00/0xad6b7ddc146117a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c328 expref: 27 pid: 3068 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746065078.582299:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.582301:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.582303:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.582308:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582317:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065078.582320:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.582322:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582328:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.582331:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.582332:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881261349120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.582337:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3553 00010000:00010000:3.0:1746065078.582339:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582348:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582354:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc14613f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582379:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065078.582381:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.582384:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.582387:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065078.582389:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582394:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582401:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582406:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b200/0xad6b7ddc14613fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582416:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.582417:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065078.582419:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065078.582426:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349504 00000100:00100000:3.0:1746065078.582429:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349504 00000100:00100000:3.0:1746065078.582444:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8420 00000100:00100000:3.0:1746065078.582448:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+83:26180:x1830881261349504:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.582457:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.582466:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3de expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065078.582481:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.582491:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.582492:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.582497:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 84 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582506:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 84 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.582512:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166200, rc 0) 00000100:00100000:3.0:1746065078.582541:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+84:26180:x1830881261349504:12345-192.168.202.27@tcp:101:bash.0 Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.582546:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8420 00000004:00080000:3.0:1746065078.582585:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4380/2, rc 0, transno 21474839749 00000100:00100000:3.0:1746065078.582590:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262613120:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065078.582755:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582762:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582769:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582790:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582800:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065078.582807:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.582810:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582816:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.582818:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582825:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582833:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582838:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc14613f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.582850:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.582851:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.582852:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065078.583226:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+23:3760:x1830881262612608:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8040us (8131us total) trans 17179872472 rc 0/0 00000100:00100000:1.0:1746065078.583232:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8418 00010000:00010000:2.0:1746065078.583494:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065078.583514:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e7480/2, rc 0, transno 21474839748 00000100:00100000:2.0:1746065078.583518:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262613248:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065078.583531:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.583537:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.583544:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.583551:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.583580:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065078.583667:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+23:3761:x1830881262612736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9517us (10025us total) trans 17179872473 rc 0/0 00000100:00100000:2.0:1746065078.583673:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8412 00010000:00010000:0.0:1746065078.583682:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.583686:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.583691:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.583694:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.583703:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.583712:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.583716:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc14613e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.583727:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.583729:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.583730:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065078.583759:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a0a80/2, rc 0, transno 17179872473 00000100:00100000:2.0:1746065078.583768:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262612736:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065078.583845:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a2d80/2, rc 0, transno 17179872472 00000100:00100000:3.0:1746065078.583849:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262612608:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.585712:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.585766:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349632 00000100:00100000:2.0:1746065078.585794:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349632 00000100:00100000:2.0:1746065078.585840:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8421 00000100:00100000:2.0:1746065078.585847:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+26:26180:x1830881261349632:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.585861:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.585876:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3e5 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.585893:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.585907:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.585909:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.585915:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.585926:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.585938:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6a00, rc 0) 00000100:00100000:2.0:1746065078.585971:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:26180:x1830881261349632:12345-192.168.202.27@tcp:101:bash.0 Request processed in 125us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.585976:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8421 00000100:00100000:0.0:1746065078.593302:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.593351:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.593449:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349888 00000100:00100000:2.0:1746065078.593457:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349888 00002000:00010000:2.0:1746065078.593488:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/847 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.593492:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098580e00 with x1830881261349888 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.593501:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098580e00. 00000100:00100000:2.0:1746065078.593525:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261349760 00000100:00100000:2.0:1746065078.593528:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261349760 00002000:00010000:2.0:1746065078.593536:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/846 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.593538:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098581880 with x1830881261349760 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.593544:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098581880. 00000100:00100000:2.0:1746065078.593554:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1245 00000100:00100000:2.0:1746065078.593560:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261349888:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:1.0:1746065078.593804:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1246 00000100:00100000:1.0:1746065078.593811:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+84:2005:x1830881261349760:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065078.593889:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.593892:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.593894:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.593895:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.593897:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.593947:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+85:2005:x1830881261349760:12345-192.168.202.27@tcp:10:bash.0 Request processed in 130us (588us total) trans 21474839750 rc 0/0 00000100:00100000:1.0:1746065078.593953:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1246 00002000:00010000:1.0:1746065078.593956:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/846 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.593958:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098581880 with x1830881261349760 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.593962:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098581880. 00002000:00010000:2.0:1746065078.594522:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.594525:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.594527:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.594528:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:2.0:1746065078.594530:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065078.594563:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881261349888:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1003us (1269us total) trans 17179872474 rc 0/0 00000100:00100000:2.0:1746065078.594578:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1245 00002000:00010000:2.0:1746065078.594582:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/847 (0->18446744073709551615) 00002000:00100000:2.0:1746065078.594583:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098580e00 with x1830881261349888 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065078.594587:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098580e00. 00000100:00100000:0.0:1746065078.596536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.596652:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261350144 00000100:00100000:2.0:1746065078.596658:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261350144 00000100:00100000:2.0:1746065078.596693:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11972 00000100:00100000:2.0:1746065078.596699:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27862:x1830881261350144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.596716:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.596732:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461413 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3ec expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.596819:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.596829:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.596838:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.596847:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.596852:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.596856:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.597599:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.597608:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.597616:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.597625:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 2 00010000:00010000:2.0:1746065078.598086:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598091:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598096:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598100:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598104:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d8200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.598108:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598113:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598122:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:2.0:1746065078.598125:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.598128:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598133:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f4d8200/0xad6b7ddc146141a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598185:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598193:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598197:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598201:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.598203:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598207:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598213:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:2.0:1746065078.598215:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.598217:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598221:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51b200/0xad6b7ddc1461421 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.598258:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461413 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.598270:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.598276:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065078.598278:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.598280:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51bc00, rc 0) 00000100:00100000:2.0:1746065078.599046:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27862:x1830881261350144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1947us (2114us total) trans 4294975364 rc 0/0 00000100:00100000:2.0:1746065078.599055:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11972 00000100:00100000:1.0:1746065078.599201:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.599603:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261350400 00000100:00100000:2.0:1746065078.599609:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261350400 00000100:00100000:2.0:1746065078.599652:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4124 00000100:00100000:2.0:1746065078.599658:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261350400:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065078.600488:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261350400:12345-192.168.202.27@tcp:35:bash.0 Request processed in 827us (1283us total) trans 4294975365 rc 0/0 00000100:00100000:3.0:1746065078.600495:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4124 00000100:00100000:0.0:1746065078.602122:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.603492:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261350656 00000100:00100000:3.0:1746065078.603506:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261350656 00000100:00100000:3.0:1746065078.603559:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4125 00000100:00100000:3.0:1746065078.603573:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27862:x1830881261350656:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.603814:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27862:x1830881261350656:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 247us (1695us total) trans 4294975366 rc 0/0 00000100:00100000:3.0:1746065078.603821:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4125 00000100:00100000:0.0:1746065078.607232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.607425:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261350912 00000100:00100000:2.0:1746065078.607432:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261350912 00000100:00100000:2.0:1746065078.607471:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11973 00000100:00100000:2.0:1746065078.607478:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27862:x1830881261350912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.607499:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.607660:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461436 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3f3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.607765:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: --/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065078.607811:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.607833:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261351168 00000100:00100000:1.0:1746065078.607840:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261351168 00000100:00100000:1.0:1746065078.607875:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11974 00000100:00100000:1.0:1746065078.607881:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27863:x1830881261351168:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065078.607901:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065078.607959:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.607966:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,1 mode: --/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.608014:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51be00/0xad6b7ddc14613bf lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3d0 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.608018:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.608027:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 276 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.608042:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262614144:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.608042:0:7204:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 276 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.608052:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461387 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3c2 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.608060:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065078.608064:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: --/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.608069:0:7204:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.608074:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.608084:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.608099:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.608105:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.608111:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.608120:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.608126:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.608131:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.608189:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.608194:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.608198:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.608209:0:7204:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.608214:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065078.608441:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00010000:00010000:2.0:1746065078.609322:0:7205:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880098663480 x1830881262614144) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.609330:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c51bc00/0xad6b7ddc1461428 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ec expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.609338:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262614144:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.609348:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065078.609350:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.609354:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.609357:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.609360:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.609363:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.609374:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 5 00010000:00010000:2.0:1746065078.609446:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461436 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.609456:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.609461:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.609464:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:2.0:1746065078.609494:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27862:x1830881261350912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2017us (2273us total) trans 4294975367 rc 0/0 00000100:00100000:2.0:1746065078.609499:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11973 00000100:00100000:0.0:1746065078.611604:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.611813:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261351296 00000100:00100000:2.0:1746065078.611820:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261351296 00010000:00010000:2.0:1746065078.611967:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.612068:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3554 00000100:00100000:2.0:1746065078.612076:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+275:2007:x1830881261351296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.612086:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.612090:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.612099:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.612114:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146143d lrc: 0/0,0 mode: --/CW res: [0x240000403:0x32b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3f3 expref: 275 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.612129:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065078.612132:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.612138:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.612143:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.612242:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.612250:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612255:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065078.612283:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+274:2007:x1830881261351296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 208us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.612289:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3554 00000004:00080000:0.0:1746065078.612447:0:7204:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x32b:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1746065078.612506:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612513:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612519:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612523:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.612526:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612532:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612539:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065078.612541:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065078.612544:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612548:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc1461452 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612588:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612594:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612598:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612603:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612607:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.612609:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612613:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612619:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd200) 00010000:00010000:0.0:1746065078.612621:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.612623:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612626:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc1461444 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065078.612636:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098583800 reply state ffff88012ec8d000 transno 4294975368 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612642:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.612647:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbde00) 00010000:00010000:0.0:1746065078.612649:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065078.612651:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065078.612694:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27863:x1830881261351168:12345-192.168.202.27@tcp:36:rm.0 Request processed in 4812us (4883us total) trans 4294975368 rc 0/0 00000100:00100000:0.0:1746065078.612700:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11974 00000100:00100000:0.0:1746065078.615874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.615980:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261351424 00000100:00100000:2.0:1746065078.615986:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261351424 00000100:00100000:2.0:1746065078.616038:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11975 00000100:00100000:2.0:1746065078.616044:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27862:x1830881261351424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.616069:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.616089:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461460 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c3fa expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.616350:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461467 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.616361:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461467 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.616370:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461467 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065078.616403:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 5 00000004:00200000:2.0:1746065078.616407:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065078.616418:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461467 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.616439:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461460 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3fa expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.616450:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461467 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3fa expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.616456:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:2.0:1746065078.616458:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065078.616461:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d400, rc 0) 00000100:00100000:2.0:1746065078.616503:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27862:x1830881261351424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 458us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.616509:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11975 00000100:00100000:0.0:1746065078.619166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.619203:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261351680 00000100:00100000:3.0:1746065078.619211:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261351680 00000100:00100000:3.0:1746065078.619274:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11976 00000100:00100000:3.0:1746065078.619281:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27862:x1830881261351680:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.619297:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.619313:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc146146e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c401 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.619392:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461475 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.619402:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461475 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.619410:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461475 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.619419:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 5 00010000:00010000:3.0:1746065078.619499:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc146146e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c401 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.619528:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461475 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c401 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.619534:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:3.0:1746065078.619537:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065078.619540:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:3.0:1746065078.619584:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27862:x1830881261351680:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 304us (426us total) trans 4294975369 rc 0/0 00000100:00100000:3.0:1746065078.619590:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11976 00000100:00100000:1.0:1746065078.622862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.623288:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261351808 00000100:00100000:2.0:1746065078.623496:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261351808 00000100:00100000:1.0:1746065078.623608:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.623633:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261351936 00000100:00100000:0.0:1746065078.623637:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261351936 00000100:00100000:0.0:1746065078.623668:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8422 00000100:00100000:0.0:1746065078.623674:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+85:2005:x1830881261351936:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065078.623712:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.623727:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 85 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.623733:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065078.623735:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065078.623737:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.623766:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 85 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.623816:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 85 pid: 3068 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.623829:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262614272:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.623934:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11977 00000100:00100000:0.0:1746065078.623938:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.623940:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27864:x1830881261351808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.623950:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.623963:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146148a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c408 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.624074:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.624085:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.624094:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.624101:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.624106:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.624110:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.624140:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625023:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625030:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625036:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625040:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.625044:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625049:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625058:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800928a2400) 00010000:00010000:2.0:1746065078.625061:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.625064:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625069:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461491 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625078:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625083:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625087:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625091:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.625092:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625096:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625102:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbde00) 00010000:00010000:2.0:1746065078.625104:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.625106:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625110:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7800/0xad6b7ddc1461498 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.625135:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146148a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c408 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.625146:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc146148a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c408 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.625157:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:2.0:1746065078.625646:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27864:x1830881261351808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1704us (2789us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.625652:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11977 00000100:00100000:1.0:1746065078.625726:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262614272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.625742:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.625937:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.625989:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261352064 00000100:00100000:3.0:1746065078.625994:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261352064 00002000:00100000:3.0:1746065078.626017:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (0->4) req@ffff88008f3e5500 x1830881261352064/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:749/0 lens 496/0 e 0 to 0 dl 1746065089 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065078.626026:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881261352064 ext(0->4) 00010000:00010000:3.0:1746065078.626032:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 86 pid: 3068 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.626041:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 86 pid: 3068 timeout: 774 lvb_type: 0 00002000:00010000:3.0:1746065078.626047:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e5500 00000100:00100000:3.0:1746065078.626071:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 213 00000100:00100000:3.0:1746065078.626077:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+86:2005:x1830881261352064:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:3.0:1746065078.628199:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+88:2005:x1830881261352064:12345-192.168.202.27@tcp:4:bash.0 Request processed in 2115us (2256us total) trans 21474839751 rc 0/0 00000100:00100000:3.0:1746065078.628207:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 213 00002000:00100000:3.0:1746065078.628216:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (0->4) req@ffff88008f3e5500 x1830881261352064/t21474839751(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:749/0 lens 496/448 e 0 to 0 dl 1746065089 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065078.628224:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881261352064 ext(0->4) 00010000:00010000:3.0:1746065078.628231:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 88 pid: 3068 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.628244:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 88 pid: 3068 timeout: 774 lvb_type: 0 00002000:00010000:3.0:1746065078.628249:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e5500 00000100:00100000:0.0:1746065078.628311:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.628543:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261352192 00000100:00100000:2.0:1746065078.628549:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261352192 00000100:00100000:2.0:1746065078.628599:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11978 00000100:00100000:2.0:1746065078.628607:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27864:x1830881261352192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.628625:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.628640:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146149f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c40f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.629090:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.629102:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629111:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629118:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.629123:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629132:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629163:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629168:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629172:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629177:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629181:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.629184:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629189:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629196:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:2.0:1746065078.629199:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.629201:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629205:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629215:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629218:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629223:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629226:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.629228:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629232:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629237:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbde00) 00010000:00010000:2.0:1746065078.629239:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.629242:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629245:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61c00/0xad6b7ddc14614ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.629266:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146149f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c40f expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.629272:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146149f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c40f expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.629281:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:2.0:1746065078.629687:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27864:x1830881261352192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1080us (1375us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.629693:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11978 00000100:00100000:0.0:1746065078.630527:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.630602:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261352320 00000100:00100000:2.0:1746065078.630607:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261352320 00010000:00010000:2.0:1746065078.630632:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 88 pid: 3068 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.630664:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3555 00000100:00100000:2.0:1746065078.630670:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+88:2004:x1830881261352320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.630679:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065078.630691:0:7190:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1746065078.630694:0:7190:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065078.630698:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 88 pid: 3068 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.630707:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 88 pid: 3068 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.630720:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136166200/0xad6b7ddc1461405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3de expref: 88 pid: 3068 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.630731:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.630733:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.630737:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.630744:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.630763:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.630822:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+87:2004:x1830881261352320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 152us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.630830:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3555 00010000:00010000:0.0:1746065078.631059:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631067:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631081:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631088:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631094:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631098:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.631101:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631106:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631114:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.631119:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc1461483 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.631155:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+86:2005:x1830881261351936:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 7481us (7547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.631163:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8422 00000100:00100000:1.0:1746065078.632466:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.632523:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.632802:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261352448 00000100:00100000:2.0:1746065078.632807:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261352448 00000100:00100000:2.0:1746065078.632832:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261352704 00000100:00100000:2.0:1746065078.632834:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261352704 00000100:00100000:2.0:1746065078.632845:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11979 00000100:00100000:2.0:1746065078.632851:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27864:x1830881261352448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.632864:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.632878:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14614b4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c416 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.632930:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14614bb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.632940:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14614bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.632947:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14614bb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065078.632986:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065078.632990:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065078.633013:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60c00/0xad6b7ddc14614b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c416 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.633024:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14614bb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c416 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.633030:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065078.633033:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065078.633035:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000100:00100000:3.0:1746065078.633048:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11980 00000100:00100000:3.0:1746065078.633055:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27862:x1830881261352704:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065078.633075:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065078.633075:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27864:x1830881261352448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 224us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.633080:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11979 00010000:00010000:3.0:1746065078.633085:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461467 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3fa expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.633097:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:3.0:1746065078.633099:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.633114:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.633354:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.633361:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:3.0:1746065078.633973:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2362, 88 off195720 00000004:00080000:3.0:1746065078.633980:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674652205834ns, next at 675481534386ns, rc = 0 00000040:00080000:3.0:1746065078.634017:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2366, 88 off196176 00000004:00080000:3.0:1746065078.634021:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674652247551ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065078.634274:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2367, 88 off196264 00000004:00080000:3.0:1746065078.634279:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674652505422ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065078.634291:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2363, 88 off195808 00000004:00080000:3.0:1746065078.634294:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674652520047ns, next at 675481534386ns, rc = 0 00000100:00100000:3.0:1746065078.637377:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.637578:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261352832 00000100:00100000:2.0:1746065078.637586:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261352832 00000100:00100000:2.0:1746065078.637622:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11981 00000100:00100000:2.0:1746065078.637628:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27864:x1830881261352832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.637645:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.637660:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc14614c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c41d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.637708:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.637718:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637726:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637734:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.637738:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637743:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637769:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637798:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637802:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637808:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637812:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.637815:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637821:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637831:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065078.637834:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.637837:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637842:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637851:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637855:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637859:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637863:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.637865:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637869:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637874:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbde00) 00010000:00010000:2.0:1746065078.637876:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.637877:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637881:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.637901:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc14614c9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c41d expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.637908:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc14614c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c41d expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.637913:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f800, rc 0) 00000100:00100000:2.0:1746065078.637952:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27864:x1830881261352832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 324us (583us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.637957:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11981 00000001:00080000:0.0:1746065078.638074:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975370 is committed 00000004:00080000:0.0:1746065078.638079:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1590 committed 00000004:00080000:0.0:1746065078.638084:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1600 committed 00000004:00080000:0.0:1746065078.638096:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1599 committed 00000004:00080000:0.0:1746065078.638098:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1589 committed 00010000:00010000:0.0:1746065078.638123:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.638128:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.638132:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.638135:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.638137:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.638141:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.638147:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbde00) 00010000:00010000:0.0:1746065078.638149:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.638150:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.638154:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488000/0xad6b7ddc146144b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:3.0:1746065078.638553:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262614400:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.638594:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746065078.638650:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f3e6680 reply state ffff88012bff8c00 transno 4294975370 ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638659:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638663:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:3.0:1746065078.638665:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065078.638667:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065078.638707:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065078.638715:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27862:x1830881261352704:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 5661us (6192us total) trans 4294975370 rc 0/0 00000100:00100000:3.0:1746065078.638720:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11980 00010000:00010000:3.0:1746065078.638736:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638741:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638750:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638754:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.638756:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638760:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638766:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:3.0:1746065078.638768:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065078.638770:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.638791:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167200/0xad6b7ddc14614c2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065078.638836:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065078.638842:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262614528:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.638861:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.638913:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262614400 00000100:00100000:1.0:1746065078.638918:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262614400 00000100:00100000:1.0:1746065078.638938:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262614528 00000100:00100000:1.0:1746065078.638940:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262614528 00000100:00100000:1.0:1746065078.638951:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8423 00000100:00100000:1.0:1746065078.638956:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+218:3760:x1830881262614400:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.639056:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+219:3760:x1830881262614400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 100us (461us total) trans 21474839752 rc 0/0 00000100:00100000:1.0:1746065078.639061:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8423 00000100:00100000:1.0:1746065078.639070:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8424 00000100:00100000:1.0:1746065078.639073:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+218:3762:x1830881262614528:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065078.639106:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.639109:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.639111:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.639112:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.639114:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.639128:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+219:3762:x1830881262614528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 55us (266us total) trans 21474839753 rc 0/0 00000100:00100000:1.0:1746065078.639133:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8424 00000004:00080000:0.0:1746065078.639371:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e7800/2, rc 0, transno 21474839752 00000100:00100000:0.0:1746065078.639376:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262614400:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065078.639388:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4000/2, rc 0, transno 21474839753 00000100:00100000:0.0:1746065078.639391:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262614528:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.639593:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262614656:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.639613:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.640591:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262614784:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.640616:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.640670:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262614656 00000100:00100000:3.0:1746065078.640674:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262614656 00000100:00100000:3.0:1746065078.640695:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262614784 00000100:00100000:3.0:1746065078.640696:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262614784 00000100:00100000:3.0:1746065078.640705:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8425 00000100:00100000:3.0:1746065078.640710:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+24:3762:x1830881262614656:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065078.640809:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.640811:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:3.0:1746065078.640813:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.640815:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:3.0:1746065078.640817:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.640837:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3762:x1830881262614656:12345-0@lo:2:osp-syn-1-1.0 Request processed in 127us (1223us total) trans 17179872475 rc 0/0 00000100:00100000:3.0:1746065078.640843:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8425 00000100:00100000:3.0:1746065078.640852:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8426 00000100:00100000:3.0:1746065078.640856:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+24:3759:x1830881262614784:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065078.640885:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.640887:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.640889:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.640890:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.640893:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.640908:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3759:x1830881262614784:12345-0@lo:2:osp-syn-1-1.0 Request processed in 53us (291us total) trans 17179872476 rc 0/0 00000100:00100000:3.0:1746065078.640913:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8426 00000004:00080000:1.0:1746065078.641014:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098661880/2, rc 0, transno 17179872476 00000100:00100000:1.0:1746065078.641018:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262614784:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065078.641164:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098663480/2, rc 0, transno 17179872475 00000100:00100000:1.0:1746065078.641168:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262614656:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.653096:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.653125:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.653883:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261353216 00000100:00100000:0.0:1746065078.653892:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261353216 00000100:00100000:2.0:1746065078.653914:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261353088 00000100:00100000:2.0:1746065078.653918:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261353088 00000100:00100000:0.0:1746065078.653931:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11982 00000100:00100000:2.0:1746065078.653935:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11983 00000100:00100000:0.0:1746065078.653937:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27862:x1830881261353216:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065078.653939:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27864:x1830881261353088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.653954:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.653957:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065078.653963:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.653976:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c42b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.653978:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc14614bb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c416 expref: 270 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.653992:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065078.653999:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.654004:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614e5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c424 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.654021:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.654030:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 271 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.654041:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:0.0:1746065078.654043:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065078.654045:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00010000:00010000:2.0:1746065078.654070:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.654076:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654082:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065078.654084:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+271:27862:x1830881261353216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 147us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.654089:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11982 00010000:00010000:2.0:1746065078.654091:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.654095:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654100:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654361:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.654368:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654374:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065078.654384:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32d:0x0]: returning size 0 00010000:00010000:2.0:1746065078.654403:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654407:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654412:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654417:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654421:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.654424:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654428:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654434:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e1fc300) 00010000:00010000:2.0:1746065078.654435:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.654438:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654441:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc14614ec lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065078.654448:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834d500 reply state ffff88012be24000 transno 4294975371 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654453:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.654461:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e1fcf00) 00010000:00010000:2.0:1746065078.654462:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.654464:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065078.654481:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14614e5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.654493:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.654497:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff88008f379800) 00010000:00010000:2.0:1746065078.654499:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.654500:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:2.0:1746065078.654519:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:27864:x1830881261353088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 579us (1394us total) trans 4294975371 rc 0/0 00000100:00100000:2.0:1746065078.654523:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11983 00000100:00100000:0.0:1746065078.657088:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.657661:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261353472 00000100:00100000:3.0:1746065078.657669:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261353472 00000100:00100000:3.0:1746065078.657720:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11984 00000100:00100000:3.0:1746065078.657727:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27864:x1830881261353472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.657745:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.657760:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461508 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c432 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.657933:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.657945:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.657951:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.657975:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.657986:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 273 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.657996:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262614912:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065078.658025:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.658085:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.658268:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261353600 00000100:00100000:2.0:1746065078.658272:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261353600 00000100:00100000:2.0:1746065078.658291:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11985 00000100:00100000:2.0:1746065078.658296:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27862:x1830881261353600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.658303:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.658310:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc1461516 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c439 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.658339:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146151d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065078.658346:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146151d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.658358:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146151d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065078.658378:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32b:0x0]: returning size 5 00000004:00200000:2.0:1746065078.658382:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065078.658393:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146151d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065078.658410:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f60a00/0xad6b7ddc1461516 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c439 expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.658435:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146151d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c439 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.658442:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:2.0:1746065078.658444:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065078.658446:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fc00, rc 0) 00000100:00100000:2.0:1746065078.658469:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27862:x1830881261353600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.658475:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11985 00000100:00100000:3.0:1746065078.661500:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262614912:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.661517:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065078.661655:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.661728:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.661799:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261353728 00000100:00100000:1.0:1746065078.661805:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261353728 00000100:00100000:1.0:1746065078.661838:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8427 00000100:00100000:1.0:1746065078.661844:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+86:2004:x1830881261353728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.661857:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.661872:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c440 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065078.661890:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 5, mtime: 0x6812d6b6, atime: 0x0, ctime: 0x6812d6b6, blocks: 0x8 00010000:00010000:1.0:1746065078.661902:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.661904:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.661910:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 87 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.661926:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 87 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.661934:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d600, rc 0) 00000100:00100000:1.0:1746065078.661979:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+87:2004:x1830881261353728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 135us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.661985:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8427 00000100:00100000:2.0:1746065078.662216:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261353856 00000100:00100000:2.0:1746065078.662220:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261353856 00010000:00010000:2.0:1746065078.662236:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 275 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.662253:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3556 00000100:00100000:2.0:1746065078.662257:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+275:2004:x1830881261353856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.662265:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.662270:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 275 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.662278:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 275 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.662292:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61000/0xad6b7ddc14614fa lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c424 expref: 275 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.662305:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff88008f379800) 00010000:00010000:2.0:1746065078.662309:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662315:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662321:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662335:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.662354:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261353856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.662360:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3556 00010000:00010000:2.0:1746065078.662394:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662399:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.662417:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32d:0x0]: returning size 0 00000100:00100000:2.0:1746065078.662536:0:11456:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:11456:1830881262615040:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1746065078.662561:0:11456:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065078.662589:0:11456:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00000004:00080000:2.0:1746065078.662643:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x351:0x0], index 1: 0 00000004:00080000:2.0:1746065078.662648:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x350:0x0], index 0: 0 00000100:00100000:3.0:1746065078.662650:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615040 00000004:00080000:2.0:1746065078.662651:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x351:0x0], index 0: 0 00000100:00100000:3.0:1746065078.662654:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615040 00000004:00080000:2.0:1746065078.662655:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x352:0x0], index 1: 0 00000100:00100000:3.0:1746065078.662672:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8428 00000100:00100000:3.0:1746065078.662677:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:11456:x1830881262615040:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1746065078.662701:0:3068:0:(ofd_dev.c:1633:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 866 00010000:00010000:2.0:1746065078.662731:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662738:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662743:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662747:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.662751:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662756:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662762:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff88008f379800) 00010000:00010000:2.0:1746065078.662764:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.662767:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662771:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc146150f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.662821:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461508 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c432 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.662827:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461508 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c432 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.662838:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779e00, rc 0) 00000100:00100000:2.0:1746065078.662858:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27864:x1830881261353472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5132us (5779us total) trans 4294975372 rc 301/301 00000100:00100000:2.0:1746065078.662864:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11984 00000100:00100000:3.0:1746065078.664984:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:11456:x1830881262615040:12345-0@lo:5:osp-pre-1-1.0 Request processed in 2304us (2419us total) trans 17179872477 rc 0/0 00000100:00100000:3.0:1746065078.664993:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8428 00000100:00100000:2.0:1746065078.665300:0:11456:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:11456:1830881262615040:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1746065078.665311:0:11456:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x352:0x0]-[0x2c0000400:0x381:0x0] 00000100:00100000:0.0:1746065078.665675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.665735:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.665984:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261354240 00000100:00100000:3.0:1746065078.665988:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261354240 00000100:00100000:3.0:1746065078.666009:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8429 00000100:00100000:3.0:1746065078.666013:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+87:2007:x1830881261354240:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065078.666194:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261354112 00000100:00100000:2.0:1746065078.666198:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261354112 00000100:00100000:2.0:1746065078.666225:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4126 00000100:00100000:2.0:1746065078.666229:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27864:x1830881261354112:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.666676:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+87:2007:x1830881261354240:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 660us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.666682:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8429 00000100:00100000:2.0:1746065078.666895:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27864:x1830881261354112:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 665us (1222us total) trans 4294975373 rc 0/0 00000100:00100000:2.0:1746065078.666901:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4126 00000100:00100000:0.0:1746065078.668316:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.668597:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261354496 00000100:00100000:2.0:1746065078.668602:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261354496 00000100:00100000:2.0:1746065078.668638:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4127 00000100:00100000:2.0:1746065078.668644:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27864:x1830881261354496:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.668764:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27864:x1830881261354496:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 119us (451us total) trans 4294975374 rc 0/0 00000100:00100000:2.0:1746065078.668769:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4127 00000100:00100000:1.0:1746065078.669201:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.669335:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261354624 00000100:00100000:0.0:1746065078.669338:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261354624 00000100:00100000:0.0:1746065078.669455:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8430 00000100:00100000:0.0:1746065078.669461:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+87:2006:x1830881261354624:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065078.669686:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+87:2006:x1830881261354624:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 225us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.669693:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8430 00000100:00100000:0.0:1746065078.674227:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.675267:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261354880 00000100:00100000:2.0:1746065078.675275:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261354880 00000100:00100000:2.0:1746065078.675318:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11986 00000100:00100000:2.0:1746065078.675326:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261354880:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.675348:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.675364:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc1461532 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c447 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.675486:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.675497:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675506:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675515:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.675521:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675526:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675564:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461547 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.675581:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461547 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675587:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461547 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.675596:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32d:0x0]: returning size 0 00010000:00010000:2.0:1746065078.675656:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675665:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675670:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675676:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675682:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095778600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.675685:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675690:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675699:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b48d2700) 00010000:00010000:2.0:1746065078.675702:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.675705:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675709:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095778600/0xad6b7ddc1461539 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675719:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675724:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675728:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675732:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.675735:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675739:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675744:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e1fcf00) 00010000:00010000:2.0:1746065078.675746:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.675748:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675752:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461540 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.675793:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc1461532 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c447 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.675806:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461547 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c447 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.675811:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:2.0:1746065078.675813:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.675814:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3400, rc 0) 00000100:00100000:2.0:1746065078.675862:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261354880:12345-192.168.202.27@tcp:101:bash.0 Request processed in 538us (1642us total) trans 4294975375 rc 0/0 00000100:00100000:2.0:1746065078.675867:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11986 00000100:00100000:2.0:1746065078.677345:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.677728:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261355136 00000100:00100000:0.0:1746065078.677797:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261355136 00000100:00100000:0.0:1746065078.677845:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11987 00000100:00100000:0.0:1746065078.677852:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27862:x1830881261355136:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065078.677890:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.677908:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc146151d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c439 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.677927:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:0.0:1746065078.677930:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.677953:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065078.677961:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.677968:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00010000:0.0:1746065078.678052:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098662d80 reply state ffff88011daae000 transno 4294975376 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.678064:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.678069:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:0.0:1746065078.678071:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065078.678073:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065078.678143:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:27862:x1830881261355136:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 290us (801us total) trans 4294975376 rc 0/0 00000100:00100000:0.0:1746065078.678150:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11987 00000100:00100000:0.0:1746065078.680876:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.680931:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261355264 00000100:00100000:2.0:1746065078.680939:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261355264 00000100:00100000:0.0:1746065078.680982:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.680991:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11988 00000100:00100000:2.0:1746065078.680998:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261355264:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.681018:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.681034:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146155c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c44e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.681226:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261355392 00000100:00100000:1.0:1746065078.681230:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261355392 00000100:00100000:1.0:1746065078.681252:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8431 00000100:00100000:1.0:1746065078.681257:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+87:2004:x1830881261355392:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065078.681357:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065078.681360:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:1.0:1746065078.681362:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.681363:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:1.0:1746065078.681366:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065078.681405:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+88:2004:x1830881261355392:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 148us (423us total) trans 21474839754 rc 0/0 00000100:00100000:1.0:1746065078.681411:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8431 00010000:00010000:2.0:1746065078.681469:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461563 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.681480:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461563 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.681490:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461563 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.681579:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146155c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c44e expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.681593:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461563 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c44e expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.681599:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:2.0:1746065078.681601:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065078.681604:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:2.0:1746065078.681626:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261355264:12345-192.168.202.27@tcp:101:bash.0 Request processed in 630us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.681632:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11988 00000100:00100000:0.0:1746065078.687462:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.687515:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.687695:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261355904 00000100:00100000:2.0:1746065078.687704:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261355904 00000100:00100000:3.0:1746065078.690385:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261355648 00000100:00100000:3.0:1746065078.690397:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261355648 00000100:00100000:2.0:1746065078.690468:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11989 00000100:00100000:2.0:1746065078.690478:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261355904:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065078.690528:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.690550:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461547 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c447 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.690579:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:2.0:1746065078.690583:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065078.690662:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4128 00000100:00100000:3.0:1746065078.690668:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27862:x1830881261355648:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:3.0:1746065078.690693:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x32b:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461475 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c401 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.690728:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.690739:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.690747:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065078.690798:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975377 00000004:00010000:2.0:1746065078.690814:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955ce300 reply state ffff88008d93a000 transno 4294975378 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.690821:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.690826:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:2.0:1746065078.690828:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.690830:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065078.690905:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261355904:12345-192.168.202.27@tcp:36:bash.0 Request processed in 429us (3453us total) trans 4294975378 rc 0/0 00000100:00100000:2.0:1746065078.690911:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11989 00000020:00080000:2.0:1746065078.690915:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1746065078.691142:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:3.0:1746065078.691153:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.691159:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.691182:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.691192:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 281 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.691202:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262615168:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.691278:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.698709:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.698995:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262615168:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.699013:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000100:00100000:0.0:1746065078.699145:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.699203:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261356032 00000100:00100000:1.0:1746065078.699204:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261356160 00000100:00100000:2.0:1746065078.699209:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261356032 00000100:00100000:1.0:1746065078.699209:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261356160 00010000:00010000:1.0:1746065078.699238:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 283 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.699244:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11990 00000100:00100000:2.0:1746065078.699249:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261356032:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065078.699269:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3557 00000100:00100000:1.0:1746065078.699275:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+283:2005:x1830881261356160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065078.699285:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.699290:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 283 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.699300:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 283 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.699319:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4a00/0xad6b7ddc14614de lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c42b expref: 283 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.699333:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:1.0:1746065078.699337:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.699345:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.699350:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.699366:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.699371:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.699377:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000100:00100000:1.0:1746065078.699403:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+282:2005:x1830881261356160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.699459:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3557 00000040:00080000:3.0:1746065078.699805:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2364, 88 off195896 00000004:00080000:3.0:1746065078.699810:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674718036252ns, next at 675481534386ns, rc = 0 00000040:00080000:3.0:1746065078.699841:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2368, 88 off196352 00000004:00080000:3.0:1746065078.699843:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674718069949ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065078.699876:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2369, 88 off196440 00000004:00080000:3.0:1746065078.699879:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674718105315ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065078.699888:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2365, 88 off195984 00000004:00080000:3.0:1746065078.699890:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674718117010ns, next at 675481534386ns, rc = 0 00010000:00010000:2.0:1746065078.700522:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.700536:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461578 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c455 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.700581:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461578 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c455 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.700590:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461578 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c455 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.700603:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:2.0:1746065078.700605:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.700608:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779e00, rc 0) 00000100:00100000:2.0:1746065078.700635:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261356032:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1386us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.700640:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11990 00000001:00080000:3.0:1746065078.704094:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975379 is committed 00000004:00080000:3.0:1746065078.704104:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1592 committed 00000004:00080000:3.0:1746065078.704110:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1602 committed 00000004:00080000:3.0:1746065078.704114:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1601 committed 00000004:00080000:3.0:1746065078.704116:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1591 committed 00000004:00010000:3.0:1746065078.704163:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955cc700 reply state ffff88009df67000 transno 4294975379 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.704181:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.704187:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:3.0:1746065078.704189:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065078.704193:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065078.704198:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:3.0:1746065078.704200:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065078.704207:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1461475 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c401 expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.704241:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065078.704250:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262615424:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.704254:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262615296:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.704451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065078.704626:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704634:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704639:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704643:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.704646:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704654:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704662:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e1fcf00) 00010000:00010000:0.0:1746065078.704663:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.704665:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704669:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc14614f3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065078.704675:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065078.704687:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704691:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704695:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704698:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.704699:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704703:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704707:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:0.0:1746065078.704708:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.704710:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704713:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de5800/0xad6b7ddc1461555 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704721:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704725:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704728:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704731:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.704733:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704736:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704741:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:0.0:1746065078.704742:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.704744:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.704747:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc146156a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065078.704798:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.704836:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615296 00000100:00100000:1.0:1746065078.704841:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615296 00010000:00080000:3.0:1746065078.704849:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065078.704857:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+270:27862:x1830881261355648:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 14189us (17342us total) trans 4294975379 rc 0/0 00000100:00100000:3.0:1746065078.704868:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4128 00000100:00100000:1.0:1746065078.704868:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615424 00000100:00100000:1.0:1746065078.704870:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615424 00000100:00100000:1.0:1746065078.704890:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8432 00000100:00100000:3.0:1746065078.704894:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8433 00000100:00100000:1.0:1746065078.704895:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+220:3759:x1830881262615296:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.704899:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+220:3761:x1830881262615424:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065078.705005:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.705008:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.705009:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065078.705010:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.705011:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.705011:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:3.0:1746065078.705013:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1746065078.705014:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746065078 -> 1746065078 00002000:00010000:1.0:1746065078.705015:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:1.0:1746065078.705017:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065078.705035:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+222:3761:x1830881262615424:12345-0@lo:2:osp-syn-0-1.0 Request processed in 136us (237us total) trans 21474839756 rc 0/0 00000100:00100000:3.0:1746065078.705039:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8433 00000100:00100000:1.0:1746065078.705042:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+222:3759:x1830881262615296:12345-0@lo:2:osp-syn-0-1.0 Request processed in 146us (592us total) trans 21474839755 rc 0/0 00000100:00100000:1.0:1746065078.705047:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8432 00000004:00080000:3.0:1746065078.705067:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223480/2, rc 0, transno 21474839756 00000004:00080000:1.0:1746065078.705070:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222300/2, rc 0, transno 21474839755 00000100:00100000:3.0:1746065078.705072:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262615424:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.705073:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262615296:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065078.705094:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261356416 00010000:00010000:0.0:1746065078.705137:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065078.705143:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065078.705146:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065078.705150:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.705152:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065078.705157:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065078.705164:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff8800928a2c00) 00010000:00010000:0.0:1746065078.705166:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065078.705168:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065078.705172:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1461571 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00000100:00100000:3.0:1746065078.705363:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261356416 00000100:00100000:3.0:1746065078.705386:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11991 00000100:00100000:3.0:1746065078.705390:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+270:26180:x1830881261356416:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.705400:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.705402:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065078.705414:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461578 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c455 expref: 270 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.705422:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:3.0:1746065078.705424:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.705430:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc146157f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c45c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.705460:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461586 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.705467:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461586 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.705473:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461586 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065078.707180:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.707224:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261356544 00000100:00100000:1.0:1746065078.707229:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261356544 00000100:00100000:1.0:1746065078.707254:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11992 00000100:00100000:1.0:1746065078.707259:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+270:27862:x1830881261356544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.707274:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065078.707288:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262615552:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.707318:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.707347:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262615680:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.707362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.707380:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615552 00000100:00100000:1.0:1746065078.707383:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615552 00000100:00100000:1.0:1746065078.707397:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615680 00000100:00100000:1.0:1746065078.707399:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615680 00000100:00100000:1.0:1746065078.707429:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8434 00000100:00100000:1.0:1746065078.707434:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+27:3762:x1830881262615552:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.707439:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8435 00000100:00100000:3.0:1746065078.707447:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+27:3759:x1830881262615680:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065078.707525:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.707527:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.707527:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb mtime from disk: 1746065078 -> 1746065078 00002000:00010000:3.0:1746065078.707530:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.707530:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.707532:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.707532:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb ctime from disk: 1746065078 -> 1746065078 00002000:00010000:3.0:1746065078.707533:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.707534:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x34f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1746065078.707535:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x350:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.707559:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3762:x1830881262615552:12345-0@lo:2:osp-syn-1-1.0 Request processed in 125us (240us total) trans 17179872478 rc 0/0 00000100:00100000:3.0:1746065078.707561:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3759:x1830881262615680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 116us (198us total) trans 17179872479 rc 0/0 00000100:00100000:1.0:1746065078.707573:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8434 00000100:00100000:3.0:1746065078.707576:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8435 00000004:00080000:1.0:1746065078.707602:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098662a00/2, rc 0, transno 17179872478 00000004:00080000:3.0:1746065078.707606:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098660e00/2, rc 0, transno 17179872479 00000100:00100000:1.0:1746065078.707606:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262615552:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065078.707609:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262615680:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065078.707624:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146158d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c463 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.707658:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146158d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c463 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.707668:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7a00/0xad6b7ddc146158d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c463 expref: 271 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.707679:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012edbdf00) 00010000:00010000:1.0:1746065078.707682:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065078.707684:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7a00, rc 0) 00000040:00080000:3.0:1746065078.707706:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2370, 88 off196528 00000004:00080000:3.0:1746065078.707711:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674725936993ns, next at 675481510748ns, rc = 0 00000100:00100000:1.0:1746065078.707725:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27862:x1830881261356544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 465us (550us total) trans 0 rc 0/0 00000040:00080000:3.0:1746065078.707727:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2366, 88 off196072 00000004:00080000:3.0:1746065078.707729:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674725955998ns, next at 675481534386ns, rc = 0 00000100:00100000:1.0:1746065078.707730:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11992 00000040:00080000:3.0:1746065078.707755:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2367, 88 off196160 00000004:00080000:3.0:1746065078.707757:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674725983833ns, next at 675481534386ns, rc = 0 00000040:00080000:3.0:1746065078.707853:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2372, 88 off196696 00000004:00080000:3.0:1746065078.707858:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674726084052ns, next at 675481510748ns, rc = 0 00000100:00100000:1.0:1746065078.718350:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.719123:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261356800 00000100:00100000:3.0:1746065078.719131:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261356800 00000100:00100000:3.0:1746065078.719180:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4129 00000100:00100000:3.0:1746065078.719188:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27862:x1830881261356800:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065078.719543:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x32b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1746065078.720496:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975380 is committed 00000004:00080000:2.0:1746065078.720503:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1604 committed 00000004:00080000:2.0:1746065078.720518:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1594 committed 00000004:00080000:2.0:1746065078.720524:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1593 committed 00000004:00080000:2.0:1746065078.720526:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1603 committed 00000100:00100000:0.0:1746065078.722012:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262615808:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.722068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.722166:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065078.722174:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262615936:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.722196:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.722268:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615808 00000100:00100000:0.0:1746065078.722275:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615808 00000100:00100000:0.0:1746065078.722311:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262615936 00000100:00100000:0.0:1746065078.722313:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262615936 00000100:00100000:0.0:1746065078.722328:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8436 00000100:00100000:0.0:1746065078.722333:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+29:3760:x1830881262615808:12345-0@lo:2:osp-syn-1-1.0 00000040:00080000:3.0:1746065078.722348:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2368, 64 off196224 00000040:00080000:3.0:1746065078.722371:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2373, 64 off196760 00000040:00080000:3.0:1746065078.722378:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2374, 64 off196824 00000040:00080000:3.0:1746065078.722384:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2369, 64 off196288 00010000:00010000:3.0:1746065078.722431:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:3.0:1746065078.722442:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7206 initiator: MDT1 00000100:00100000:0.0:1746065078.722446:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+30:3760:x1830881262615808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 112us (377us total) trans 17179872480 rc 0/0 00010000:00010000:3.0:1746065078.722452:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00000100:00100000:0.0:1746065078.722452:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8436 00010000:00010000:3.0:1746065078.722458:0:7206:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.722463:0:7206:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.722467:0:7206:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065078.722479:0:7206:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1746065078.722481:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955cd880/2, rc 0, transno 17179872480 00000100:00100000:0.0:1746065078.722488:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262615808:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.722510:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8437 00000100:00100000:0.0:1746065078.722516:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3762:x1830881262615936:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.722581:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3762:x1830881262615936:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (384us total) trans 17179872481 rc 0/0 00000100:00100000:0.0:1746065078.722586:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8437 00000100:00100000:3.0:1746065078.722627:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+272:27862:x1830881261356800:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 3439us (4284us total) trans 4294975381 rc 0/0 00010000:00010000:1.0:1746065078.722632:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1746065078.722637:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4129 00010000:00010000:1.0:1746065078.722638:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.722643:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.722646:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.722652:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.722662:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32b:0x0].0x0 (ffff88012edbdf00) 00010000:00010000:1.0:1746065078.722664:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065078.722667:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.722671:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461594 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x32b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065078.722683:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.722684:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.722685:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065078.722694:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262616064:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.722712:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065078.722729:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955cdc00/2, rc 0, transno 17179872481 00000100:00100000:1.0:1746065078.722734:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262615936:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065078.722735:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461586 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c45c expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.722742:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:3.0:1746065078.722744:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746065078.722751:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616064 00000100:00100000:1.0:1746065078.722754:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616064 00010000:00010000:3.0:1746065078.722755:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc146157f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c45c expref: 272 pid: 7205 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1746065078.722770:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8438 00010000:00010000:3.0:1746065078.722786:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461586 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c45c expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.722793:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+221:3762:x1830881262616064:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065078.722804:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:3.0:1746065078.722806:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065078.722808:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53d1000, rc 0) 00000100:00100000:3.0:1746065078.722825:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261356416:12345-192.168.202.27@tcp:101:bash.0 Request processed in 17434us (18151us total) trans 4294975380 rc 0/0 00000100:00100000:3.0:1746065078.722830:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11991 00000100:00100000:1.0:1746065078.722862:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+222:3762:x1830881262616064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 70us (149us total) trans 21474839757 rc 0/0 00000100:00100000:1.0:1746065078.722867:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8438 00000004:00080000:1.0:1746065078.722888:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834e300/2, rc 0, transno 21474839757 00000100:00100000:1.0:1746065078.722900:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262616064:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.722990:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262616192:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.723016:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.723435:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616192 00000100:00100000:0.0:1746065078.723439:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616192 00000100:00100000:0.0:1746065078.724113:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8439 00000100:00100000:0.0:1746065078.724203:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+222:3759:x1830881262616192:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.724905:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+223:3759:x1830881262616192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 786us (1887us total) trans 21474839758 rc 0/0 00000100:00100000:0.0:1746065078.724912:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8439 00000004:00080000:3.0:1746065078.725018:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85d880/2, rc 0, transno 21474839758 00000100:00100000:3.0:1746065078.725529:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262616192:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.731143:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.731258:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261356928 00000100:00100000:2.0:1746065078.731266:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261356928 00000100:00100000:2.0:1746065078.731301:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8440 00000100:00100000:2.0:1746065078.731308:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:26180:x1830881261356928:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.731313:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065078.731322:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.731339:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c46a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.731358:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.731375:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.731377:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.731383:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.731394:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.731402:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779e00, rc 0) 00000100:00100000:2.0:1746065078.731443:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:26180:x1830881261356928:12345-192.168.202.27@tcp:101:bash.0 Request processed in 135us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.731448:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8440 00000100:00100000:0.0:1746065078.740992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.743431:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261357056 00000100:00100000:2.0:1746065078.743442:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261357056 00000100:00100000:2.0:1746065078.743491:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8441 00000100:00100000:2.0:1746065078.743498:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+88:26180:x1830881261357056:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.743513:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.743531:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c471 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.743554:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.743579:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.743580:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.743586:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 89 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.743599:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 89 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.743608:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81200, rc 0) 00000100:00100000:2.0:1746065078.743661:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+89:26180:x1830881261357056:12345-192.168.202.27@tcp:101:bash.0 Request processed in 164us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.743666:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8441 00000100:00100000:0.0:1746065078.745195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.746748:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261357312 00000100:00100000:3.0:1746065078.746758:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261357312 00000100:00100000:3.0:1746065078.746822:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11993 00000100:00100000:3.0:1746065078.746829:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27865:x1830881261357312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.746849:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.746868:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c478 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.746946:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.746957:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.746965:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.746975:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.746980:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.746985:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747068:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc14615be lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.747076:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc14615be lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747081:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc14615be lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.747090:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32d:0x0]: returning size 2 00010000:00010000:3.0:1746065078.747148:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747155:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747160:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747165:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747170:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.747174:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747180:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747188:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cc00) 00010000:00010000:3.0:1746065078.747191:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.747194:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747199:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc14615b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747230:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747235:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747239:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747242:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.747244:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747252:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747257:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065078.747258:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.747260:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747264:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc14615b7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.747305:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c478 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.747317:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc14615be lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c478 expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.747322:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:3.0:1746065078.747323:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.747325:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:3.0:1746065078.747370:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27865:x1830881261357312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 542us (2181us total) trans 4294975382 rc 0/0 00000100:00100000:3.0:1746065078.747375:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11993 00000100:00100000:3.0:1746065078.748891:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.749435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.749611:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261357440 00000100:00100000:0.0:1746065078.749617:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261357440 00000100:00100000:1.0:1746065078.749662:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261357568 00000100:00100000:1.0:1746065078.749665:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261357568 00002000:00010000:1.0:1746065078.749690:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/848 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.749694:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a648000 with x1830881261357568 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.749702:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a648000. 00002000:00010000:3.0:1746065078.749915:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/849 (0->18446744073709551615) 00002000:00100000:3.0:1746065078.749918:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d85df80 with x1830881261357440 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065078.749924:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d85df80. 00000100:00100000:0.0:1746065078.750491:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.750592:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1247 00000100:00100000:1.0:1746065078.750600:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+89:2005:x1830881261357568:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:3.0:1746065078.750719:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1248 00000100:00100000:3.0:1746065078.750725:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881261357440:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065078.750840:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x351:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.750842:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x351:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:3.0:1746065078.750844:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x351:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.750846:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x351:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:3.0:1746065078.750848:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x351:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.750882:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261357440:12345-192.168.202.27@tcp:10:bash.0 Request processed in 157us (1995us total) trans 17179872482 rc 0/0 00000100:00100000:2.0:1746065078.750885:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261357824 00000100:00100000:3.0:1746065078.750888:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1248 00000100:00100000:2.0:1746065078.750889:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261357824 00002000:00010000:3.0:1746065078.750890:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/849 (0->18446744073709551615) 00002000:00100000:3.0:1746065078.750892:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d85df80 with x1830881261357440 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065078.750896:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d85df80. 00000100:00100000:2.0:1746065078.750911:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4130 00000100:00100000:2.0:1746065078.750916:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+273:27865:x1830881261357824:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.751026:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27865:x1830881261357824:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 108us (534us total) trans 4294975383 rc 0/0 00000100:00100000:2.0:1746065078.751031:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4130 00002000:00010000:1.0:1746065078.751574:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065078.751576:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.751578:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065078.751579:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 1746065078 00002000:00010000:1.0:1746065078.751581:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065078.751599:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+90:2005:x1830881261357568:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1000us (2164us total) trans 21474839759 rc 0/0 00000100:00100000:1.0:1746065078.751605:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1247 00002000:00010000:1.0:1746065078.751607:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/848 (0->18446744073709551615) 00002000:00100000:1.0:1746065078.751609:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a648000 with x1830881261357568 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065078.751612:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a648000. 00000100:00100000:0.0:1746065078.755524:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.755613:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261358080 00000100:00100000:2.0:1746065078.755620:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261358080 00000100:00100000:2.0:1746065078.756873:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4131 00000100:00100000:2.0:1746065078.756888:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261358080:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065078.757120:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261358080:12345-192.168.202.27@tcp:35:bash.0 Request processed in 237us (1601us total) trans 4294975384 rc 0/0 00000100:00100000:2.0:1746065078.757126:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4131 00000100:00100000:0.0:1746065078.767003:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.767089:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261358336 00000100:00100000:3.0:1746065078.767097:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261358336 00000100:00100000:3.0:1746065078.767138:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11994 00000100:00100000:3.0:1746065078.767145:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27867:x1830881261358336:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065078.767193:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065078.767220:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461586 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c45c expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.767256:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc14615be lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c478 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.767268:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461563 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c44e expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.767282:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:3.0:1746065078.767292:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.767312:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.767322:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.767330:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.767340:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.767345:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.767350:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.767412:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.767418:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.767424:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:3.0:1746065078.767632:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2375, 64 off196888 00000040:00080000:3.0:1746065078.767650:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2370, 64 off196352 00000040:00080000:3.0:1746065078.767658:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2371, 64 off196416 00000040:00080000:3.0:1746065078.767665:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2376, 64 off196952 00010000:00010000:3.0:1746065078.767700:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065078.767707:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.768785:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.768794:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.768799:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.768803:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769560:0:7204:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065078.769591:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769597:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769602:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769606:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.769609:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769614:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769623:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:3.0:1746065078.769627:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065078.769630:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769634:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14615da lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769740:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769746:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769750:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769754:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769758:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.769761:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769765:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769789:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c700) 00010000:00010000:3.0:1746065078.769792:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.769794:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769799:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14615cc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:3.0:1746065078.769811:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099bd2680 reply state ffff88008b06f000 transno 4294975385 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769819:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065078.769824:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:3.0:1746065078.769826:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065078.769828:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065078.769899:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27867:x1830881261358336:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2751us (2901us total) trans 4294975385 rc 0/0 00000100:00100000:3.0:1746065078.769906:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11994 00010000:00010000:0.0:1746065078.769966:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.769971:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.769975:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.769978:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.769982:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.769993:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32d:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:0.0:1746065078.769995:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065078.769997:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.770001:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc14615e1 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x32d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.770024:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.770025:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.770027:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065078.776212:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.776470:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261358592 00000100:00100000:0.0:1746065078.776478:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261358592 00000100:00100000:0.0:1746065078.776527:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11995 00000100:00100000:0.0:1746065078.776535:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091326050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27866:x1830881261358592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.776553:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.776629:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc14615e8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c47f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.776697:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.776707:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776716:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776724:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065078.776730:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776735:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776764:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776768:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776803:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776809:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776813:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.776817:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776822:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776831:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009867e400) 00010000:00010000:0.0:1746065078.776834:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.776837:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776841:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc14615ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776861:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776865:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776870:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776874:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.776876:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776880:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776886:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:0.0:1746065078.776888:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.776890:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776894:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc14615f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.776916:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc14615e8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c47f expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.776922:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc14615e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c47f expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.776932:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4c00, rc 0) 00000100:00100000:0.0:1746065078.776976:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091326050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27866:x1830881261358592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 442us (771us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065078.776981:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11995 00000100:00100000:0.0:1746065078.780072:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.780131:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261358720 00000100:00100000:1.0:1746065078.780138:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261358720 00000100:00100000:1.0:1746065078.780181:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11996 00000100:00100000:1.0:1746065078.780188:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27866:x1830881261358720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.780205:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.780219:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14615fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c486 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.780267:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.780277:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780285:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780292:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.780297:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780301:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780331:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780336:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780341:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780345:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780349:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.780352:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780357:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780363:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd200) 00010000:00010000:1.0:1746065078.780366:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.780368:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780372:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461604 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780988:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780994:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.780998:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.781002:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.781005:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.781009:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.781015:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065078.781016:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.781018:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.781022:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc146160b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.781045:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14615fd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c486 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.781051:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14615fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c486 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.781060:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c800, rc 0) 00000100:00100000:1.0:1746065078.781104:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27866:x1830881261358720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 916us (1039us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.781110:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11996 00000100:00100000:0.0:1746065078.784954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.788188:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261358848 00000100:00100000:1.0:1746065078.788201:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261358848 00000100:00100000:1.0:1746065078.788258:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11997 00000100:00100000:1.0:1746065078.788265:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27868:x1830881261358848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.788281:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.788299:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461612 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c48d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.788353:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.788363:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788371:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788379:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.788384:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788389:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788418:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788422:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788427:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788432:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788436:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.788439:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788448:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788456:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd600) 00010000:00010000:1.0:1746065078.788459:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.788462:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788465:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461619 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788474:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788478:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788483:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788486:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.788488:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788491:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788496:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065078.788497:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.788499:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788503:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461620 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.788525:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461612 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c48d expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.788532:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461612 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c48d expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.788541:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d400, rc 0) 00000100:00100000:1.0:1746065078.788609:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27868:x1830881261358848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 344us (3662us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.788614:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11997 00000100:00100000:0.0:1746065078.795241:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.795302:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261359104 00000100:00100000:2.0:1746065078.795309:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261359104 00000100:00100000:2.0:1746065078.795363:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11998 00000100:00100000:2.0:1746065078.795371:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27869:x1830881261359104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.795387:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.795403:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461627 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c494 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.795469:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.795479:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795487:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795494:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.795500:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795505:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795533:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795538:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795543:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795549:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795553:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.795557:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795561:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795578:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.795581:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.795584:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795588:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc146162e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795613:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795618:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795622:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795626:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.795627:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795631:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795639:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.795640:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.795642:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795646:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1461635 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.795668:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461627 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c494 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.795674:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461627 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c494 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.795683:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3400, rc 0) 00000100:00100000:2.0:1746065078.795731:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27869:x1830881261359104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 360us (497us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.795737:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11998 00000100:00100000:0.0:1746065078.799170:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.800395:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261359232 00000100:00100000:1.0:1746065078.800406:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261359232 00000100:00100000:1.0:1746065078.800460:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11999 00000100:00100000:1.0:1746065078.800466:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27869:x1830881261359232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.800482:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.800499:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc146163c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c49b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.800552:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.800562:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800582:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800591:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.800601:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800606:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800638:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800644:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800649:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800654:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800659:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.800663:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800668:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800676:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd300) 00010000:00010000:1.0:1746065078.800679:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.800681:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800686:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1461643 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800698:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800702:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800706:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800710:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.800712:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800715:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800719:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065078.800721:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.800723:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800726:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc146164a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.800746:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc146163c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c49b expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.800752:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc146163c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c49b expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.800760:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d400, rc 0) 00000100:00100000:1.0:1746065078.802392:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27869:x1830881261359232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1920us (3224us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.802399:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11999 00000100:00100000:0.0:1746065078.807451:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.807540:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261359360 00000100:00100000:1.0:1746065078.807548:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261359360 00000100:00100000:1.0:1746065078.807609:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12000 00000100:00100000:1.0:1746065078.807617:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27868:x1830881261359360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.807634:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.807650:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461651 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4a2 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.807711:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.807721:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807730:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807739:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065078.807744:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807748:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807821:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807826:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807832:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807841:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807845:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.807848:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807854:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807864:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065078.807867:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.807869:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807873:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461658 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807883:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807888:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807893:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807897:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065078.807899:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807904:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807913:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065078.807915:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065078.807917:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807921:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146165f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065078.807945:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461651 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4a2 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.807952:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1461651 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4a2 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.807963:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d200, rc 0) 00000100:00100000:1.0:1746065078.808004:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27868:x1830881261359360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 388us (561us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065078.808010:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12000 00000100:00100000:0.0:1746065078.813725:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.814482:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.814611:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261359488 00000100:00100000:3.0:1746065078.814619:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261359488 00000100:00100000:3.0:1746065078.814669:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261359744 00000100:00100000:3.0:1746065078.814671:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261359744 00000100:00100000:3.0:1746065078.814688:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12001 00000100:00100000:3.0:1746065078.814696:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27868:x1830881261359488:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065078.814700:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12002 00000100:00100000:2.0:1746065078.814706:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27870:x1830881261359744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.814711:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.814711:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.814728:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc1461666 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4a9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.814738:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146166d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4b0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.814796:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461674 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.814804:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.814805:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461674 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.814813:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461674 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.814841:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065078.814845:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065078.814884:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814892:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814901:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.814905:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc1461666 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4a9 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.814906:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814911:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.814920:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461674 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4a9 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.814926:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:3.0:1746065078.814928:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065078.814930:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f600, rc 0) 00010000:00010000:2.0:1746065078.814936:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814941:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814945:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814950:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814955:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.814958:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814963:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814970:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:2.0:1746065078.814973:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.814976:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814980:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc146167b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814988:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814992:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814995:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.814999:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.815000:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.815004:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.815009:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.815010:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.815012:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.815016:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3400/0xad6b7ddc1461682 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.815032:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146166d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4b0 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.815038:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146166d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4b0 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.815044:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:2.0:1746065078.815062:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+276:27870:x1830881261359744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 356us (581us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.815067:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12002 00000100:00100000:3.0:1746065078.815171:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27868:x1830881261359488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 475us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.815176:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12001 00000100:00100000:0.0:1746065078.818419:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.818827:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261359872 00000100:00100000:2.0:1746065078.818835:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261359872 00000100:00100000:2.0:1746065078.818892:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12003 00000100:00100000:2.0:1746065078.818900:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27870:x1830881261359872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.819050:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.819067:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461689 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4b7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.819158:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.819170:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819179:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819189:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.819195:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819200:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819235:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819240:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819244:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819249:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819253:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.819256:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819261:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819268:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:2.0:1746065078.819271:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.819639:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819646:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1461690 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819656:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819661:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819666:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819671:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.819674:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819677:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819684:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.819685:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.819687:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819691:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc1461697 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.819714:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461689 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4b7 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.819721:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461689 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4b7 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.819728:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:2.0:1746065078.820442:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27870:x1830881261359872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1539us (2026us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.820450:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12003 00000100:00100000:0.0:1746065078.829338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.829907:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261360128 00000100:00100000:2.0:1746065078.829984:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261360128 00000100:00100000:2.0:1746065078.830032:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12004 00000100:00100000:2.0:1746065078.830039:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27868:x1830881261360128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.830056:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.830058:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065078.830079:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461674 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4a9 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.830104:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:2.0:1746065078.830112:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.830123:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc146169e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4be expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.830202:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.830211:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830217:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830225:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.830230:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830234:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830525:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.830532:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830541:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065078.830548:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 0 00010000:00010000:2.0:1746065078.830576:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830581:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830586:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830590:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830594:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.830597:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830601:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830607:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.830609:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.830611:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830615:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc14616a5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065078.830622:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099bd0e00 reply state ffff88012be28000 transno 4294975386 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830631:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.830636:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.830637:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.830639:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065078.830656:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524000/0xad6b7ddc146169e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.830666:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.830671:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fc00) 00010000:00010000:2.0:1746065078.830673:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.830674:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:2.0:1746065078.830729:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27868:x1830881261360128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 690us (1400us total) trans 4294975386 rc 0/0 00000100:00100000:2.0:1746065078.830734:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12004 00000100:00100000:0.0:1746065078.834269:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.834383:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261360384 00000100:00100000:2.0:1746065078.834391:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261360384 00000100:00100000:2.0:1746065078.834455:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12005 00000100:00100000:2.0:1746065078.834462:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27868:x1830881261360384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.834480:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.834495:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14616c1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4c5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.834873:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.834885:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.834891:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.834915:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.834925:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 278 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.834935:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098661500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262616320:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065078.835017:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.842572:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.842633:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261360640 00000100:00100000:3.0:1746065078.842641:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261360640 00000100:00100000:3.0:1746065078.842688:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12006 00000100:00100000:3.0:1746065078.842694:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27871:x1830881261360640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.842710:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.842726:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc14616cf lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4cc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.842837:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.842848:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843327:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.843338:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 0 00010000:00010000:3.0:1746065078.843445:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843451:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843457:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843461:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.843465:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843470:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843478:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fc00) 00010000:00010000:3.0:1746065078.843481:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065078.843484:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843489:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc14616d6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.843883:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc14616cf lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4cc expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.843890:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc14616cf lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4cc expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.843898:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f800, rc 0) 00000100:00100000:3.0:1746065078.844380:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27871:x1830881261360640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1683us (1822us total) trans 4294975387 rc 301/301 00000100:00100000:3.0:1746065078.844390:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12006 00000100:00100000:0.0:1746065078.844540:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.844558:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098661500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262616320:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.845029:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065078.846236:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261360768 00000100:00100000:1.0:1746065078.846358:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261360768 00010000:00010000:1.0:1746065078.846393:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 280 pid: 7203 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.846516:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3558 00000100:00100000:2.0:1746065078.846525:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+280:2004:x1830881261360768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.846538:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.846543:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 280 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.846676:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 280 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.846696:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14616b3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4be expref: 280 pid: 7203 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.846722:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fc00) 00010000:00010000:2.0:1746065078.846726:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.846737:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.846743:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.846758:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.846764:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.846770:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065078.846807:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 0 00000100:00100000:2.0:1746065078.846823:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261360768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 299us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.846829:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3558 00000004:00080000:3.0:1746065078.846957:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x352:0x0], index 0: 0 00000004:00080000:3.0:1746065078.846962:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x353:0x0], index 1: 0 00000004:00080000:3.0:1746065078.846966:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x354:0x0], index 1: 0 00000004:00080000:3.0:1746065078.846969:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x353:0x0], index 0: 0 00010000:00010000:3.0:1746065078.847059:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.847065:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.847070:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.847075:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.847078:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.847082:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065078.847082:0:10212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef27100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262616448:0@lo:5:osp-pre-0-1.0 00010000:00010000:3.0:1746065078.847090:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fc00) 00010000:00010000:3.0:1746065078.847093:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065078.847096:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.847100:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14616c8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065078.847114:0:10212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065078.847135:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14616c1 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4c5 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.847135:0:10212:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065078.847135:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616448 00000100:00100000:0.0:1746065078.847139:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616448 00010000:00010000:3.0:1746065078.847141:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14616c1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4c5 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.847152:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:0.0:1746065078.847158:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8442 00000100:00100000:0.0:1746065078.847162:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+223:10212:x1830881262616448:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1746065078.847190:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27868:x1830881261360384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 12728us (12929us total) trans 4294975388 rc 301/301 00002000:00080000:0.0:1746065078.847190:0:3067:0:(ofd_dev.c:1633:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 866 00000100:00100000:3.0:1746065078.847197:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12005 00000100:00100000:0.0:1746065078.848182:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+224:10212:x1830881262616448:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1018us (1066us total) trans 21474839760 rc 0/0 00000100:00100000:0.0:1746065078.848188:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8442 00000100:00100000:1.0:1746065078.848605:0:10212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef27100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262616448:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1746065078.848614:0:10212:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x353:0x0]-[0x280000400:0x381:0x0] 00000100:00100000:0.0:1746065078.849698:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.849800:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261361024 00000100:00100000:3.0:1746065078.849807:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261361024 00000100:00100000:3.0:1746065078.849844:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4132 00000100:00100000:3.0:1746065078.849851:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27868:x1830881261361024:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.850030:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27868:x1830881261361024:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 179us (335us total) trans 4294975389 rc 0/0 00000100:00100000:3.0:1746065078.850036:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4132 00000100:00100000:2.0:1746065078.852215:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.852795:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261361280 00000100:00100000:2.0:1746065078.852795:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.852802:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261361280 00000100:00100000:3.0:1746065078.852850:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4133 00000100:00100000:3.0:1746065078.852861:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27868:x1830881261361280:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.853013:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27868:x1830881261361280:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 155us (805us total) trans 4294975390 rc 0/0 00000100:00100000:2.0:1746065078.853325:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261361408 00000100:00100000:2.0:1746065078.853328:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261361408 00000100:00100000:2.0:1746065078.853351:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12007 00000100:00100000:2.0:1746065078.853356:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27871:x1830881261361408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.853364:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.853380:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7600/0xad6b7ddc14616eb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4d3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.853432:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4133 00010000:00010000:2.0:1746065078.853460:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7c00/0xad6b7ddc14616f2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.853471:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7c00/0xad6b7ddc14616f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.853480:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7c00/0xad6b7ddc14616f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065078.853502:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 0 00000004:00200000:2.0:1746065078.853505:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065078.853515:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7c00/0xad6b7ddc14616f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.853534:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7600/0xad6b7ddc14616eb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4d3 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.853548:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7c00/0xad6b7ddc14616f2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4d3 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.853555:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.853558:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.853560:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f7c00, rc 0) 00000100:00100000:2.0:1746065078.853591:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27871:x1830881261361408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 234us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.853596:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12007 00000100:00100000:0.0:1746065078.858018:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.858066:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.858067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.858284:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261361536 00000100:00100000:1.0:1746065078.858293:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261361536 00000100:00100000:1.0:1746065078.858329:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261361664 00000100:00100000:1.0:1746065078.858331:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261361664 00000100:00100000:1.0:1746065078.858348:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8443 00000100:00100000:1.0:1746065078.858354:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881261361536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.858371:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.858389:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4da expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.858422:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8444 00000100:00100000:3.0:1746065078.858432:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+90:2006:x1830881261361664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.858440:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.858449:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4e1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.858450:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261361920 00000100:00100000:2.0:1746065078.858453:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261361920 00002000:00010000:3.0:1746065078.858471:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1746065078.858479:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12008 00000100:00100000:2.0:1746065078.858483:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261361920:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.858487:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.858488:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.858492:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.858495:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 91 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.858502:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1461707 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4e8 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.858508:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 91 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.858518:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:3.0:1746065078.858555:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+91:2006:x1830881261361664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 127us (489us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065078.858613:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.858626:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858634:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858641:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.858646:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858650:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858689:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc146171c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.858695:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc146171c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858700:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc146171c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065078.858707:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 0 00010000:00010000:2.0:1746065078.858768:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858802:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858807:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858814:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858820:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.858823:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858829:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858837:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065078.858839:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.858842:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858847:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6000/0xad6b7ddc146170e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858856:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858860:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858864:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858867:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.858869:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858873:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858877:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.858879:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.858881:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858885:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6200/0xad6b7ddc1461715 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.858911:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1461707 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e8 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.858924:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc146171c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e8 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.858929:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.858931:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.858933:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f6e00, rc 0) 00000100:00100000:2.0:1746065078.858955:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261361920:12345-192.168.202.27@tcp:101:bash.0 Request processed in 472us (888us total) trans 4294975391 rc 0/0 00000100:00100000:2.0:1746065078.858961:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12008 00002000:00010000:1.0:1746065078.859134:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065078.859143:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.859145:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.859149:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.859159:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065078.859166:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c800, rc 0) 00000100:00100000:1.0:1746065078.859187:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881261361536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 833us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.859294:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8444 00000100:00100000:1.0:1746065078.859328:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8443 00000100:00100000:0.0:1746065078.860757:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.860808:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261362048 00000100:00100000:3.0:1746065078.860813:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261362048 00000100:00100000:3.0:1746065078.860843:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12009 00000100:00100000:3.0:1746065078.860849:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261362048:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.860867:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065078.860872:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.860879:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc146172a lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4ef expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.860902:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1461731 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.860912:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1461731 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.860920:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1461731 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.860995:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc146172a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4ef expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.861010:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1461731 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4ef expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.861016:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:3.0:1746065078.861019:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065078.861020:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31c00, rc 0) 00000100:00100000:3.0:1746065078.861063:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261362048:12345-192.168.202.27@tcp:101:bash.0 Request processed in 213us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.861065:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261362176 00000100:00100000:3.0:1746065078.861068:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12009 00000100:00100000:2.0:1746065078.861069:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261362176 00000100:00100000:2.0:1746065078.861108:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 545 00000100:00100000:2.0:1746065078.861114:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+284:2007:x1830881261362176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.861122:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.861132:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc146171c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e8 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.861143:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.861149:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065078.861167:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+283:2007:x1830881261362176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.861173:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 545 00000100:00100000:0.0:1746065078.862689:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.862876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.862902:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261362560 00000100:00100000:2.0:1746065078.862907:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261362560 00000100:00100000:2.0:1746065078.862958:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261362432 00000100:00100000:2.0:1746065078.862961:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261362432 00000100:00100000:0.0:1746065078.862985:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12010 00000100:00100000:3.0:1746065078.862989:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12011 00000100:00100000:0.0:1746065078.862992:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261362560:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:3.0:1746065078.862995:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27871:x1830881261362432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.863009:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.863020:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1461738 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4f6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.863034:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.863045:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7c00/0xad6b7ddc14616f2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4d3 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.863050:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1461738 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4f6 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.863058:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1461738 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4f6 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.863064:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065078.863068:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.863070:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:3.0:1746065078.863072:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065078.863073:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30800, rc 0) 00010000:00010000:0.0:1746065078.863191:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065078.863198:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.863204:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:0.0:1746065078.863229:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975392 00000004:00010000:0.0:1746065078.863241:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88013189aa00 reply state ffff88011daae000 transno 4294975393 ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.863247:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.863252:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065078.863253:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065078.863255:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065078.863457:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27871:x1830881261362432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 461us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.863457:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261362560:12345-192.168.202.27@tcp:36:bash.0 Request processed in 465us (771us total) trans 4294975393 rc 0/0 00000100:00100000:0.0:1746065078.863462:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12010 00000020:00080000:0.0:1746065078.863465:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746065078.863466:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12011 00000100:00100000:0.0:1746065078.865244:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.865572:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261362688 00000100:00100000:2.0:1746065078.865579:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261362688 00000100:00100000:0.0:1746065078.865637:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.865682:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261362944 00000100:00100000:3.0:1746065078.865686:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261362944 00000100:00100000:3.0:1746065078.865716:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4134 00000100:00100000:3.0:1746065078.865723:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27871:x1830881261362944:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065078.865839:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12012 00000100:00100000:2.0:1746065078.865846:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261362688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.865854:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.865868:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461746 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c4fd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.865905:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461746 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4fd expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.865915:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461746 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4fd expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.865930:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.865932:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.865935:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00200, rc 0) 00000100:00100000:2.0:1746065078.865972:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261362688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 127us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.865978:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12012 00000100:00100000:3.0:1746065078.866126:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27871:x1830881261362944:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 404us (489us total) trans 4294975394 rc 0/0 00000100:00100000:3.0:1746065078.866132:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4134 00000100:00100000:0.0:1746065078.867727:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.867912:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261363456 00000100:00100000:1.0:1746065078.867966:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261363456 00000100:00100000:2.0:1746065078.868001:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.868017:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261363328 00000100:00100000:1.0:1746065078.868019:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261363328 00000100:00100000:1.0:1746065078.868034:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12013 00000100:00100000:1.0:1746065078.868040:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261363456:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:2.0:1746065078.868044:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12014 00000100:00100000:2.0:1746065078.868050:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27871:x1830881261363328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.868056:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.868056:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.868058:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746065078.868069:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc146174d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c504 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.868074:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461746 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4fd expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.868089:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1461738 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4f6 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.868097:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065078.868099:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.868105:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461754 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c50b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.868123:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.868125:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.868132:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.868132:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.868139:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.868139:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.868146:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.868150:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868154:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868217:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.868223:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868228:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065078.868236:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 0 00000040:00080000:1.0:1746065078.868308:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2372, 88 off196504 00000004:00080000:1.0:1746065078.868314:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674886539411ns, next at 675481534386ns, rc = 0 00000040:00080000:1.0:1746065078.868336:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2377, 88 off197040 00000004:00080000:1.0:1746065078.868339:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674886565435ns, next at 675481510748ns, rc = 0 00000040:00080000:1.0:1746065078.868350:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2378, 88 off197128 00000004:00080000:1.0:1746065078.868353:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674886579407ns, next at 675481510748ns, rc = 0 00000040:00080000:1.0:1746065078.868447:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2374, 88 off196696 00000004:00080000:1.0:1746065078.868451:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674886677297ns, next at 675481534386ns, rc = 0 00010000:00010000:2.0:1746065078.868584:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868595:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868600:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868605:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.868608:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868614:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868620:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.868622:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065078.868624:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868628:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461770 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868637:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868642:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868646:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868649:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868652:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.868655:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868658:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868663:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f600) 00010000:00010000:2.0:1746065078.868664:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.868666:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868669:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc146175b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868674:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868677:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868680:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868683:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.868685:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868689:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868693:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065078.868694:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.868696:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868703:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461769 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.868726:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc146174d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c504 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.868731:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc146174d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c504 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.868740:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00400, rc 0) 00000100:00100000:2.0:1746065078.868788:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27871:x1830881261363328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 722us (772us total) trans 4294975396 rc 301/301 00000100:00100000:2.0:1746065078.868794:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12014 00000100:00100000:0.0:1746065078.871516:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.871680:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261363584 00000100:00100000:2.0:1746065078.871687:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261363584 00000100:00100000:2.0:1746065078.871733:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12015 00000100:00100000:2.0:1746065078.871741:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27871:x1830881261363584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.871765:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.871803:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc146177e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c512 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.872008:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.872018:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.872023:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.872038:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.872046:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:3.0:1746065078.872149:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975396 is committed 00000004:00080000:3.0:1746065078.872158:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1596 committed 00010000:00010000:0.0:1746065078.872161:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.872167:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.872173:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00000004:00080000:3.0:1746065078.872178:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1606 committed 00010000:00010000:0.0:1746065078.872178:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f877000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.872180:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00000004:00080000:3.0:1746065078.872183:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1605 committed 00000004:00080000:3.0:1746065078.872185:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1595 committed 00010000:00010000:0.0:1746065078.872185:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.872196:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:0.0:1746065078.872198:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.872201:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.872205:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14615d3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065078.872224:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872228:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872232:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872240:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.872242:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872246:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872252:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:0.0:1746065078.872254:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.872256:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872260:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14616ac lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065078.872274:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.872279:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.872283:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.872286:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993fc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065078.872288:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.872292:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.872298:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065078.872301:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065078.872303:0:3745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065078.872308:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065078.872312:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993fc00/0xad6b7ddc146173f lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065078.872422:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262616576:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.872423:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262616832:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.872458:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.872481:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616832 00000100:00100000:0.0:1746065078.872484:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616832 00000100:00100000:1.0:1746065078.872495:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617344:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.872503:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8445 00000100:00100000:0.0:1746065078.872508:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+224:3762:x1830881262616832:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.872510:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.872521:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617856:0@lo:2:osp-syn-1-1.0 00002000:00080000:0.0:1746065078.872522:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:847 count 1 00000100:00100000:1.0:1746065078.872532:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065078.872536:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.872544:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746065078.872548:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262616704:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065078.872548:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 90 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065078.872554:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.872556:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065078.872558:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065078.872559:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065078.872591:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617216:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.872604:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.872615:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617728:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065078.872626:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065078.872645:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617344 00000100:00100000:1.0:1746065078.872648:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617344 00000100:00100000:1.0:1746065078.872663:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617856 00000100:00100000:1.0:1746065078.872665:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617856 00000100:00100000:1.0:1746065078.872676:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616704 00000100:00100000:1.0:1746065078.872678:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616704 00000100:00100000:1.0:1746065078.872686:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617216 00000100:00100000:1.0:1746065078.872687:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617216 00000100:00100000:1.0:1746065078.872692:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617728 00000100:00100000:2.0:1746065078.872693:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262616960:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.872694:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617728 00000100:00100000:1.0:1746065078.872701:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8446 00000100:00100000:1.0:1746065078.872705:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+227:3762:x1830881262617344:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065078.872705:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 90 pid: 1880 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1746065078.872714:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:849 count 1 00000100:00100000:2.0:1746065078.872718:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065078.872721:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 90 pid: 1880 timeout: 774 lvb_type: 1 00002000:00010000:1.0:1746065078.872729:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1746065078.872730:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262617472:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.872730:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262618112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.872734:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.872740:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.872741:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065078.872744:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065078.872744:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.872763:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262617984:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065078.872788:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065078.872793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.872798:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616960 00000100:00100000:0.0:1746065078.872801:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616960 00000100:00100000:3.0:1746065078.872809:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617472 00000100:00100000:3.0:1746065078.872811:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617472 00000100:00100000:0.0:1746065078.872813:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617984 00000100:00100000:0.0:1746065078.872814:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617984 00000100:00100000:2.0:1746065078.872816:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8447 00000100:00100000:2.0:1746065078.872822:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3762:x1830881262617856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.872822:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8448 00000100:00100000:0.0:1746065078.872826:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+228:3762:x1830881262616704:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065078.872835:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:846 count 1 00010000:00010000:0.0:1746065078.872845:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.872854:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 90 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065078.872858:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.872859:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.872861:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.872874:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 90 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065078.872881:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 90 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746065078.872889:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262618240:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065078.872913:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746065078.872920:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x354:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065078.872922:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x354:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.872923:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x354:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.872924:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x354:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065078.872925:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x354:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065078.872925:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.872935:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262617088:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.872946:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+34:3762:x1830881262617856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 125us (413us total) trans 17179872483 rc 0/0 00000100:00100000:0.0:1746065078.872952:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065078.872960:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262617600:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.872971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065078.873031:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8449 00000100:00100000:3.0:1746065078.873038:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+34:3762:x1830881262617216:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.873050:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:849 count 1 00010000:00010000:3.0:1746065078.873061:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873071:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873076:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.873077:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.873079:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873093:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873100:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 30 pid: 3067 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.873108:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262618368:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.873128:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065078.873141:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262616576 00000100:00100000:3.0:1746065078.873143:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262616576 00000100:00100000:3.0:1746065078.873156:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617088 00000100:00100000:2.0:1746065078.873157:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8447 00000100:00100000:3.0:1746065078.873158:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617088 00000100:00100000:3.0:1746065078.873165:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617600 00000100:00100000:3.0:1746065078.873167:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617600 00000100:00100000:3.0:1746065078.873175:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8450 00000100:00100000:3.0:1746065078.873178:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+229:3762:x1830881262617728:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065078.873185:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8451 00000100:00100000:2.0:1746065078.873191:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:3759:x1830881262616960:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065078.873201:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:848 count 1 00000100:00100000:3.0:1746065078.873257:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+230:3762:x1830881262617728:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (629us total) trans 21474839761 rc 0/0 00010000:00010000:1.0:1746065078.873257:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873262:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8450 00010000:00010000:1.0:1746065078.873265:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.873270:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873271:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8452 00000100:00100000:3.0:1746065078.873275:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+35:3759:x1830881262617472:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.873284:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:850 count 1 00010000:00010000:1.0:1746065078.873292:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1746065078.873296:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.873299:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873306:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.873307:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.873310:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873317:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873321:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873326:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873339:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065078.873412:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+36:3759:x1830881262617472:12345-0@lo:6:osp-syn-1-1.0 Request processed in 136us (667us total) trans 17179872484 rc 0/0 00000100:00100000:1.0:1746065078.873412:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+230:3762:x1830881262617344:12345-0@lo:6:osp-syn-0-1.0 Request processed in 705us (899us total) trans 21474839762 rc 0/0 00000100:00100000:1.0:1746065078.873417:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8446 00010000:00010000:2.0:1746065078.873424:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.873435:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065078.873441:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.873442:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.873444:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.873445:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065078.873450:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.873455:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.873458:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.873459:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065078.873464:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.873466:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 30 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746065078.873473:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.873475:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098660000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262618496:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065078.873479:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97c00/0xad6b7ddc1461793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.873493:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.873497:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.873501:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.873504:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873507:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8452 00010000:00010000:0.0:1746065078.873508:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.873516:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873517:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8453 00010000:00010000:0.0:1746065078.873521:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc14617a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873522:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+229:3759:x1830881262617984:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065078.873530:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.873531:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.873532:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1746065078.873560:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x353:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.873562:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x353:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.873574:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x353:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.873575:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x353:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.873577:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x353:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.873698:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+230:3759:x1830881262617984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (802us total) trans 21474839763 rc 0/0 00000100:00100000:3.0:1746065078.873704:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8453 00000100:00100000:3.0:1746065078.873715:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8454 00000100:00100000:3.0:1746065078.873719:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+35:3760:x1830881262616576:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065078.873728:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:847 count 1 00010000:00010000:3.0:1746065078.873735:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873743:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873748:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.873749:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065078.873751:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873763:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.873770:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 30 pid: 1880 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.873793:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262618624:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.873812:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065078.873812:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8455 00000100:00100000:1.0:1746065078.873818:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+229:3760:x1830881262617088:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065078.873820:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1746065078.873827:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:848 count 1 00010000:00010000:1.0:1746065078.873835:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065078.873840:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925c8000/2, rc 0, transno 17179872484 00010000:00010000:1.0:1746065078.873843:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 90 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873845:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262617472:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065078.873852:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000004:00080000:3.0:1746065078.873853:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef24380/2, rc 0, transno 21474839763 00010000:00010000:1.0:1746065078.873853:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065078.873855:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.873856:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262617984:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065078.873869:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 90 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.873876:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 90 pid: 11461 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746065078.873884:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262618752:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.873908:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065078.873925:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8456 00000100:00100000:1.0:1746065078.873930:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+35:3760:x1830881262617600:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.874004:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+36:3760:x1830881262617600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 73us (1030us total) trans 17179872485 rc 0/0 00000100:00100000:1.0:1746065078.874008:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8456 00010000:00010000:1.0:1746065078.874052:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c50b expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.874060:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065078.874062:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065078.874064:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.874070:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.874075:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.874097:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461754 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c50b expref: 273 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065078.874108:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c50b expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065078.874117:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cb480/2, rc 0, transno 17179872485 00000100:00100000:0.0:1746065078.874121:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262617600:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065078.874126:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d400, rc 0) 00000100:00100000:1.0:1746065078.874142:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261363456:12345-192.168.202.27@tcp:101:bash.0 Request processed in 6103us (6421us total) trans 4294975395 rc 0/0 00000100:00100000:1.0:1746065078.874148:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12013 00010000:00010000:1.0:1746065078.874165:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.874170:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065078.874196:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 2 00000004:00200000:1.0:1746065078.874199:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065078.874212:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.874231:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc146177e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c512 expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.874240:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c512 expref: 271 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.874249:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065078.874251:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065078.874253:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:1.0:1746065078.874282:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+271:27871:x1830881261363584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2542us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.874287:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12015 00000100:00100000:2.0:1746065078.874312:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f900 going to sleep for 11 seconds 00000004:00080000:2.0:1746065078.874340:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef26d80/2, rc 0, transno 21474839761 00000100:00100000:2.0:1746065078.874343:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617728:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065078.874352:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef27480/2, rc 0, transno 21474839762 00000100:00100000:2.0:1746065078.874355:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617344:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065078.874362:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925cb800/2, rc 0, transno 17179872483 00000100:00100000:2.0:1746065078.874365:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617856:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065078.877553:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262618240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065078.877583:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.877956:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262618368:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.877969:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.877990:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262618624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065078.877990:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262618752:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.877999:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.877999:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.878000:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098660000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262618496:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065078.878013:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.878042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.878059:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.878084:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261363712 00000100:00100000:2.0:1746065078.878085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.878089:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261363712 00010000:00010000:3.0:1746065078.878117:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 91 pid: 1880 timeout: 774 lvb_type: 1 00000100:00100000:3.0:1746065078.878138:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261363968 00000100:00100000:3.0:1746065078.878140:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261363968 00010000:00010000:3.0:1746065078.878150:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 31 pid: 3067 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.878152:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262618112:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065078.878165:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.878176:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364224 00000100:00100000:3.0:1746065078.878178:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364224 00000100:00100000:0.0:1746065078.878184:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3559 00010000:00010000:3.0:1746065078.878188:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 92 pid: 11461 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.878191:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+92:2004:x1830881261363712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065078.878201:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3560 00010000:00010000:0.0:1746065078.878202:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065078.878206:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261363968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.878207:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 92 pid: 1880 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.878213:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065078.878216:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 31 pid: 3067 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.878216:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 92 pid: 1880 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.878224:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 31 pid: 3067 timeout: 774 lvb_type: 0 00010000:00010000:3.0:1746065078.878235:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc146159b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c46a expref: 31 pid: 3067 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.878235:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8000/0xad6b7ddc1461379 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3b4 expref: 92 pid: 1880 timeout: 774 lvb_type: 1 00010000:00010000:3.0:1746065078.878245:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.878245:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.878247:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.878247:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.878251:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.878251:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.878258:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.878262:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.878273:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.878273:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065078.878310:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+91:2004:x1830881261363712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.878448:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261363968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 241us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.878687:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3559 00000100:00100000:2.0:1746065078.878701:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3561 00000100:00100000:3.0:1746065078.878926:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3560 00010000:00010000:3.0:1746065078.878946:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.878952:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.878959:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.878965:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.878977:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065078.878998:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065078.879034:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1746065078.879035:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065078.879040:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879047:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.879050:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879057:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.879062:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065078.879071:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879076:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14617a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.879076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065078.879090:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.879092:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.879093:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065078.879101:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.879104:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364480 00000100:00100000:1.0:1746065078.879107:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364480 00000100:00100000:0.0:1746065078.879114:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261363840 00000100:00100000:0.0:1746065078.879117:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261363840 00010000:00010000:0.0:1746065078.879130:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 91 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746065078.879138:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12016 00000100:00100000:0.0:1746065078.879151:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364096 00000100:00100000:0.0:1746065078.879153:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364096 00000100:00100000:1.0:1746065078.879158:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364352 00000100:00100000:1.0:1746065078.879160:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364352 00010000:00010000:0.0:1746065078.879161:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 30 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.879171:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 31 pid: 3067 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746065078.879173:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3562 00000100:00100000:0.0:1746065078.879177:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+91:2004:x1830881261363840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065078.879182:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3563 00010000:00010000:0.0:1746065078.879183:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065078.879186:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261364096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.879186:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 91 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746065078.879192:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.879193:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 91 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746065078.879195:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 31 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.879202:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 31 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.879208:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461524 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c440 expref: 91 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746065078.879212:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146140c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3e5 expref: 31 pid: 1880 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746065078.879218:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879219:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.879220:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065078.879221:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879221:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879224:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879227:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879229:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879241:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.879242:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.879260:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261364096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.879260:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+90:2004:x1830881261363840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.879265:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3562 00000100:00100000:1.0:1746065078.879268:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3563 00000100:00100000:0.0:1746065078.879276:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3564 00000100:00100000:0.0:1746065078.879280:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261364352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065078.879284:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+271:27871:x1830881261364480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.879286:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.879289:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 29 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746065078.879296:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 29 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746065078.879299:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.879306:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c51ae00/0xad6b7ddc146134f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c3ad expref: 29 pid: 3067 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746065078.879310:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc14617c4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c519 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879313:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879314:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879316:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879322:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065078.879324:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+90:2004:x1830881261364224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.879332:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.879332:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.879336:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 89 pid: 11461 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.879344:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 89 pid: 11461 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746065078.879345:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261364352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065078.879349:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc14617c4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c519 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065078.879350:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3564 00010000:00010000:2.0:1746065078.879354:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc14615a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c471 expref: 89 pid: 11461 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746065078.879358:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc14617c4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c519 expref: 272 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879364:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.879365:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879366:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879368:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879371:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065078.879371:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879373:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065078.879374:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879375:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00010000:00010000:0.0:1746065078.879377:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879383:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879384:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065078.879391:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065078.879392:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:27871:x1830881261364480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 249us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.879394:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+88:2004:x1830881261364224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 688us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.879397:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12016 00000100:00100000:2.0:1746065078.879403:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3561 00010000:00010000:1.0:1746065078.879411:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879417:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879423:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879428:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879434:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879437:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1746065078.879440:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879446:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879452:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.879460:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1746065078.879473:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1746065078.879477:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879482:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.879485:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879490:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879498:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879504:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146179a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879513:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065078.879515:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879519:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.879522:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879527:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879533:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879538:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc14617bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879547:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.879549:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879553:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.879555:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879561:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879580:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879585:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617af lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.879593:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.879595:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.879596:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.879599:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065078.879636:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+231:3762:x1830881262616704:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6808us (7075us total) trans 21474839764 rc 0/0 00000100:00100000:0.0:1746065078.879643:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8448 00000100:00100000:0.0:1746065078.879653:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364608 00000100:00100000:0.0:1746065078.879656:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364608 00000100:00100000:0.0:1746065078.879671:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8457 00000100:00100000:0.0:1746065078.879675:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+88:26180:x1830881261364608:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065078.879682:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.879690:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c520 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065078.879704:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065078.879712:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879714:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065078.879718:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 89 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879727:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 89 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879733:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:0.0:1746065078.879748:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+89:26180:x1830881261364608:12345-192.168.202.27@tcp:101:bash.0 Request processed in 73us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.879753:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8457 00000100:00100000:1.0:1746065078.879790:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+230:3760:x1830881262617088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5971us (6836us total) trans 21474839765 rc 0/0 00000100:00100000:1.0:1746065078.879795:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8455 00000004:00080000:0.0:1746065078.879814:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef25180/2, rc 0, transno 21474839764 00000100:00100000:0.0:1746065078.879819:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262616704:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1746065078.879841:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef25880/2, rc 0, transno 21474839765 00000100:00100000:0.0:1746065078.879844:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262617088:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065078.879852:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.879859:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879866:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879873:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879878:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.879901:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065078.879972:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+230:3762:x1830881262616832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7463us (7512us total) trans 21474839766 rc 0/0 00000100:00100000:0.0:1746065078.879977:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8445 00000004:00080000:0.0:1746065078.879997:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ef24a80/2, rc 0, transno 21474839766 00000100:00100000:0.0:1746065078.880000:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ef24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262616832:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065078.880404:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.880411:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.880422:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.880427:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.880441:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065078.880601:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+38:3759:x1830881262616960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7409us (7880us total) trans 17179872486 rc 0/0 00000100:00100000:2.0:1746065078.880607:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8451 00000004:00080000:3.0:1746065078.880760:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925c9c00/2, rc 0, transno 17179872486 00000100:00100000:3.0:1746065078.880765:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262616960:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065078.880821:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065078.880827:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880833:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6e00 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:3.0:1746065078.880835:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3762:x1830881262617216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7797us (8228us total) trans 17179872487 rc 0/0 00010000:00010000:0.0:1746065078.880836:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.880840:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8449 00010000:00010000:0.0:1746065078.880843:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880853:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065078.880859:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800925c9f80/2, rc 0, transno 17179872487 00010000:00010000:0.0:1746065078.880859:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146178c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.880862:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262617216:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065078.880876:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065078.880879:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880888:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f7800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065078.880891:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880896:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880904:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880910:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc14617b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.880920:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.880921:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065078.880923:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.881060:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065078.883534:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+36:3760:x1830881262616576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9808us (10601us total) trans 17179872488 rc 0/0 00000100:00100000:2.0:1746065078.883545:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8454 00000004:00080000:0.0:1746065078.883820:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131899f80/2, rc 0, transno 17179872488 00000100:00100000:0.0:1746065078.883826:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262616576:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065078.883879:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.883962:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.883984:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364736 00000100:00100000:2.0:1746065078.883991:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364736 00000100:00100000:3.0:1746065078.884022:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261364992 00000100:00100000:3.0:1746065078.884025:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261364992 00000100:00100000:3.0:1746065078.884055:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4135 00000100:00100000:3.0:1746065078.884062:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27871:x1830881261364992:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.884233:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27871:x1830881261364992:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 171us (270us total) trans 4294975397 rc 0/0 00000100:00100000:3.0:1746065078.884240:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4135 00000100:00100000:2.0:1746065078.884312:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8458 00000100:00100000:2.0:1746065078.884317:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+28:26180:x1830881261364736:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065078.884326:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.884342:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c527 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065078.884362:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065078.884376:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.884377:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065078.884384:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.884395:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.884403:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:2.0:1746065078.884424:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+29:26180:x1830881261364736:12345-192.168.202.27@tcp:101:bash.0 Request processed in 106us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.884429:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8458 00000100:00100000:2.0:1746065078.887892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.888727:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261365120 00000100:00100000:0.0:1746065078.888736:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261365120 00000100:00100000:0.0:1746065078.888807:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 546 00000100:00100000:0.0:1746065078.888815:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+273:2005:x1830881261365120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065078.888825:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065078.888847:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc14617c4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c519 expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.888860:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065078.888863:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065078.888869:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.888901:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+272:2005:x1830881261365120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065078.888907:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 546 00000100:00100000:1.0:1746065078.888979:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.889006:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261365632 00000100:00100000:1.0:1746065078.889009:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261365632 00000100:00100000:2.0:1746065078.889044:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12017 00000100:00100000:2.0:1746065078.889052:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+272:27871:x1830881261365632:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065078.889055:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065078.889067:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.889079:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a852b000/0xad6b7ddc14617d9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c52e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.889141:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.889152:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889159:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889170:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.889174:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889178:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889253:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc14617ee lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.889260:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc14617ee lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889265:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc14617ee lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065078.889272:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 2 00010000:00010000:2.0:1746065078.889328:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889333:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889338:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889342:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889347:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.889350:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889358:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889365:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fa00) 00010000:00010000:2.0:1746065078.889367:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.889369:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889373:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14617e0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889381:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889385:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889389:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889393:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.889395:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889399:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889404:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fc00) 00010000:00010000:2.0:1746065078.889405:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.889407:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889411:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc14617e7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.889440:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a852b000/0xad6b7ddc14617d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c52e expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.889451:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc14617ee lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c52e expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.889456:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.889458:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065078.889459:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31600, rc 0) 00000100:00100000:2.0:1746065078.889481:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27871:x1830881261365632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 431us (614us total) trans 4294975398 rc 0/0 00000100:00100000:2.0:1746065078.889487:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12017 00000100:00100000:0.0:1746065078.890581:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261365376 00000100:00100000:0.0:1746065078.890588:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261365376 00002000:00010000:0.0:1746065078.890611:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/851 (0->18446744073709551615) 00002000:00100000:0.0:1746065078.890615:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800982dd500 with x1830881261365376 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065078.890623:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800982dd500. 00000100:00100000:0.0:1746065078.891257:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261365248 00000100:00100000:0.0:1746065078.891262:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261365248 00002000:00010000:0.0:1746065078.891276:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/850 (0->18446744073709551615) 00002000:00100000:0.0:1746065078.891279:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800982dc700 with x1830881261365248 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065078.891285:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800982dc700. 00000100:00100000:0.0:1746065078.891301:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1249 00000100:00100000:0.0:1746065078.891307:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261365376:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065078.891450:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x353:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065078.891452:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x353:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:0.0:1746065078.891454:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x353:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065078.891456:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x353:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:0.0:1746065078.891457:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x353:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.891552:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1250 00000100:00100000:3.0:1746065078.891560:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+89:2004:x1830881261365248:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065078.891647:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x352:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065078.891649:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x352:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:3.0:1746065078.891651:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x352:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065078.891652:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x352:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:3.0:1746065078.891654:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x352:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065078.894093:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+90:2004:x1830881261365248:12345-192.168.202.27@tcp:10:bash.0 Request processed in 2524us (5027us total) trans 21474839767 rc 0/0 00000100:00100000:3.0:1746065078.894103:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1250 00002000:00010000:3.0:1746065078.894109:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/850 (0->18446744073709551615) 00002000:00100000:3.0:1746065078.894112:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800982dc700 with x1830881261365248 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065078.894119:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800982dc700. 00000100:00100000:0.0:1746065078.894342:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261365376:12345-192.168.202.27@tcp:10:bash.0 Request processed in 3033us (5360us total) trans 17179872489 rc 0/0 00000100:00100000:0.0:1746065078.894351:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1249 00002000:00010000:0.0:1746065078.894353:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/851 (0->18446744073709551615) 00002000:00100000:0.0:1746065078.894356:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800982dd500 with x1830881261365376 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065078.894362:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800982dd500. 00000100:00100000:1.0:1746065078.894812:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.894911:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261365888 00000100:00100000:0.0:1746065078.894917:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261365888 00000100:00100000:0.0:1746065078.894956:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4136 00000100:00100000:0.0:1746065078.894962:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+274:27871:x1830881261365888:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065078.895134:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261365888:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 171us (321us total) trans 4294975399 rc 0/0 00000100:00100000:0.0:1746065078.895139:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4136 00000100:00100000:0.0:1746065078.903343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.903406:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261366016 00000100:00100000:3.0:1746065078.903415:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261366016 00000100:00100000:3.0:1746065078.903454:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4137 00000100:00100000:3.0:1746065078.903461:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261366016:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065078.903738:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261366016:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 275us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.903743:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4137 00000100:00100000:0.0:1746065078.905971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.907741:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261366400 00000100:00100000:2.0:1746065078.907752:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261366400 00000100:00100000:2.0:1746065078.907809:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12018 00000100:00100000:2.0:1746065078.907816:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27873:x1830881261366400:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065078.907861:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1746065078.907887:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d400/0xad6b7ddc1461762 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c50b expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.907913:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc14617ee lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c52e expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.907924:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461785 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c512 expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.907933:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1461731 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4ef expref: 272 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.907943:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.907951:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065078.907971:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.907980:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.907987:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.907997:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.908002:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908008:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908084:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065078.908090:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908096:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065078.908448:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x32f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1746065078.908512:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908521:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908526:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908530:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.908533:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908538:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908545:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88009554fc00) 00010000:00010000:2.0:1746065078.908547:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065078.908550:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908554:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146180a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908583:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908588:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908591:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908595:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908599:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.908602:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908606:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908611:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f200) 00010000:00010000:2.0:1746065078.908613:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.908615:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908619:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e600/0xad6b7ddc14617fc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065078.908627:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135220e00 reply state ffff88008d93a000 transno 4294975400 ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908634:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065078.908639:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:2.0:1746065078.908641:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065078.908643:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065078.908947:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.908950:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27873:x1830881261366400:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1133us (2983us total) trans 4294975400 rc 0/0 00000100:00100000:3.0:1746065078.908956:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12018 00000100:00100000:3.0:1746065078.908972:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261366528 00000100:00100000:3.0:1746065078.908975:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261366528 00000100:00100000:3.0:1746065078.909004:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12019 00000100:00100000:3.0:1746065078.909008:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27871:x1830881261366528:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.909019:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.909028:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461811 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c535 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.909077:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461818 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065078.909085:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461818 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065078.909091:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461818 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065078.909098:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x32f:0x0]: returning size 2 00010000:00010000:3.0:1746065078.909148:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461811 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c535 expref: 276 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.909164:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461818 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c535 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.909170:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065078.909172:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065078.909174:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7f000, rc 0) 00000100:00100000:3.0:1746065078.909212:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261366528:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 202us (266us total) trans 4294975401 rc 0/0 00000100:00100000:3.0:1746065078.909217:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12019 00000100:00100000:0.0:1746065078.911238:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.912621:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261366784 00000100:00100000:3.0:1746065078.912630:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261366784 00000100:00100000:3.0:1746065078.912679:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4138 00000100:00100000:3.0:1746065078.912686:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261366784:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:3.0:1746065078.912746:0:7207:0:(mdt_open.c:2285:mdt_close_handle_layouts()) ### [0x240000403:0x32f:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461818 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c535 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.912790:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065078.912799:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912806:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000004:00020000:3.0:1746065078.912905:0:7207:0:(lod_lov.c:1538:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000403:0x32f:0x0]: rc = -1 00010000:00010000:3.0:1746065078.912922:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912928:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912932:0:7207:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912937:0:7207:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.912940:0:7207:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912944:0:7207:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912951:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065078.912953:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1746065078.912956:0:7207:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912963:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1461826 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065078.912970:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065078.912971:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065078.912974:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461818 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c535 expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065078.913473:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261366784:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 786us (2240us total) trans 4294975402 rc -1/-1 00000100:00100000:3.0:1746065078.913479:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4138 00000100:00100000:0.0:1746065078.917434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.917987:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261366912 00000100:00100000:1.0:1746065078.917995:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261366912 00000100:00100000:1.0:1746065078.918045:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12020 00000100:00100000:1.0:1746065078.918052:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27871:x1830881261366912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.918073:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.920520:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97c00/0xad6b7ddc146182d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c53c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.920592:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97c00/0xad6b7ddc146182d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c53c expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.920604:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97c00/0xad6b7ddc146182d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c53c expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.920618:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88012edbd300) 00010000:00010000:1.0:1746065078.920620:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065078.920623:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97c00, rc 0) 00000100:00100000:1.0:1746065078.920684:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27871:x1830881261366912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2631us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.920690:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12020 00000100:00100000:0.0:1746065078.920948:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.921269:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261367040 00000100:00100000:2.0:1746065078.921276:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261367040 00000100:00100000:2.0:1746065078.921315:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12021 00000100:00100000:2.0:1746065078.921321:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27874:x1830881261367040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.921333:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.921344:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461834 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c543 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.921399:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.921408:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921415:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921424:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065078.921429:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921433:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921710:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921716:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921720:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921725:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921730:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.921733:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921738:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921747:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f300) 00010000:00010000:2.0:1746065078.921750:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.921753:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921757:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146183b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921797:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921802:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921807:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921810:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.921812:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921816:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921821:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:2.0:1746065078.921823:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.921825:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921829:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1461842 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.921850:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461834 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c543 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.921860:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461834 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c543 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.921870:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668600, rc 0) 00000100:00100000:2.0:1746065078.921911:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27874:x1830881261367040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 590us (964us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.921917:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12021 00000100:00100000:0.0:1746065078.931746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.931802:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261367296 00000100:00100000:3.0:1746065078.931810:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261367296 00000100:00100000:3.0:1746065078.931855:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4139 00000100:00100000:3.0:1746065078.931862:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27871:x1830881261367296:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065078.932065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:3.0:1746065078.932089:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x32f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1746065078.932143:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261367424 00000100:00100000:2.0:1746065078.932147:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261367424 00000040:00080000:3.0:1746065078.932149:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2375, 64 off196760 00000040:00080000:3.0:1746065078.932170:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2379, 64 off197192 00000100:00100000:2.0:1746065078.932171:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12022 00000100:00100000:2.0:1746065078.932176:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27874:x1830881261367424:12345-192.168.202.27@tcp:101:lfs.0 00000040:00080000:3.0:1746065078.932178:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2380, 64 off197256 00010000:00010000:2.0:1746065078.932184:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:3.0:1746065078.932186:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2376, 64 off196824 00010000:00010000:2.0:1746065078.932199:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461849 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c54a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.932220:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065078.932231:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.932234:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.932239:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.932239:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932245:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.932250:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.932251:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.932254:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.932256:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.932258:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065078.932264:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.932268:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065078.932283:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932287:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932290:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932294:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932299:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.932302:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932307:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932314:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fc00) 00010000:00010000:2.0:1746065078.932316:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.932319:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932323:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1461857 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932330:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932334:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932338:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932341:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.932343:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932347:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932351:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:2.0:1746065078.932353:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.932354:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932357:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc146185e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.932374:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461849 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c54a expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.932380:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461849 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c54a expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.932389:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:3.0:1746065078.932391:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27871:x1830881261367296:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 530us (654us total) trans 4294975403 rc 0/0 00000100:00100000:3.0:1746065078.932397:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4139 00000100:00100000:2.0:1746065078.932402:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27874:x1830881261367424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 227us (338us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.932406:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12022 00010000:00010000:1.0:1746065078.932517:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065078.932522:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.932527:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ae00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065078.932530:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.932535:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.932542:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32f:0x0].0x0 (ffff88012edbd300) 00010000:00010000:1.0:1746065078.932544:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065078.932548:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.932552:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ae00/0xad6b7ddc1461850 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x32f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065078.932562:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.932572:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065078.932573:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065078.937235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.937314:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261367552 00000100:00100000:2.0:1746065078.937321:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261367552 00000100:00100000:2.0:1746065078.937358:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12023 00000100:00100000:2.0:1746065078.937364:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27874:x1830881261367552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.937382:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.937399:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461865 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c551 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.937446:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146186c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.937456:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146186c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.937464:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146186c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065078.937497:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065078.937501:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065078.937526:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461865 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c551 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.937538:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146186c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c551 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.937544:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.937546:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065078.937548:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668a00, rc 0) 00000100:00100000:2.0:1746065078.937964:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27874:x1830881261367552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 599us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.937969:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12023 00000100:00100000:0.0:1746065078.957386:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.958894:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261367808 00000100:00100000:2.0:1746065078.958903:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261367808 00000100:00100000:2.0:1746065078.958956:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12024 00000100:00100000:2.0:1746065078.958964:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27875:x1830881261367808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065078.958980:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065078.958997:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461873 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c558 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.959059:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.959069:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959077:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959085:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065078.959090:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959095:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959122:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959126:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959131:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959138:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959143:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.959146:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959151:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959160:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:2.0:1746065078.959162:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.959165:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959170:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc146187a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959192:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959197:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959201:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959205:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065078.959207:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959211:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959221:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:2.0:1746065078.959223:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065078.959225:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959229:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461881 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065078.959249:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461873 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c558 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.959255:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1461873 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c558 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065078.959262:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668600, rc 0) 00000100:00100000:2.0:1746065078.959310:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27875:x1830881261367808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 348us (1933us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065078.959316:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12024 00000100:00100000:0.0:1746065078.964652:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.964683:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261368064 00000100:00100000:0.0:1746065078.964689:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261368064 00000100:00100000:0.0:1746065078.964738:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12025 00000100:00100000:0.0:1746065078.964746:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27874:x1830881261368064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065078.964764:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065078.964767:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065078.964808:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc146186c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c551 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065078.965085:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065078.965096:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.965149:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1461888 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c55f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.965242:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.965252:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.965260:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.965268:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.965274:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.965279:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966081:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.966089:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966095:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.966102:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 0 00010000:00010000:3.0:1746065078.966121:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966126:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966132:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966136:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966141:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.966143:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966148:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966154:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:3.0:1746065078.966156:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.966159:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966167:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc146188f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:3.0:1746065078.966189:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834ca80 reply state ffff88012be30000 transno 4294975404 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966196:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.966200:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:3.0:1746065078.966202:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065078.966205:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065078.966225:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1461888 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.966238:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.966243:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065078.966245:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.966247:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:3.0:1746065078.966302:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27874:x1830881261368064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1557us (1657us total) trans 4294975404 rc 0/0 00000100:00100000:3.0:1746065078.966309:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12025 00000100:00100000:0.0:1746065078.968718:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.970962:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261368320 00000100:00100000:3.0:1746065078.970972:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261368320 00000100:00100000:3.0:1746065078.971021:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12026 00000100:00100000:3.0:1746065078.971029:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27874:x1830881261368320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.971047:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.971062:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc14618ab lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c566 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.971141:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.971153:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.971160:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.971182:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.971190:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 281 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:3.0:1746065078.971200:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262618880:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065078.971629:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065078.972971:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262618880:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065078.972988:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065078.973626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065078.973707:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261368448 00000100:00100000:2.0:1746065078.973712:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261368448 00010000:00010000:2.0:1746065078.973739:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 282 pid: 7205 timeout: 774 lvb_type: 0 00000100:00100000:2.0:1746065078.973762:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3565 00000100:00100000:2.0:1746065078.973768:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+282:2004:x1830881261368448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065078.973819:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065078.973824:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 282 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.973839:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 282 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.973857:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146189d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c55f expref: 282 pid: 7205 timeout: 774 lvb_type: 0 00010000:00010000:2.0:1746065078.973883:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065078.973886:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.973893:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.973898:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065078.973913:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065078.973942:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.973948:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065078.973956:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+281:2004:x1830881261368448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 187us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065078.973962:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3565 00000004:00200000:3.0:1746065078.973967:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 0 00000004:00080000:3.0:1746065078.974098:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x355:0x0], index 1: 0 00000004:00080000:3.0:1746065078.974103:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x354:0x0], index 0: 0 00000004:00080000:3.0:1746065078.974107:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x355:0x0], index 0: 0 00000004:00080000:3.0:1746065078.974109:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x356:0x0], index 1: 0 00010000:00010000:3.0:1746065078.974173:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974179:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974183:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974187:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.974190:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974195:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974201:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065078.974203:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065078.974205:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974209:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc14618b2 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.974238:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc14618ab lrc: 1/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c566 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.974244:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc14618ab lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c566 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.974258:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:3.0:1746065078.977664:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27874:x1830881261368320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6625us (8941us total) trans 4294975405 rc 301/301 00000100:00100000:3.0:1746065078.977673:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12026 00000100:00100000:0.0:1746065078.980388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.980639:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261368704 00000100:00100000:3.0:1746065078.980646:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261368704 00000100:00100000:3.0:1746065078.980684:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4140 00000100:00100000:3.0:1746065078.980690:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27874:x1830881261368704:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065078.980934:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27874:x1830881261368704:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 243us (554us total) trans 4294975406 rc 0/0 00000100:00100000:3.0:1746065078.980940:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4140 00000100:00100000:0.0:1746065078.985191:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.986025:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261369216 00000100:00100000:3.0:1746065078.986033:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261369216 00000100:00100000:3.0:1746065078.986081:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12027 00000100:00100000:3.0:1746065078.986086:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27875:x1830881261369216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.986103:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.986121:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14618c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c56d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.986183:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.986193:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986202:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986210:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.986215:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986219:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065078.986235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065078.986288:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14618d5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065078.986294:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14618d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986299:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14618d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065078.986306:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 0 00010000:00010000:3.0:1746065078.986363:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986368:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986373:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986377:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986381:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.986384:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986393:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986401:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:3.0:1746065078.986488:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.986491:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986496:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14618c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986506:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986510:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986514:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986517:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065078.986519:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986522:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986528:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:3.0:1746065078.986529:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065078.986531:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986535:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc14618ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065078.986560:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14618c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c56d expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.986580:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14618d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c56d expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.986585:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065078.986587:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065078.986588:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a400, rc 0) 00000100:00100000:3.0:1746065078.986623:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27875:x1830881261369216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 537us (1439us total) trans 4294975407 rc 0/0 00000100:00100000:3.0:1746065078.986628:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12027 00000100:00100000:1.0:1746065078.986708:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261368960 00000100:00100000:1.0:1746065078.986712:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261368960 00000100:00100000:1.0:1746065078.986750:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4141 00000100:00100000:1.0:1746065078.986755:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27874:x1830881261368960:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065078.987136:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27874:x1830881261368960:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 379us (901us total) trans 4294975408 rc 0/0 00000100:00100000:1.0:1746065078.987142:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4141 00000100:00100000:0.0:1746065078.989504:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.989601:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261369344 00000100:00100000:3.0:1746065078.989608:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261369344 00000100:00100000:3.0:1746065078.990259:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8459 00000100:00100000:3.0:1746065078.990267:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261369344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065078.990283:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.990298:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c574 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065078.990318:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065078.990334:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.990336:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065078.990343:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.990356:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065078.990365:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e000, rc 0) 00000100:00100000:3.0:1746065078.990680:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881261369344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 414us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.990687:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8459 00000100:00100000:0.0:1746065078.993330:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.993883:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261369472 00000100:00100000:3.0:1746065078.993891:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261369472 00000100:00100000:3.0:1746065078.993928:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12028 00000100:00100000:3.0:1746065078.993935:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261369472:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065078.993955:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.993970:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44400/0xad6b7ddc14618ea lrc: 2/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c57b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.993999:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc14618f1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065078.994009:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc14618f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.994018:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc14618f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065078.994103:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44400/0xad6b7ddc14618ea lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c57b expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.994117:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc14618f1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c57b expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.994124:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065078.994127:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065078.994130:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fac00, rc 0) 00000100:00100000:3.0:1746065078.994187:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261369472:12345-192.168.202.27@tcp:101:bash.0 Request processed in 252us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065078.994193:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12028 00000100:00100000:0.0:1746065078.995038:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065078.995222:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261369728 00000100:00100000:1.0:1746065078.995228:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261369728 00000100:00100000:1.0:1746065078.996176:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12029 00000100:00100000:1.0:1746065078.996186:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27875:x1830881261369728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.996304:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065078.996319:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14618f8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c582 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.996400:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc14618ff lrc: 3/1,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.996409:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc14618ff lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.996417:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc14618ff lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065078.996427:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 0 00010000:00010000:1.0:1746065078.996513:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14618f8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c582 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.996526:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc14618ff lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c582 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.996532:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:1.0:1746065078.996534:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065078.996537:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97400, rc 0) 00000100:00100000:1.0:1746065078.996593:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27875:x1830881261369728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 410us (1558us total) trans 4294975409 rc 0/0 00000100:00100000:1.0:1746065078.996599:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12029 00000100:00100000:0.0:1746065078.999054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065078.999116:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065078.999601:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261369984 00000100:00100000:1.0:1746065078.999603:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261370112 00000100:00100000:3.0:1746065078.999608:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261369984 00000100:00100000:1.0:1746065078.999608:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261370112 00000100:00100000:3.0:1746065078.999641:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12030 00000100:00100000:3.0:1746065078.999647:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261369984:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:1.0:1746065078.999664:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12031 00000100:00100000:1.0:1746065078.999671:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27875:x1830881261370112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065078.999683:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065078.999685:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065078.999697:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146190d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c589 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.999703:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14618d5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c56d expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065078.999715:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065078.999718:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065078.999750:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065078.999760:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.999768:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065078.999823:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 0 00000004:00200000:1.0:1746065078.999827:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065078.999839:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065078.999857:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146190d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.999868:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065078.999874:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:1.0:1746065078.999876:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065078.999878:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96800, rc 0) 00000100:00100000:1.0:1746065078.999915:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27875:x1830881261370112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 246us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065078.999921:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12031 00010000:00010000:3.0:1746065079.001076:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.001088:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.001094:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 4/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.001117:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.001126:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 288 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.001141:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262619008:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.002079:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.002643:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.002710:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261370368 00000100:00100000:1.0:1746065079.002716:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261370368 00000100:00100000:1.0:1746065079.002748:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12032 00000100:00100000:1.0:1746065079.002754:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27875:x1830881261370368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.002767:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.002796:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461922 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c590 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.002855:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.002867:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.002875:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.002882:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.002886:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.002891:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.002971:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.002978:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.002983:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065079.002990:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 0 00010000:00010000:1.0:1746065079.003045:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003050:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003055:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003059:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003065:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.003068:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003074:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003081:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065079.003084:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.003086:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003091:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461929 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003099:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003103:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003107:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003110:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.003112:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003116:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003121:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:1.0:1746065079.003122:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.003125:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003129:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461930 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.003153:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461922 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.003166:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.003172:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.003173:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:1.0:1746065079.003175:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779e00, rc 0) 00000100:00100000:1.0:1746065079.004944:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27875:x1830881261370368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2182us (2296us total) trans 4294975411 rc 0/0 00000100:00100000:1.0:1746065079.004953:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12032 00000100:00100000:2.0:1746065079.006049:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.006116:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262619008:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.006136:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065079.006331:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261370496 00000100:00100000:0.0:1746065079.006337:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261370496 00010000:00010000:0.0:1746065079.006365:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 291 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.006385:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3566 00000100:00100000:0.0:1746065079.006390:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+291:2007:x1830881261370496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.006401:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.006406:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 291 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.006415:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 291 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.006433:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461914 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c589 expref: 291 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.006448:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:0.0:1746065079.006452:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.006459:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.006464:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.006476:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.006504:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+290:2007:x1830881261370496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.006510:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3566 00010000:00010000:3.0:1746065079.007161:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.007168:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065079.007231:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975410 00000004:00010000:3.0:1746065079.007260:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834f100 reply state ffff88009aa01000 transno 4294975412 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.007268:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.007273:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.007275:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.007277:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.007332:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261369984:12345-192.168.202.27@tcp:36:bash.0 Request processed in 7684us (8283us total) trans 4294975412 rc 0/0 00000100:00100000:3.0:1746065079.007337:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12030 00000020:00080000:3.0:1746065079.007340:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065079.008838:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.008999:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261370752 00000100:00100000:1.0:1746065079.009006:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261370752 00000100:00100000:1.0:1746065079.009371:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4142 00000100:00100000:1.0:1746065079.009379:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27875:x1830881261370752:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065079.009527:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27875:x1830881261370752:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 148us (695us total) trans 4294975413 rc 0/0 00000100:00100000:1.0:1746065079.009545:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4142 00000100:00100000:2.0:1746065079.015077:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.015125:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.015192:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261371008 00000100:00100000:1.0:1746065079.015201:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261371008 00000100:00100000:1.0:1746065079.015243:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261371136 00000100:00100000:1.0:1746065079.015246:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261371136 00000100:00100000:1.0:1746065079.015259:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4143 00000100:00100000:1.0:1746065079.015264:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261371008:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065079.015443:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261371008:12345-192.168.202.27@tcp:35:bash.0 Request processed in 177us (373us total) trans 4294975414 rc 0/0 00000100:00100000:1.0:1746065079.015449:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4143 00000100:00100000:1.0:1746065079.015463:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4144 00000100:00100000:1.0:1746065079.015467:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27875:x1830881261371136:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065079.015516:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27875:x1830881261371136:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 48us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.015521:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4144 00000100:00100000:0.0:1746065079.019390:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.019856:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261371392 00000100:00100000:3.0:1746065079.019863:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261371392 00000100:00100000:3.0:1746065079.020437:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12033 00000100:00100000:3.0:1746065079.020446:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261371392:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.020467:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.020470:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065079.020495:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc14618ff lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c582 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.020707:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.020711:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.020723:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461945 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c597 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.020765:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.021937:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.021947:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.021975:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.021987:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 293 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.021998:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262619136:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.022492:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.025160:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262619136:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.025181:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065079.027953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.028654:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261371520 00000100:00100000:2.0:1746065079.028662:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261371520 00010000:00010000:2.0:1746065079.028703:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 294 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.028733:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3567 00000100:00100000:2.0:1746065079.028741:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261371520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.028755:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.028760:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 294 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.028790:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 294 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.028811:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461937 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c590 expref: 294 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.029419:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:2.0:1746065079.029425:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.029433:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.029438:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.029465:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.029506:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+293:2004:x1830881261371520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 765us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.029513:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3567 00010000:00010000:3.0:1746065079.029800:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.029807:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065079.030986:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000040:00080000:3.0:1746065079.031118:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2381, 88 off197344 00000004:00080000:3.0:1746065079.031127:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675049352384ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065079.031152:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2377, 88 off196912 00000004:00080000:3.0:1746065079.031156:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675049382232ns, next at 675481534386ns, rc = 0 00000040:00080000:3.0:1746065079.031510:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2378, 88 off197000 00000004:00080000:3.0:1746065079.031513:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675049739448ns, next at 675481534386ns, rc = 0 00000040:00080000:3.0:1746065079.031521:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2382, 88 off197432 00000004:00080000:3.0:1746065079.031523:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675049749767ns, next at 675481510748ns, rc = 0 00000100:00100000:1.0:1746065079.031527:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261371776 00000100:00100000:1.0:1746065079.031532:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261371776 00000100:00100000:1.0:1746065079.031561:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12034 00000100:00100000:1.0:1746065079.031578:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27876:x1830881261371776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.031592:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.031607:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461953 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c59e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.031672:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.031685:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031693:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031701:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.031707:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031712:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031793:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.031801:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031806:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065079.031814:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 2 00010000:00010000:1.0:1746065079.031851:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031857:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031862:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031866:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.031870:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031875:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031882:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.031885:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746065079.031888:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031892:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461968 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031902:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031907:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031911:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031915:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031919:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.031921:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031925:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031930:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd200) 00010000:00010000:1.0:1746065079.031932:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.031934:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031938:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97400/0xad6b7ddc146195a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031944:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031948:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031952:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031956:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.031958:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031962:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031967:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:1.0:1746065079.031969:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.031971:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.031975:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461961 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.032006:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461953 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c59e expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.032012:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96800/0xad6b7ddc1461953 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c59e expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.032022:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96800, rc 0) 00000100:00100000:1.0:1746065079.032274:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27876:x1830881261371776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 477us (1071us total) trans 4294975416 rc 301/301 00000100:00100000:1.0:1746065079.032280:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12034 00000100:00100000:0.0:1746065079.035560:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.036209:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261371904 00000100:00100000:1.0:1746065079.036217:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261371904 00000100:00100000:1.0:1746065079.036253:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12035 00000100:00100000:1.0:1746065079.036260:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27876:x1830881261371904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.036276:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.036291:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461976 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5a5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.036364:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.036374:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.036380:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 4/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.036394:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.036401:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:2.0:1746065079.036494:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975416 is committed 00000004:00080000:2.0:1746065079.036502:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1608 committed 00000004:00080000:2.0:1746065079.036508:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1598 committed 00000004:00080000:2.0:1746065079.036512:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1597 committed 00000004:00080000:2.0:1746065079.036513:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1607 committed 00000100:00100000:0.0:1746065079.036664:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262619264:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.036703:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.036733:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262619264 00000100:00100000:0.0:1746065079.036736:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262619264 00000100:00100000:0.0:1746065079.036755:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8460 00000100:00100000:0.0:1746065079.036759:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3760:x1830881262619264:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065079.036786:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:851 count 1 00010000:00010000:0.0:1746065079.036801:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.036812:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.036818:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065079.036819:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065079.036821:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.036835:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.036843:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 30 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.036850:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262619776:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.036952:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262619392:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.036972:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065079.036975:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.036976:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262619648:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.036989:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065079.036991:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.036992:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262619520:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.037004:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.037005:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.037014:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262619392 00000100:00100000:0.0:1746065079.037016:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262619392 00000100:00100000:0.0:1746065079.037029:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262619648 00000100:00100000:0.0:1746065079.037031:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262619648 00000100:00100000:0.0:1746065079.037040:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262619520 00000100:00100000:0.0:1746065079.037041:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262619520 00010000:00010000:3.0:1746065079.037048:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c597 expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.037050:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8461 00000100:00100000:0.0:1746065079.037054:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3761:x1830881262619392:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065079.037057:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.037059:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065079.037061:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00002000:00080000:0.0:1746065079.037062:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:852 count 1 00010000:00010000:3.0:1746065079.037070:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.037070:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.037075:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.037079:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.037084:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.037085:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.037087:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.037094:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461945 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c597 expref: 277 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065079.037098:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.037105:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 30 pid: 3067 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746065079.037106:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c597 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.037112:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262619904:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.037120:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67000, rc 0) 00000100:00100000:0.0:1746065079.037131:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.037137:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261371392:12345-192.168.202.27@tcp:101:bash.0 Request processed in 16693us (17756us total) trans 4294975415 rc 0/0 00000100:00100000:0.0:1746065079.037142:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8462 00000100:00100000:3.0:1746065079.037143:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12033 00000100:00100000:0.0:1746065079.037147:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+39:3760:x1830881262619648:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065079.037160:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.037164:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.037187:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 2 00000004:00200000:3.0:1746065079.037191:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.037202:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.037220:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461976 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.037228:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.037234:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.037236:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065079.037238:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01a00, rc 0) 00000100:00100000:0.0:1746065079.037239:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+40:3760:x1830881262619648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 93us (248us total) trans 17179872490 rc 0/0 00000100:00100000:0.0:1746065079.037244:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8462 00000100:00100000:3.0:1746065079.037253:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27876:x1830881261371904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 994us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.037255:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8463 00000100:00100000:3.0:1746065079.037258:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12035 00000100:00100000:0.0:1746065079.037258:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+39:3761:x1830881262619520:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065079.037295:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065079.037298:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.037300:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.037302:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.037304:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065079.037322:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+40:3761:x1830881262619520:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (317us total) trans 17179872491 rc 0/0 00000100:00100000:0.0:1746065079.037327:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8463 00000004:00080000:3.0:1746065079.037342:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85e300/2, rc 0, transno 17179872491 00000004:00080000:0.0:1746065079.037344:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85ca80/2, rc 0, transno 17179872490 00000100:00100000:3.0:1746065079.037346:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262619520:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.037346:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262619648:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.037713:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037721:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037725:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037730:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.037733:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037739:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037747:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:1.0:1746065079.037749:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.037752:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037756:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc1461803 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.037766:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037770:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037798:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037802:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.037804:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037808:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037813:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554fa00) 00010000:00010000:1.0:1746065079.037815:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.037817:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037824:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577bc00/0xad6b7ddc1461896 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.037835:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.037839:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.037844:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.037848:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.037850:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.037854:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.037859:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.037861:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.037863:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.037867:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc146191b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065079.037983:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262620416:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.038010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.038027:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065079.038031:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262620032:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.038044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.038059:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262620416 00000100:00100000:2.0:1746065079.038062:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262620416 00000100:00100000:2.0:1746065079.038078:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262620032 00000100:00100000:2.0:1746065079.038079:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262620032 00000100:00100000:2.0:1746065079.038087:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8464 00000100:00100000:2.0:1746065079.038091:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+231:3759:x1830881262620416:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.038170:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+232:3759:x1830881262620416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 78us (159us total) trans 21474839768 rc 0/0 00000100:00100000:2.0:1746065079.038175:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8464 00000100:00100000:2.0:1746065079.038184:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8465 00000100:00100000:2.0:1746065079.038188:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+231:3759:x1830881262620032:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.038197:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:850 count 1 00010000:00010000:2.0:1746065079.038206:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.038216:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 89 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.038222:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.038224:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.038226:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.038244:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 89 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.038252:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 89 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.038255:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262620288:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.038260:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262620544:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.038275:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.038289:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.038290:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262620160:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.038303:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.039637:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262620288 00000100:00100000:1.0:1746065079.039644:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262620288 00000100:00100000:1.0:1746065079.039672:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262620160 00000100:00100000:1.0:1746065079.039674:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262620160 00000100:00100000:1.0:1746065079.039687:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8466 00000100:00100000:1.0:1746065079.039692:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+233:3762:x1830881262620288:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.039834:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+234:3762:x1830881262620288:12345-0@lo:2:osp-syn-0-1.0 Request processed in 141us (1557us total) trans 21474839769 rc 0/0 00000100:00100000:1.0:1746065079.039839:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8466 00000100:00100000:1.0:1746065079.039852:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8467 00000100:00100000:1.0:1746065079.039856:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+233:3761:x1830881262620160:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065079.039865:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:851 count 1 00010000:00010000:1.0:1746065079.039875:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.039887:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 89 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065079.039893:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.039895:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.039896:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.039913:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 89 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065079.039921:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 89 pid: 1880 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746065079.039931:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262620672:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065079.039971:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe780 going to sleep for 11 seconds 00000004:00080000:2.0:1746065079.040055:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982ddc00/2, rc 0, transno 21474839768 00000100:00100000:2.0:1746065079.040061:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262620416:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065079.040127:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dc380/2, rc 0, transno 21474839769 00000100:00100000:3.0:1746065079.040131:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262620288:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.045608:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.045637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.045652:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.045679:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372160 00000100:00100000:0.0:1746065079.045686:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372160 00010000:00010000:0.0:1746065079.045724:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 31 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.045746:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372288 00000100:00100000:0.0:1746065079.045748:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372288 00010000:00010000:0.0:1746065079.045758:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 32 pid: 3067 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746065079.045804:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3568 00000100:00100000:0.0:1746065079.045810:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261372160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.045821:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.045825:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 32 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.045834:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 32 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.045871:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.045873:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.045877:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.045885:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.045904:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.045926:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3569 00000100:00100000:3.0:1746065079.045934:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261372288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065079.045938:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261372160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 127us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065079.045941:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065079.045944:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3568 00010000:00010000:3.0:1746065079.045947:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 32 pid: 3067 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746065079.045956:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 31 pid: 3067 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746065079.045972:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.045973:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.045976:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.045982:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.045991:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.046007:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261372288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.046013:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3569 00010000:00010000:2.0:1746065079.046092:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc14617d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c527 expref: 30 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.046118:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262619776:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.046130:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.046137:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.046142:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.046148:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.046155:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.046183:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065079.046228:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.046234:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.046240:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7f000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.046244:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.046251:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.046261:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.046266:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461984 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.046281:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.046282:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.046283:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.047100:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c800/0xad6b7ddc14616f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4da expref: 29 pid: 3067 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746065079.047127:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262619904:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.047148:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.047152:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065079.047155:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.047160:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.047167:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.047172:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.047183:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065079.047185:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372416 00000100:00100000:0.0:1746065079.047189:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372416 00000100:00100000:0.0:1746065079.047219:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8468 00000100:00100000:0.0:1746065079.047225:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:26180:x1830881261372416:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065079.047248:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.047257:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5b3 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.047274:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.047280:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.047281:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.047284:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.047301:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.047310:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746065079.047321:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262620800:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.047360:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.047439:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372032 00000100:00100000:0.0:1746065079.047443:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372032 00000100:00100000:0.0:1746065079.047464:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12036 00000100:00100000:0.0:1746065079.047468:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27876:x1830881261372032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.047477:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.047486:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14619a7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5ac expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.047539:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14619a7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5ac expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.047549:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14619a7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5ac expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.047561:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:0.0:1746065079.047575:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065079.047578:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:2.0:1746065079.047718:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+40:3760:x1830881262619264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10957us (11013us total) trans 17179872492 rc 0/0 00000100:00100000:2.0:1746065079.048021:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8460 00000004:00080000:2.0:1746065079.048061:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85d180/2, rc 0, transno 17179872492 00000100:00100000:2.0:1746065079.048066:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262619264:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.048336:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27876:x1830881261372032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 866us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.048342:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12036 00000100:00100000:1.0:1746065079.048469:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+40:3761:x1830881262619392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11413us (11491us total) trans 17179872493 rc 0/0 00000100:00100000:1.0:1746065079.048475:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8461 00000004:00080000:3.0:1746065079.048487:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85fb80/2, rc 0, transno 17179872493 00010000:00010000:1.0:1746065079.048490:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1746065079.048491:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262619392:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.048495:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.048501:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f7800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.048521:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.048528:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.048577:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262620544:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.048602:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.049293:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.049302:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7800/0xad6b7ddc146198b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.049316:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.049317:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.049319:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065079.049335:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262620672:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.049346:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746065079.049659:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839769 is committed 00000001:00080000:0.0:1746065079.049666:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839767 is committed 00000100:00100000:0.0:1746065079.051910:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.051945:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.052094:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.052186:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262620800:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.052212:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.052225:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f6e00, rc 0) 00000100:00100000:1.0:1746065079.052271:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:26180:x1830881261372416:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5045us (5119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.052279:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8468 00000100:00100000:0.0:1746065079.052360:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.052435:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.052470:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372672 00000100:00100000:2.0:1746065079.052476:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372672 00010000:00010000:2.0:1746065079.052502:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 18 pid: 1880 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.052524:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372544 00000100:00100000:2.0:1746065079.052526:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372544 00010000:00010000:2.0:1746065079.052534:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 19 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.052545:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372800 00000100:00100000:2.0:1746065079.052547:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372800 00010000:00010000:2.0:1746065079.052554:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.052577:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3570 00000100:00100000:2.0:1746065079.052583:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881261372672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.052593:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.052597:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 19 pid: 1880 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.052605:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 19 pid: 1880 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.052624:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1461700 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c4e1 expref: 19 pid: 1880 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.052636:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.052639:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.052643:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052650:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052665:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.052681:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+18:2004:x1830881261372672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.052686:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3570 00000100:00100000:2.0:1746065079.052696:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3571 00000100:00100000:2.0:1746065079.052700:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+17:2004:x1830881261372544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.052706:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.052710:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 17 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.052716:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 17 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.052726:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc14617cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c520 expref: 17 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.052733:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.052734:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.052737:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052742:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052753:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.052766:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+16:2004:x1830881261372544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.052771:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3571 00000100:00100000:2.0:1746065079.052795:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3572 00000100:00100000:2.0:1746065079.052800:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261372800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.052806:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.052810:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.052817:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.052828:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580e000/0xad6b7ddc14618e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c574 expref: 30 pid: 10219 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.052841:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.052842:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.052847:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052853:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052872:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.052881:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881262620928:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065079.052915:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4fb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065079.052931:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052937:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052945:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052952:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.052964:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.053175:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262620160:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13317us (14870us total) trans 21474839770 rc 0/0 00000100:00100000:2.0:1746065079.053181:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8467 00000100:00100000:2.0:1746065079.053193:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261372928 00000100:00100000:2.0:1746065079.053196:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261372928 00000100:00100000:2.0:1746065079.053208:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8469 00000100:00100000:2.0:1746065079.053211:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261372928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.053221:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.053229:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e000/0xad6b7ddc14619ae lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5ba expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.053249:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262621056:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065079.053266:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065079.053278:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.053282:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053288:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.053291:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053313:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053323:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053328:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00200/0xad6b7ddc1461999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053339:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.053340:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.053342:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.053350:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053356:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053362:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053367:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.053375:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.053451:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881262620032:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15262us (15405us total) trans 21474839771 rc 0/0 00000100:00100000:2.0:1746065079.053456:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8465 00000100:00100000:2.0:1746065079.053481:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839769 gen 2 00000004:00080000:2.0:1746065079.053485:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c000, transno 21474839482 00000004:00080000:2.0:1746065079.053492:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ed80, transno 21474839483 00000004:00080000:2.0:1746065079.053494:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf0000, transno 21474839486 00000004:00080000:2.0:1746065079.053496:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1180, transno 21474839487 00000004:00080000:2.0:1746065079.053498:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dfb80, transno 21474839489 00000004:00080000:2.0:1746065079.053500:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982df800, transno 21474839490 00000004:00080000:2.0:1746065079.053502:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dca80, transno 21474839491 00000004:00080000:2.0:1746065079.053504:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f100, transno 21474839492 00000004:00080000:2.0:1746065079.053506:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ceaa00, transno 21474839494 00000004:00080000:2.0:1746065079.053508:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce9c00, transno 21474839495 00000004:00080000:2.0:1746065079.053510:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37fb80, transno 21474839496 00000004:00080000:2.0:1746065079.053512:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cead80, transno 21474839497 00000004:00080000:2.0:1746065079.053515:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37c000, transno 21474839498 00000004:00080000:2.0:1746065079.053516:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f800, transno 21474839499 00000004:00080000:2.0:1746065079.053518:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ceb100, transno 21474839502 00000004:00080000:2.0:1746065079.053520:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ceb800, transno 21474839503 00000004:00080000:2.0:1746065079.053522:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc2a00, transno 21474839505 00000004:00080000:2.0:1746065079.053524:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1c00, transno 21474839506 00000004:00080000:2.0:1746065079.053525:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc2300, transno 21474839507 00000004:00080000:2.0:1746065079.053527:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1180, transno 21474839508 00000004:00080000:2.0:1746065079.053530:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85d500, transno 21474839510 00000004:00080000:2.0:1746065079.053532:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a7480, transno 21474839511 00000004:00080000:2.0:1746065079.053534:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a6d80, transno 21474839512 00000004:00080000:2.0:1746065079.053535:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85f800, transno 21474839513 00000004:00080000:2.0:1746065079.053538:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e300, transno 21474839514 00000004:00080000:2.0:1746065079.053539:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc000, transno 21474839515 00000004:00080000:2.0:1746065079.053542:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1f80, transno 21474839518 00000004:00080000:2.0:1746065079.053544:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577fb80, transno 21474839519 00000004:00080000:2.0:1746065079.053561:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cd880, transno 21474839521 00000004:00080000:2.0:1746065079.053572:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cf480, transno 21474839522 00000004:00080000:2.0:1746065079.053574:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12d80, transno 21474839523 00000004:00080000:2.0:1746065079.053576:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12a00, transno 21474839524 00000004:00080000:2.0:1746065079.053578:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e13800, transno 21474839525 00000004:00080000:2.0:1746065079.053580:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e11c00, transno 21474839526 00000004:00080000:2.0:1746065079.053582:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd1c00, transno 21474839528 00000004:00080000:2.0:1746065079.053584:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925ce300, transno 21474839529 00000004:00080000:2.0:1746065079.053593:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098672a00, transno 21474839531 00000004:00080000:2.0:1746065079.053595:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098672d80, transno 21474839532 00000004:00080000:2.0:1746065079.053597:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098671880, transno 21474839533 00000004:00080000:2.0:1746065079.053599:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098670380, transno 21474839534 00000004:00080000:2.0:1746065079.053601:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e53b80, transno 21474839537 00000004:00080000:2.0:1746065079.053603:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e52d80, transno 21474839538 00000004:00080000:2.0:1746065079.053605:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cf800, transno 21474839539 00000004:00080000:2.0:1746065079.053607:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cc380, transno 21474839540 00000004:00080000:2.0:1746065079.053609:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d15880, transno 21474839541 00000004:00080000:2.0:1746065079.053611:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d15500, transno 21474839542 00000004:00080000:2.0:1746065079.053613:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d14700, transno 21474839545 00000004:00080000:2.0:1746065079.053615:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d16a00, transno 21474839546 00000004:00080000:2.0:1746065079.053617:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45b480, transno 21474839547 00000004:00080000:2.0:1746065079.053619:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458a80, transno 21474839548 00000004:00080000:2.0:1746065079.053621:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458380, transno 21474839549 00000004:00080000:2.0:1746065079.053622:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458700, transno 21474839550 00000004:00080000:2.0:1746065079.053624:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458000, transno 21474839551 00000004:00080000:2.0:1746065079.053626:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459f80, transno 21474839552 00000004:00080000:2.0:1746065079.053628:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a93100, transno 21474839554 00000004:00080000:2.0:1746065079.053630:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90e00, transno 21474839555 00000004:00080000:2.0:1746065079.053632:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91180, transno 21474839556 00000004:00080000:2.0:1746065079.053634:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a93800, transno 21474839557 00000004:00080000:2.0:1746065079.053635:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ccb100, transno 21474839559 00000004:00080000:2.0:1746065079.053637:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c8e00, transno 21474839560 00000004:00080000:2.0:1746065079.053639:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc9880, transno 21474839561 00000004:00080000:2.0:1746065079.053641:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c8a80, transno 21474839562 00000004:00080000:2.0:1746065079.053644:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed6d80, transno 21474839565 00000004:00080000:2.0:1746065079.053646:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed7480, transno 21474839566 00000004:00080000:2.0:1746065079.053648:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc8e00, transno 21474839568 00000004:00080000:2.0:1746065079.053650:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc9f80, transno 21474839569 00000004:00080000:2.0:1746065079.053652:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834dc00, transno 21474839570 00000004:00080000:2.0:1746065079.053654:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ce00, transno 21474839571 00000004:00080000:2.0:1746065079.053655:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c9180, transno 21474839573 00000004:00080000:2.0:1746065079.053657:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c9500, transno 21474839574 00000004:00080000:2.0:1746065079.053659:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c8380, transno 21474839575 00000004:00080000:2.0:1746065079.053661:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c000, transno 21474839576 00000004:00080000:2.0:1746065079.053663:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bd180, transno 21474839577 00000004:00080000:2.0:1746065079.053665:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bc380, transno 21474839578 00000004:00080000:2.0:1746065079.053666:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bea00, transno 21474839579 00000004:00080000:2.0:1746065079.053668:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bd880, transno 21474839580 00000004:00080000:2.0:1746065079.053670:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3800, transno 21474839582 00000004:00080000:2.0:1746065079.053671:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce9880, transno 21474839583 00000004:00080000:2.0:1746065079.053673:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3b80, transno 21474839584 00000004:00080000:2.0:1746065079.053675:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ce8700, transno 21474839585 00000004:00080000:2.0:1746065079.053676:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3480, transno 21474839586 00000004:00080000:2.0:1746065079.053678:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc0380, transno 21474839587 00000004:00080000:2.0:1746065079.053680:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da680, transno 21474839589 00000004:00080000:2.0:1746065079.053682:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957dad80, transno 21474839590 00000004:00080000:2.0:1746065079.053684:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45a680, transno 21474839591 00000004:00080000:2.0:1746065079.053686:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90380, transno 21474839592 00000004:00080000:2.0:1746065079.053688:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a92a00, transno 21474839593 00000004:00080000:2.0:1746065079.053690:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91c00, transno 21474839594 00000004:00080000:2.0:1746065079.053692:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfd500, transno 21474839596 00000004:00080000:2.0:1746065079.053694:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a649880, transno 21474839597 00000004:00080000:2.0:1746065079.053696:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6d80, transno 21474839598 00000004:00080000:2.0:1746065079.053699:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528000, transno 21474839599 00000004:00080000:2.0:1746065079.053701:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90000, transno 21474839600 00000004:00080000:2.0:1746065079.053703:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cd180, transno 21474839601 00000004:00080000:2.0:1746065079.053705:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f8000, transno 21474839603 00000004:00080000:2.0:1746065079.053707:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f9500, transno 21474839604 00000004:00080000:2.0:1746065079.053709:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4f8a80, transno 21474839605 00000004:00080000:2.0:1746065079.053711:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4fb480, transno 21474839606 00000004:00080000:2.0:1746065079.053713:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098358700, transno 21474839609 00000004:00080000:2.0:1746065079.053715:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835b100, transno 21474839610 00000004:00080000:2.0:1746065079.053717:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098358380, transno 21474839612 00000004:00080000:2.0:1746065079.053719:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098358000, transno 21474839613 00000004:00080000:2.0:1746065079.053721:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bf480, transno 21474839614 00000004:00080000:2.0:1746065079.053723:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2bce00, transno 21474839615 00000004:00080000:2.0:1746065079.053725:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f480, transno 21474839616 00000004:00080000:2.0:1746065079.053727:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f800, transno 21474839617 00000004:00080000:2.0:1746065079.053729:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10380, transno 21474839619 00000004:00080000:2.0:1746065079.053730:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12300, transno 21474839620 00000004:00080000:2.0:1746065079.053732:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10700, transno 21474839621 00000004:00080000:2.0:1746065079.053734:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e11500, transno 21474839622 00000004:00080000:2.0:1746065079.053736:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098581180, transno 21474839625 00000004:00080000:2.0:1746065079.053737:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098582680, transno 21474839626 00000004:00080000:2.0:1746065079.053739:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982de680, transno 21474839628 00000004:00080000:2.0:1746065079.053741:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223b80, transno 21474839629 00000004:00080000:2.0:1746065079.053743:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5c00, transno 21474839630 00000004:00080000:2.0:1746065079.053745:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5180, transno 21474839631 00000004:00080000:2.0:1746065079.053747:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5c00, transno 21474839633 00000004:00080000:2.0:1746065079.053748:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098580700, transno 21474839634 00000004:00080000:2.0:1746065079.053750:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098580000, transno 21474839635 00000004:00080000:2.0:1746065079.053753:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6d80, transno 21474839636 00000004:00080000:2.0:1746065079.053754:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098583100, transno 21474839637 00000004:00080000:2.0:1746065079.053757:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098581c00, transno 21474839638 00000004:00080000:2.0:1746065079.053759:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4380, transno 21474839640 00000004:00080000:2.0:1746065079.053765:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5880, transno 21474839641 00000004:00080000:2.0:1746065079.053766:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5180, transno 21474839642 00000004:00080000:2.0:1746065079.053769:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4a80, transno 21474839643 00000004:00080000:2.0:1746065079.053790:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c53c380, transno 21474839645 00000004:00080000:2.0:1746065079.053792:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cfb80, transno 21474839646 00000004:00080000:2.0:1746065079.053798:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bdf80, transno 21474839648 00000004:00080000:2.0:1746065079.053800:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c525500, transno 21474839649 00000004:00080000:2.0:1746065079.053802:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570e680, transno 21474839650 00000004:00080000:2.0:1746065079.053804:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ca80, transno 21474839651 00000004:00080000:2.0:1746065079.053806:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ea00, transno 21474839652 00000004:00080000:2.0:1746065079.053808:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d500, transno 21474839653 00000004:00080000:2.0:1746065079.053809:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4e00, transno 21474839656 00000004:00080000:2.0:1746065079.053811:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3800, transno 21474839657 00000004:00080000:2.0:1746065079.053813:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abb8700, transno 21474839659 00000100:00100000:0.0:1746065079.053813:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261373056 00000004:00080000:2.0:1746065079.053815:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abbbb80, transno 21474839660 00000004:00080000:2.0:1746065079.053816:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ed08700, transno 21474839662 00000100:00100000:0.0:1746065079.053817:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261373056 00000004:00080000:2.0:1746065079.053818:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ed09180, transno 21474839663 00000004:00080000:2.0:1746065079.053820:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85f480, transno 21474839664 00000004:00080000:2.0:1746065079.053821:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85c000, transno 21474839665 00000004:00080000:2.0:1746065079.053823:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c53c700, transno 21474839666 00000004:00080000:2.0:1746065079.053824:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85f100, transno 21474839667 00000004:00080000:2.0:1746065079.053826:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f2b8000, transno 21474839668 00000004:00080000:2.0:1746065079.053828:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c53f100, transno 21474839669 00000004:00080000:2.0:1746065079.053829:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1880, transno 21474839671 00000004:00080000:2.0:1746065079.053831:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc0e00, transno 21474839672 00000004:00080000:2.0:1746065079.053833:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098673480, transno 21474839673 00000004:00080000:2.0:1746065079.053834:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1500, transno 21474839674 00000004:00080000:2.0:1746065079.053836:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098671500, transno 21474839676 00000100:00100000:0.0:1746065079.053838:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 547 00000004:00080000:2.0:1746065079.053839:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098671c00, transno 21474839677 00000004:00080000:2.0:1746065079.053841:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f41c00, transno 21474839678 00000004:00080000:2.0:1746065079.053843:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f40700, transno 21474839679 00000100:00100000:0.0:1746065079.053844:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+273:2007:x1830881261373056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1746065079.053845:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858fb80, transno 21474839680 00000004:00080000:2.0:1746065079.053846:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858f800, transno 21474839681 00000004:00080000:2.0:1746065079.053848:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf3800, transno 21474839683 00000004:00080000:2.0:1746065079.053850:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef27800, transno 21474839684 00000004:00080000:2.0:1746065079.053851:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef26300, transno 21474839685 00010000:00010000:0.0:1746065079.053851:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1746065079.053853:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25c00, transno 21474839686 00000004:00080000:2.0:1746065079.053855:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef27b80, transno 21474839687 00000004:00080000:2.0:1746065079.053857:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2a00, transno 21474839688 00000004:00080000:2.0:1746065079.053859:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4000, transno 21474839690 00000004:00080000:2.0:1746065079.053860:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4700, transno 21474839691 00000004:00080000:2.0:1746065079.053862:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cd180, transno 21474839692 00000004:00080000:2.0:1746065079.053864:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cfb80, transno 21474839693 00010000:00010000:0.0:1746065079.053864:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14619a7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5ac expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746065079.053866:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e51880, transno 21474839694 00000004:00080000:2.0:1746065079.053868:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e53480, transno 21474839695 00000004:00080000:2.0:1746065079.053870:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fe680, transno 21474839697 00000004:00080000:2.0:1746065079.053871:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc380, transno 21474839698 00000004:00080000:2.0:1746065079.053874:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fe300, transno 21474839699 00000004:00080000:2.0:1746065079.053875:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc700, transno 21474839700 00000004:00080000:2.0:1746065079.053877:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fed80, transno 21474839701 00000004:00080000:2.0:1746065079.053878:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd880, transno 21474839702 00010000:00010000:0.0:1746065079.053883:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:0.0:1746065079.053886:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1746065079.053893:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3480, transno 21474839704 00000004:00080000:2.0:1746065079.053896:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7ff480, transno 21474839705 00000004:00080000:2.0:1746065079.053898:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fdc00, transno 21474839706 00000004:00080000:2.0:1746065079.053900:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7ff800, transno 21474839707 00000100:00100000:0.0:1746065079.053901:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+272:2007:x1830881261373056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (1466us total) trans 0 rc 0/0 00000004:00080000:2.0:1746065079.053902:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3800, transno 21474839710 00000004:00080000:2.0:1746065079.053904:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3b80, transno 21474839711 00000004:00080000:2.0:1746065079.053907:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c8700, transno 21474839713 00000100:00100000:0.0:1746065079.053907:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 547 00000004:00080000:2.0:1746065079.053909:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925ca680, transno 21474839714 00000004:00080000:2.0:1746065079.053911:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c525f80, transno 21474839716 00000004:00080000:2.0:1746065079.053913:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c524000, transno 21474839717 00000004:00080000:2.0:1746065079.053915:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c527480, transno 21474839718 00000004:00080000:2.0:1746065079.053917:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c524380, transno 21474839719 00000004:00080000:2.0:1746065079.053919:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c524a80, transno 21474839720 00000004:00080000:2.0:1746065079.053921:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c526680, transno 21474839721 00000004:00080000:2.0:1746065079.053922:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c527100, transno 21474839722 00000004:00080000:2.0:1746065079.053924:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c524700, transno 21474839723 00000004:00080000:2.0:1746065079.053926:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345180, transno 21474839726 00000004:00080000:2.0:1746065079.053928:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc8700, transno 21474839727 00000004:00080000:2.0:1746065079.053930:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cb100, transno 21474839729 00000004:00080000:2.0:1746065079.053932:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dce00, transno 21474839730 00000004:00080000:2.0:1746065079.053934:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a64ad80, transno 21474839731 00000004:00080000:2.0:1746065079.053936:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a648e00, transno 21474839732 00000004:00080000:2.0:1746065079.053937:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c529500, transno 21474839734 00000004:00080000:2.0:1746065079.053939:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52ad80, transno 21474839735 00000004:00080000:2.0:1746065079.053941:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52b480, transno 21474839736 00000004:00080000:2.0:1746065079.053943:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52a300, transno 21474839737 00000004:00080000:2.0:1746065079.053945:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528700, transno 21474839738 00000004:00080000:2.0:1746065079.053947:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52aa00, transno 21474839739 00000004:00080000:2.0:1746065079.053949:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098666a00, transno 21474839741 00000004:00080000:2.0:1746065079.053950:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dea00, transno 21474839742 00000004:00080000:2.0:1746065079.053952:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925ca300, transno 21474839743 00000004:00080000:2.0:1746065079.053954:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098664a80, transno 21474839744 00000004:00080000:2.0:1746065079.053956:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6a00, transno 21474839746 00000004:00080000:2.0:1746065079.053958:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5880, transno 21474839747 00000004:00080000:2.0:1746065079.053959:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e7480, transno 21474839748 00000004:00080000:2.0:1746065079.053961:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4380, transno 21474839749 00000004:00080000:2.0:1746065079.053963:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e7800, transno 21474839752 00000004:00080000:2.0:1746065079.053966:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4000, transno 21474839753 00000004:00080000:2.0:1746065079.053968:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222300, transno 21474839755 00000004:00080000:2.0:1746065079.053970:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223480, transno 21474839756 00000004:00080000:2.0:1746065079.053972:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834e300, transno 21474839757 00000004:00080000:2.0:1746065079.053974:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85d880, transno 21474839758 00000004:00080000:2.0:1746065079.053982:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef26d80, transno 21474839761 00000004:00080000:2.0:1746065079.053984:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef27480, transno 21474839762 00000004:00080000:2.0:1746065079.053986:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24380, transno 21474839763 00000004:00080000:2.0:1746065079.053988:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25180, transno 21474839764 00000004:00080000:2.0:1746065079.053990:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25880, transno 21474839765 00000004:00080000:2.0:1746065079.053992:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24a80, transno 21474839766 00000004:00080000:2.0:1746065079.053993:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982ddc00, transno 21474839768 00000004:00080000:2.0:1746065079.053995:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dc380, transno 21474839769 00000100:00100000:2.0:1746065079.054000:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800982dc000 x1830881262620032/t21474839771(21474839771) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1746065095 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 00000004:00080000:2.0:1746065079.054009:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dc000/2, rc 0, transno 21474839771 00000100:00100000:2.0:1746065079.054013:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262620032:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065079.055797:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.055805:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.055813:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.055816:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.055823:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.055835:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.055839:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1461992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.055854:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.055855:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.055857:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065079.055883:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dd880/2, rc 0, transno 21474839770 00000100:00100000:3.0:1746065079.055888:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262620160:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.057311:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881262620928:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065079.057313:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065079.057326:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.057328:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261373184 00000100:00100000:1.0:1746065079.057332:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261373184 00000100:00100000:3.0:1746065079.057361:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261372800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4561us (5267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.057363:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8470 00000100:00100000:3.0:1746065079.057369:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3572 00000100:00100000:1.0:1746065079.057370:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+16:26180:x1830881261373184:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.057384:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.057397:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5c1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065079.057418:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.057434:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.057436:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.057443:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 17 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.057455:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 17 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.057462:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:1.0:1746065079.057479:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+17:26180:x1830881261373184:12345-192.168.202.27@tcp:101:bash.0 Request processed in 110us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.057484:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8470 00002000:00010000:0.0:1746065079.057679:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb mtime: 0 -> 1746065079 00002000:00010000:0.0:1746065079.057683:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb atime: 0 -> 1746065079 00002000:00010000:0.0:1746065079.057685:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb ctime: 0 -> 1746065079 00000100:00100000:0.0:1746065079.057694:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262621056:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065079.057713:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e000/0xad6b7ddc14619ae lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5ba expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.057721:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e000/0xad6b7ddc14619ae lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5ba expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.057729:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e000, rc 0) 00000100:00100000:0.0:1746065079.057752:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881261372928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4540us (5392us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065079.057758:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8469 00000004:00080000:2.0:1746065079.058604:0:10211:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 224 done 00000100:00100000:0.0:1746065079.061671:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.061752:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261373312 00000100:00100000:1.0:1746065079.061760:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261373312 00002000:00010000:1.0:1746065079.061816:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/853 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.061820:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834dc00 with x1830881261373312 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.061830:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834dc00. 00000100:00100000:1.0:1746065079.061847:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1251 00000100:00100000:1.0:1746065079.061854:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881261373312:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065079.061991:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.061994:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.061996:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb atime from disk: 1746065079 -> 0 00002000:00010000:1.0:1746065079.061998:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.061999:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.062048:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261373312:12345-192.168.202.27@tcp:10:bash.0 Request processed in 194us (383us total) trans 17179872494 rc 0/0 00000100:00100000:1.0:1746065079.062054:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1251 00002000:00010000:1.0:1746065079.062056:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/853 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.062058:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834dc00 with x1830881261373312 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.062062:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834dc00. 00000100:00100000:0.0:1746065079.063124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.063203:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.063241:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261373696 00000100:00100000:3.0:1746065079.063248:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261373696 00000100:00100000:3.0:1746065079.063274:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4145 00000100:00100000:3.0:1746065079.063280:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27876:x1830881261373696:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.063413:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27876:x1830881261373696:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 133us (210us total) trans 4294975417 rc 0/0 00000100:00100000:3.0:1746065079.063418:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4145 00000100:00100000:2.0:1746065079.064039:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261373440 00000100:00100000:2.0:1746065079.064044:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261373440 00002000:00010000:2.0:1746065079.064058:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/852 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.064061:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ce00 with x1830881261373440 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.064068:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834ce00. 00000100:00100000:2.0:1746065079.064086:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1252 00000100:00100000:2.0:1746065079.064091:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+17:2005:x1830881261373440:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.064187:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.064190:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.064192:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.064193:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.064195:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.065297:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+18:2005:x1830881261373440:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1201us (2171us total) trans 21474839772 rc 0/0 00000100:00100000:2.0:1746065079.065306:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1252 00002000:00010000:2.0:1746065079.065310:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/852 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.065312:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ce00 with x1830881261373440 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.065317:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834ce00. 00000100:00100000:2.0:1746065079.070046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.070094:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261373824 00000100:00100000:0.0:1746065079.070102:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261373824 00000100:00100000:0.0:1746065079.070146:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12037 00000100:00100000:0.0:1746065079.070153:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27876:x1830881261373824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.070170:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.070185:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc14619bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5c8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.070236:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.070246:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070255:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070264:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.070269:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070274:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070333:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.070340:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070345:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065079.070374:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 2 00000004:00200000:0.0:1746065079.070378:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065079.070390:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070397:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070404:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070408:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070413:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070418:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070423:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.070426:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070432:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070440:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f3c2a00) 00010000:00010000:0.0:1746065079.070443:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.070445:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070450:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc14619c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070471:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070479:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070483:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070486:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.070488:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070493:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070498:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f3c2700) 00010000:00010000:0.0:1746065079.070500:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.070502:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070505:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc14619ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.070525:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc14619bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.070537:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 274 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.070542:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:0.0:1746065079.070543:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.070546:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:0.0:1746065079.070610:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27876:x1830881261373824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 457us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.070616:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12037 00000100:00100000:3.0:1746065079.071153:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.071202:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261374080 00000100:00100000:0.0:1746065079.071206:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261374080 00000100:00100000:0.0:1746065079.071232:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4146 00000100:00100000:0.0:1746065079.071237:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:26180:x1830881261374080:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065079.071371:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261374080:12345-192.168.202.27@tcp:35:bash.0 Request processed in 134us (219us total) trans 4294975418 rc 0/0 00000100:00100000:0.0:1746065079.071377:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4146 00000100:00100000:0.0:1746065079.076605:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.076802:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261374336 00000100:00100000:3.0:1746065079.076810:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261374336 00000100:00100000:3.0:1746065079.076850:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12038 00000100:00100000:3.0:1746065079.076857:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27876:x1830881261374336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.076877:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.076893:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc14619d8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5cf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.076976:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,1 mode: --/CW res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.076989:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.077000:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.077006:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 5/0,1 mode: --/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.077029:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.077038:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 276 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.077048:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262621184:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.077137:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.077144:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 276 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.077152:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262621312:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.077167:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.081531:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262621184:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.081542:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262621312:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.081572:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,1 mode: --/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065079.082424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.082494:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.082570:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261374720 00000100:00100000:3.0:1746065079.082572:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261374592 00000100:00100000:3.0:1746065079.082577:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261374592 00000100:00100000:2.0:1746065079.082577:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261374720 00010000:00010000:3.0:1746065079.082603:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 278 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.082605:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 278 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.082625:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3573 00000100:00100000:2.0:1746065079.082630:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3574 00000100:00100000:3.0:1746065079.082631:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+278:2004:x1830881261374592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065079.082636:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+278:2004:x1830881261374720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.082640:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.082643:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.082645:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 278 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.082646:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 278 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.082654:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 278 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.082883:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 278 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.082902:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc146197d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5a5 expref: 278 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.082919:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc14619d1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c8 expref: 277 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.082933:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.082936:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,1 mode: --/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.082944:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.082949:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.082963:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.082997:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+276:2004:x1830881261374592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 366us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.083004:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3573 00010000:00010000:3.0:1746065079.083023:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.083028:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.083047:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 5 00010000:00010000:3.0:1746065079.083147:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc14619d8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.083158:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.083163:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.083165:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065079.083167:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66400, rc 0) 00000100:00100000:3.0:1746065079.083188:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27876:x1830881261374336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6332us (6592us total) trans 4294975419 rc 0/0 00000100:00100000:3.0:1746065079.083194:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12038 00010000:00010000:2.0:1746065079.083328:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:2.0:1746065079.083332:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.083350:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+275:2004:x1830881261374720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 714us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.083357:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3574 00000100:00100000:0.0:1746065079.087300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.087361:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261374848 00000100:00100000:3.0:1746065079.087369:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261374848 00000100:00100000:3.0:1746065079.088689:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12039 00000100:00100000:3.0:1746065079.088700:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27877:x1830881261374848:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065079.088745:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746065079.088766:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc146194c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c597 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.091121:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc14618f1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c57b expref: 274 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.091130:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.091134:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.091163:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.091173:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.091180:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.091189:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.091194:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.091198:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.091260:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.091268:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.091273:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 4/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.091304:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.091314:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 273 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.091325:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262621440:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.092146:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.095133:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.095195:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261374976 00000100:00100000:2.0:1746065079.095201:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261374976 00010000:00010000:2.0:1746065079.095227:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 274 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.095251:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3575 00000100:00100000:2.0:1746065079.095257:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261374976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.095268:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.095273:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 274 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.095282:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 274 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.095300:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:2.0:1746065079.095303:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.095311:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.095317:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.095329:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.095374:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261374976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.095381:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3575 00010000:00010000:3.0:1746065079.095445:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc14619df lrc: 0/0,0 mode: --/CW res: [0x240000403:0x331:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5cf expref: 273 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.095456:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262621440:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.095470:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.095477:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.095481:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:3.0:1746065079.096068:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x331:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1746065079.096128:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096135:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096140:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096149:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.096152:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096158:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096165:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.096167:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065079.096170:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 2/0,0 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096174:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66000/0xad6b7ddc14619fb lrc: 0/0,0 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096190:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096194:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096198:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096201:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096204:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.096206:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096210:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096219:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:3.0:1746065079.096220:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.096223:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096226:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67800/0xad6b7ddc14619ed lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:3.0:1746065079.096233:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834e300 reply state ffff88009aa05000 transno 4294975420 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096239:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.096244:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:3.0:1746065079.096245:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.096247:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.096280:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27877:x1830881261374848:12345-192.168.202.27@tcp:36:rm.0 Request processed in 7583us (8989us total) trans 4294975420 rc 0/0 00000100:00100000:3.0:1746065079.096287:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12039 00000100:00100000:0.0:1746065079.097505:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.097668:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261375104 00000100:00100000:3.0:1746065079.097673:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261375104 00000100:00100000:3.0:1746065079.098251:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12040 00000100:00100000:3.0:1746065079.098258:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27876:x1830881261375104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.098274:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.098287:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc1461a02 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5d6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.098341:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc1461a09 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.098350:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc1461a09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.098357:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc1461a09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.098382:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 5 00000004:00200000:3.0:1746065079.098386:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.098396:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc1461a09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.098414:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc1461a02 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5d6 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.098425:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc1461a09 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5d6 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.098431:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065079.098433:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065079.098435:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67600, rc 0) 00000100:00100000:3.0:1746065079.098477:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27876:x1830881261375104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 220us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.098482:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12040 00000100:00100000:0.0:1746065079.102710:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.103684:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261375360 00000100:00100000:2.0:1746065079.103693:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261375360 00000100:00100000:2.0:1746065079.103749:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12041 00000100:00100000:2.0:1746065079.103756:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27876:x1830881261375360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.104766:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.105070:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a10 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5dd expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.105151:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1461a17 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.105160:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1461a17 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.105169:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1461a17 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065079.105178:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 5 00010000:00010000:3.0:1746065079.105249:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a10 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5dd expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.105261:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1461a17 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5dd expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.105267:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065079.105270:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065079.105272:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66e00, rc 0) 00000100:00100000:3.0:1746065079.105361:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27876:x1830881261375360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1605us (2657us total) trans 4294975421 rc 0/0 00000100:00100000:3.0:1746065079.105367:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12041 00000100:00100000:0.0:1746065079.106348:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.106406:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261375488 00000100:00100000:3.0:1746065079.106412:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261375488 00000100:00100000:3.0:1746065079.106437:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12042 00000100:00100000:3.0:1746065079.106442:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27878:x1830881261375488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.106454:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.106466:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461a25 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5e4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.106503:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.106510:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106517:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106525:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.106529:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106533:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106572:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106578:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106583:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106588:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106592:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.106596:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106600:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106607:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.106609:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.106612:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106617:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67000/0xad6b7ddc1461a2c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106624:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106627:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106631:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106634:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.106636:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106640:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106644:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:3.0:1746065079.106646:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.106648:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106651:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67400/0xad6b7ddc1461a33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.106666:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461a25 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5e4 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.106672:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461a25 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5e4 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.106680:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66400, rc 0) 00000100:00100000:3.0:1746065079.106716:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27878:x1830881261375488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 274us (371us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.106722:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12042 00000100:00100000:0.0:1746065079.107866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.107919:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261375616 00000100:00100000:2.0:1746065079.107923:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261375616 00000100:00100000:2.0:1746065079.108171:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8471 00000100:00100000:2.0:1746065079.108179:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261375616:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065079.108206:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.108220:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.108226:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.108228:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.108229:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.108254:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.108264:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 30 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.108279:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262621568:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.108345:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.108556:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.108595:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261375744 00000100:00100000:0.0:1746065079.108598:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261375744 00000100:00100000:0.0:1746065079.108621:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12043 00000100:00100000:0.0:1746065079.108626:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27878:x1830881261375744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.108638:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.108648:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1461a41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5eb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.108692:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.108699:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108708:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108715:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.108720:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108724:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108750:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108756:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108760:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108765:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108769:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd80800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.108796:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108804:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108812:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f3c2200) 00010000:00010000:0.0:1746065079.108815:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.108818:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108823:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461a48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108834:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108838:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108842:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108846:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.108848:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108852:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108857:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:0.0:1746065079.108859:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.108861:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108865:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81200/0xad6b7ddc1461a4f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.108884:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1461a41 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5eb expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.108890:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1461a41 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5eb expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.108899:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:0.0:1746065079.108920:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27878:x1830881261375744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 294us (576us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065079.108926:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12043 00000100:00100000:0.0:1746065079.110954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.111013:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261375872 00000100:00100000:3.0:1746065079.111018:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261375872 00000100:00100000:3.0:1746065079.111052:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12044 00000100:00100000:3.0:1746065079.111058:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27878:x1830881261375872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.111072:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.111085:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67e00/0xad6b7ddc1461a56 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5f2 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.111126:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a5d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.111135:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.111143:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a5d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065079.111173:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065079.111176:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065079.111197:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67e00/0xad6b7ddc1461a56 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5f2 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.111209:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a5d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5f2 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.111220:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065079.111222:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065079.111224:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66600, rc 0) 00000100:00100000:2.0:1746065079.111231:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262621568:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.111251:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.111260:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27878:x1830881261375872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 202us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.111266:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12044 00000100:00100000:0.0:1746065079.111397:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.111480:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261376000 00000100:00100000:2.0:1746065079.111484:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261376000 00002000:00100000:2.0:1746065079.111512:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x355:0x0] (0->4) req@ffff88008d85f100 x1830881261376000/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:750/0 lens 496/0 e 0 to 0 dl 1746065090 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065079.111520:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d85f100 with x1830881261376000 ext(0->4) 00010000:00010000:2.0:1746065079.111526:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 31 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.111535:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 31 pid: 12258 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746065079.111540:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d85f100 00000100:00100000:2.0:1746065079.111576:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 214 00000100:00100000:2.0:1746065079.111581:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881261376000:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:0.0:1746065079.114511:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.114590:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881261376000:12345-192.168.202.27@tcp:4:bash.0 Request processed in 3007us (3192us total) trans 17179872495 rc 0/0 00000100:00100000:2.0:1746065079.114600:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 214 00002000:00100000:2.0:1746065079.114610:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x355:0x0] (0->4) req@ffff88008d85f100 x1830881261376000/t17179872495(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:750/0 lens 496/448 e 0 to 0 dl 1746065090 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065079.114618:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d85f100 with x1830881261376000 ext(0->4) 00010000:00010000:2.0:1746065079.114626:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 33 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.114636:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 33 pid: 12258 timeout: 775 lvb_type: 0 00002000:00010000:2.0:1746065079.114642:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d85f100 00000100:00100000:3.0:1746065079.114767:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261376128 00000100:00100000:3.0:1746065079.114802:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261376128 00000100:00100000:3.0:1746065079.114883:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12045 00000100:00100000:3.0:1746065079.114891:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27878:x1830881261376128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.114906:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.114921:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc1461a64 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c5f9 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.114976:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.114986:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.114994:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115002:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.115007:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115012:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115048:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115053:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115057:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115063:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115067:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.115070:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115075:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115087:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065079.115089:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.115092:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115096:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1461a6b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115106:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115109:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115113:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115117:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7f000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.115119:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115123:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115127:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:3.0:1746065079.115129:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.115130:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115134:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1461a72 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.115155:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc1461a64 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5f9 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.115162:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66200/0xad6b7ddc1461a64 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5f9 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.115169:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66200, rc 0) 00000100:00100000:3.0:1746065079.115199:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27878:x1830881261376128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 310us (696us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.115205:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12045 00000100:00100000:0.0:1746065079.116228:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.116299:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261376256 00000100:00100000:2.0:1746065079.116303:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261376256 00010000:00010000:2.0:1746065079.116322:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 33 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.116340:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3576 00000100:00100000:2.0:1746065079.116346:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881261376256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.116355:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065079.116369:0:8352:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1746065079.116371:0:8352:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb atime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.116373:0:8352:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065079.116377:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 33 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.116384:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 33 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.116403:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc14619a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5b3 expref: 33 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.116430:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.116432:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.116436:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116443:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116460:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.116493:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261376256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 147us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.116499:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3576 00010000:00010000:2.0:1746065079.116516:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116523:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116537:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116543:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116552:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116557:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.116560:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116579:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116587:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.116641:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461a3a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.116681:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261375616:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 8503us (8817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.116688:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8471 00000100:00100000:0.0:1746065079.117090:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.117140:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261376512 00000100:00100000:2.0:1746065079.117143:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261376512 00000100:00100000:2.0:1746065079.117194:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12046 00000100:00100000:2.0:1746065079.117199:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27878:x1830881261376512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.117209:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.117210:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065079.117221:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1461a5d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5f2 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.117230:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065079.117235:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.117241:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1461a79 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c600 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.117300:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.117307:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117314:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117321:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.117326:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117331:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117650:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.117657:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117663:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065079.117671:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x332:0x0]: returning size 0 00010000:00010000:2.0:1746065079.117695:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117700:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117704:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117709:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117713:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.117716:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117721:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117727:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34f00) 00010000:00010000:2.0:1746065079.117730:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.117732:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117737:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2800/0xad6b7ddc1461a80 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:2.0:1746065079.117744:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955cd180 reply state ffff880095fd4000 transno 4294975422 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117751:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.117755:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:2.0:1746065079.117757:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.117759:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065079.117906:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1461a79 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.117918:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.117923:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34200) 00010000:00010000:2.0:1746065079.117925:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.117927:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fac00, rc 0) 00000100:00100000:2.0:1746065079.117950:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27878:x1830881261376512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 751us (861us total) trans 4294975422 rc 0/0 00000100:00100000:2.0:1746065079.117955:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12046 00000100:00100000:0.0:1746065079.118939:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.119000:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261376768 00000100:00100000:2.0:1746065079.119004:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261376768 00000100:00100000:2.0:1746065079.119258:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12047 00000100:00100000:2.0:1746065079.119265:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27876:x1830881261376768:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065079.119290:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.119312:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67600/0xad6b7ddc1461a09 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5d6 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.119322:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065079.119324:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.119338:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.119345:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.119351:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065079.119482:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2383, 88 off197520 00000004:00080000:2.0:1746065079.119486:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675137712607ns, next at 675481510748ns, rc = 0 00000040:00080000:2.0:1746065079.119522:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2379, 88 off197088 00000004:00080000:2.0:1746065079.119526:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675137752714ns, next at 675481534386ns, rc = 0 00000040:00080000:2.0:1746065079.119548:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2380, 88 off197176 00000004:00080000:2.0:1746065079.119551:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675137777263ns, next at 675481534386ns, rc = 0 00000040:00080000:2.0:1746065079.119559:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2384, 88 off197608 00000004:00080000:2.0:1746065079.119572:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675137787729ns, next at 675481510748ns, rc = 0 00000100:00100000:2.0:1746065079.121194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.121258:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261377024 00000100:00100000:3.0:1746065079.121263:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261377024 00000100:00100000:3.0:1746065079.121290:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12048 00000100:00100000:3.0:1746065079.121295:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27878:x1830881261377024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.121311:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.121322:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461aa3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c607 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.121376:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.121386:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.121392:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 4/0,1 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.121413:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.121422:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 282 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.121430:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262621696:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.121893:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000001:00080000:1.0:1746065079.122909:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975423 is committed 00000004:00080000:1.0:1746065079.122916:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1610 committed 00000004:00080000:1.0:1746065079.122932:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1600 committed 00000004:00080000:1.0:1746065079.122943:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1599 committed 00000004:00080000:1.0:1746065079.122944:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1609 committed 00010000:00010000:0.0:1746065079.122993:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123001:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123006:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123011:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.123015:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.123023:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262621952:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065079.123024:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123034:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:0.0:1746065079.123037:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.123039:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123043:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66c00/0xad6b7ddc14619f4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.123053:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065079.123059:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123063:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123067:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.123070:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1746065079.123071:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.123073:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.123074:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262622080:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065079.123077:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123083:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a600) 00010000:00010000:0.0:1746065079.123085:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.123086:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065079.123087:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.123091:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1461a87 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.123214:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262621952 00000100:00100000:1.0:1746065079.123218:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262621952 00000100:00100000:1.0:1746065079.123242:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622080 00000100:00100000:1.0:1746065079.123244:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622080 00000100:00100000:1.0:1746065079.123475:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8472 00000100:00100000:1.0:1746065079.123482:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3761:x1830881262621952:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.123608:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8473 00000100:00100000:2.0:1746065079.123614:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3761:x1830881262622080:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.123712:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3761:x1830881262622080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 98us (624us total) trans 21474839773 rc 0/0 00000100:00100000:2.0:1746065079.123717:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8473 00000100:00100000:2.0:1746065079.123734:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262622208:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.123747:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262621696:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.123751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065079.123761:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065079.123763:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065079.123767:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262621824:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065079.123843:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.123845:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.123847:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.123849:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.123851:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.123872:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3761:x1830881262621952:12345-0@lo:2:osp-syn-0-1.0 Request processed in 391us (818us total) trans 21474839774 rc 0/0 00000100:00100000:1.0:1746065079.123878:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8472 00000100:00100000:1.0:1746065079.123886:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622208 00000100:00100000:1.0:1746065079.123888:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622208 00000100:00100000:1.0:1746065079.123901:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8474 00000100:00100000:1.0:1746065079.123905:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+40:3759:x1830881262622208:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.123966:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+41:3759:x1830881262622208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 60us (214us total) trans 17179872496 rc 0/0 00000100:00100000:1.0:1746065079.123971:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8474 00000004:00080000:3.0:1746065079.124041:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a649880/2, rc 0, transno 21474839773 00000100:00100000:3.0:1746065079.124046:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262622080:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065079.124054:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a64a300/2, rc 0, transno 21474839774 00000100:00100000:3.0:1746065079.124056:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262621952:0@lo:2:osp-syn-0-1.0 00000004:00010000:0.0:1746065079.124058:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955cfb80 reply state ffff880136be0800 transno 4294975423 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.124067:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.124073:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:0.0:1746065079.124076:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065079.124078:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746065079.124314:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065079.124330:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27876:x1830881261376768:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 5064us (5391us total) trans 4294975423 rc 0/0 00000100:00100000:0.0:1746065079.124335:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12047 00000100:00100000:2.0:1746065079.124402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.124418:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262621824 00000004:00080000:2.0:1746065079.124419:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5880/2, rc 0, transno 17179872496 00000100:00100000:0.0:1746065079.124420:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262621824 00000100:00100000:2.0:1746065079.124422:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262622208:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.124435:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8475 00000100:00100000:2.0:1746065079.124439:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+41:3759:x1830881262621824:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.124466:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.124473:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.124478:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.124482:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.124485:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.124490:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.124498:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:1.0:1746065079.124500:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.124503:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.124511:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1461a9c lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.124603:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.124922:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+42:3759:x1830881262621824:12345-0@lo:2:osp-syn-1-1.0 Request processed in 192us (230us total) trans 17179872497 rc 0/0 00000100:00100000:2.0:1746065079.125248:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8475 00000100:00100000:0.0:1746065079.125256:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261377152 00000100:00100000:0.0:1746065079.125259:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261377152 00000004:00080000:2.0:1746065079.125271:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6a00/2, rc 0, transno 17179872497 00010000:00010000:0.0:1746065079.125273:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 273 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.125274:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262621824:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.125302:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3577 00000100:00100000:0.0:1746065079.125307:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+273:2005:x1830881261377152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.125314:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.125318:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 273 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.125331:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 273 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.125344:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fac00/0xad6b7ddc1461a8e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c600 expref: 273 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.125351:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34200) 00010000:00010000:0.0:1746065079.125354:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.125361:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.125365:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.125386:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.125407:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+272:2005:x1830881261377152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.125413:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3577 00010000:00010000:1.0:1746065079.125499:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.125505:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065079.125520:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x332:0x0]: returning size 0 00000004:00080000:1.0:1746065079.126734:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x356:0x0], index 0: 0 00000004:00080000:1.0:1746065079.126747:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x357:0x0], index 1: 0 00000004:00080000:1.0:1746065079.126752:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x358:0x0], index 1: 0 00000004:00080000:1.0:1746065079.126755:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x357:0x0], index 0: 0 00010000:00010000:1.0:1746065079.126854:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126862:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126867:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126872:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.126875:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126880:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126889:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34200) 00010000:00010000:1.0:1746065079.126891:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.126894:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 2/0,0 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126899:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66400/0xad6b7ddc1461aaa lrc: 0/0,0 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.126945:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461aa3 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x332:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c607 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.126953:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461aa3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x332:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c607 expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.126965:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:1.0:1746065079.127009:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27878:x1830881261377024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5713us (5819us total) trans 4294975424 rc 301/301 00000100:00100000:1.0:1746065079.127015:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12048 00000100:00100000:0.0:1746065079.127062:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.128233:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261377280 00000100:00100000:1.0:1746065079.128240:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261377280 00000100:00100000:1.0:1746065079.128277:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12049 00000100:00100000:1.0:1746065079.128283:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+271:27876:x1830881261377280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.128297:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.128308:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c60e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.128342:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.128352:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.128364:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:1.0:1746065079.128366:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.128368:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:1.0:1746065079.128396:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27876:x1830881261377280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 113us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.128401:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12049 00000100:00100000:0.0:1746065079.129492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.130170:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261377536 00000100:00100000:2.0:1746065079.130175:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261377536 00000100:00100000:2.0:1746065079.130203:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4147 00000100:00100000:2.0:1746065079.130208:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27878:x1830881261377536:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.130383:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27878:x1830881261377536:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 173us (893us total) trans 4294975425 rc 0/0 00000100:00100000:2.0:1746065079.130388:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4147 00000100:00100000:0.0:1746065079.131704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.132064:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261377664 00000100:00100000:2.0:1746065079.132073:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261377664 00000100:00100000:2.0:1746065079.132139:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12050 00000100:00100000:2.0:1746065079.132146:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+273:27876:x1830881261377664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.132161:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.132175:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461abf lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c615 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.132225:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461ac6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.132236:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461ac6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.132245:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461ac6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065079.132274:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x331:0x0]: returning size 5 00000004:00200000:2.0:1746065079.132278:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065079.132520:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461ac6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.132541:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461abf lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c615 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.132552:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461ac6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c615 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.132559:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065079.132573:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065079.132577:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00000100:00100000:2.0:1746065079.132617:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27876:x1830881261377664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 471us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.132622:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12050 00000100:00100000:0.0:1746065079.132801:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.133079:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261377920 00000100:00100000:1.0:1746065079.133083:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261377920 00000100:00100000:1.0:1746065079.133115:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4148 00000100:00100000:1.0:1746065079.133121:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27878:x1830881261377920:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065079.133219:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27878:x1830881261377920:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 98us (418us total) trans 4294975426 rc 0/0 00000100:00100000:1.0:1746065079.133224:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4148 00000100:00100000:0.0:1746065079.136200:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.136639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.136683:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261378304 00000100:00100000:2.0:1746065079.136692:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261378304 00000100:00100000:2.0:1746065079.136973:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12051 00000100:00100000:2.0:1746065079.136980:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261378304:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.136998:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.137014:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461acd lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c623 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.137410:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.137421:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.137551:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261378048 00000100:00100000:3.0:1746065079.137555:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261378048 00010000:00010000:2.0:1746065079.137579:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.137585:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8476 00000100:00100000:3.0:1746065079.137590:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261378048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.137591:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.137596:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.137597:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.137601:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.137606:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c61c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065079.137621:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x355:0x0] initial LVB size: 5, mtime: 0x6812d6b7, atime: 0x6812d6b7, ctime: 0x6812d6b7, blocks: 0x8 00010000:00010000:3.0:1746065079.137633:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.137635:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.137639:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461ae9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.137642:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 32 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.137644:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461ae9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.137649:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461ae9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.137652:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 32 pid: 9549 timeout: 0 lvb_type: 1 00000004:00200000:2.0:1746065079.137657:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x332:0x0]: returning size 0 00010000:00010000:3.0:1746065079.137660:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66600, rc 0) 00010000:00010000:2.0:1746065079.137711:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.137716:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.137721:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.137726:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.137731:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.137735:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.137740:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138240:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34400) 00010000:00010000:2.0:1746065079.138243:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.138247:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138252:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1461ad4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138261:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138266:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138270:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138273:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.138275:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138279:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138284:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34700) 00010000:00010000:2.0:1746065079.138286:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.138288:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.138295:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461adb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.138298:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261378048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 707us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.138304:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8476 00010000:00010000:2.0:1746065079.138327:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461acd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c623 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.138336:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461ae9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c623 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.138342:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.138343:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.138345:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84bc00, rc 0) 00000100:00100000:2.0:1746065079.138376:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261378304:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1397us (1738us total) trans 4294975427 rc 0/0 00000100:00100000:2.0:1746065079.138381:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12051 00000100:00100000:2.0:1746065079.141965:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.142689:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261378432 00000100:00100000:0.0:1746065079.142698:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261378432 00000100:00100000:0.0:1746065079.142751:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12052 00000100:00100000:0.0:1746065079.142759:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261378432:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065079.142804:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.142820:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461af7 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c62a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.142848:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461afe lrc: 3/1,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.142858:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461afe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.142867:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461afe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.142950:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461af7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c62a expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.142967:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461afe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c62a expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.142975:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:0.0:1746065079.142977:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746065079.142980:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80800, rc 0) 00000100:00100000:0.0:1746065079.144202:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261378432:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1439us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.144209:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12052 00000100:00100000:1.0:1746065079.144364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.144419:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261378560 00000100:00100000:2.0:1746065079.144425:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261378560 00000100:00100000:2.0:1746065079.144452:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8477 00000100:00100000:2.0:1746065079.144457:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261378560:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065079.144527:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261378560:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.144532:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8477 00000100:00100000:0.0:1746065079.147030:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.147580:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.147898:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261378816 00000100:00100000:2.0:1746065079.147905:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261378816 00000100:00100000:2.0:1746065079.147954:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12053 00000100:00100000:2.0:1746065079.147962:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261378816:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065079.148002:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065079.148010:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261378944 00000100:00100000:1.0:1746065079.148014:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261378944 00010000:00010000:2.0:1746065079.148025:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461ae9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c623 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.148040:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8478 00010000:00010000:2.0:1746065079.148041:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.148045:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.148045:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881261378944:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065079.148115:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881261378944:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 69us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.148121:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8478 00010000:00010000:2.0:1746065079.148192:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.148203:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.148210:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:2.0:1746065079.148248:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975428 00000004:00010000:2.0:1746065079.148264:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955ced80 reply state ffff88008d938000 transno 4294975429 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.148271:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.148275:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.148277:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.148279:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065079.148319:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261378816:12345-192.168.202.27@tcp:36:bash.0 Request processed in 358us (1296us total) trans 4294975429 rc 0/0 00000100:00100000:2.0:1746065079.148324:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12053 00000020:00080000:2.0:1746065079.148327:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065079.150534:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.150806:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261379072 00000100:00100000:3.0:1746065079.150812:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261379072 00000100:00100000:3.0:1746065079.150910:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12054 00000100:00100000:3.0:1746065079.150919:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261379072:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.150936:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.150949:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461b0c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c631 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.150987:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461b0c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c631 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.150997:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461b0c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c631 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.151015:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:3.0:1746065079.151018:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.151020:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67a00, rc 0) 00000100:00100000:3.0:1746065079.151057:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261379072:12345-192.168.202.27@tcp:101:bash.0 Request processed in 139us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.151084:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12054 00000100:00100000:3.0:1746065079.151151:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.151247:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261379328 00000100:00100000:2.0:1746065079.151251:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261379328 00000100:00100000:2.0:1746065079.151268:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12055 00000100:00100000:2.0:1746065079.151273:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27876:x1830881261379328:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065079.151297:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.151309:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461ac6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x331:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c615 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.151318:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065079.151321:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.151337:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.151343:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.151349:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00010000:2.0:1746065079.151414:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a649180 reply state ffff880092911000 transno 4294975430 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.151421:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.151425:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065079.151427:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.151429:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065079.151482:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27876:x1830881261379328:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 208us (331us total) trans 4294975430 rc 0/0 00000100:00100000:2.0:1746065079.151488:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12055 00000100:00100000:0.0:1746065079.152754:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.152855:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.152859:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261379584 00000100:00100000:2.0:1746065079.152864:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261379584 00000100:00100000:2.0:1746065079.152885:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12056 00000100:00100000:2.0:1746065079.152890:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261379584:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.152899:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065079.152924:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261379712 00000100:00100000:1.0:1746065079.152926:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261379712 00010000:00010000:2.0:1746065079.152967:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065079.152979:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461b0c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c631 expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.152991:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.152994:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.152996:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8479 00010000:00010000:2.0:1746065079.152999:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461b1a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c638 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.153001:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881261379712:12345-192.168.202.27@tcp:2:lfs.0 00010000:00010000:2.0:1746065079.153026:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461b21 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.153032:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461b21 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.153038:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461b21 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00002000:00010000:1.0:1746065079.153088:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065079.153090:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.153092:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb atime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.153094:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.153095:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb blocks from disk: 8 -> 8 00000040:00080000:2.0:1746065079.153201:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2381, 88 off197264 00000004:00080000:2.0:1746065079.153206:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675171432066ns, next at 675481534386ns, rc = 0 00000040:00080000:2.0:1746065079.153236:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2385, 88 off197696 00000004:00080000:2.0:1746065079.153239:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675171465908ns, next at 675481510748ns, rc = 0 00000040:00080000:2.0:1746065079.153263:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2386, 88 off197784 00000004:00080000:2.0:1746065079.153266:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675171492166ns, next at 675481510748ns, rc = 0 00000040:00080000:2.0:1746065079.153277:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2382, 88 off197352 00000004:00080000:2.0:1746065079.153279:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675171505578ns, next at 675481534386ns, rc = 0 00000100:00100000:1.0:1746065079.153316:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881261379712:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 313us (460us total) trans 17179872498 rc 0/0 00000100:00100000:1.0:1746065079.153362:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8479 00000100:00100000:2.0:1746065079.154557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.154815:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261379968 00000100:00100000:0.0:1746065079.154820:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261379968 00000100:00100000:0.0:1746065079.154849:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4149 00000100:00100000:0.0:1746065079.154855:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27876:x1830881261379968:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065079.154886:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x331:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1461a17 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5dd expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.154907:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:0.0:1746065079.154915:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.154921:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.154946:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.154956:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 284 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.154966:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262622336:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.155033:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ef00 going to sleep for 11 seconds 00000001:00080000:1.0:1746065079.155081:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975431 is committed 00000004:00080000:1.0:1746065079.155087:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1602 committed 00000004:00080000:1.0:1746065079.155092:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1612 committed 00000004:00080000:1.0:1746065079.155095:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1611 committed 00000004:00080000:1.0:1746065079.155097:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1601 committed 00010000:00010000:1.0:1746065079.155119:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.155126:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.155131:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.155136:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.155139:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.155146:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461b21 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x332:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c638 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.155159:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:1.0:1746065079.155159:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.155162:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065079.155168:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.155170:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461b1a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c638 expref: 277 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065079.155170:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.155173:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.155177:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b05 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x332:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.155179:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461b21 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x332:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c638 expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.155186:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.155190:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.155194:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.155195:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.155197:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065079.155198:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.155199:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00010000:00010000:1.0:1746065079.155200:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.155204:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.155209:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:1.0:1746065079.155211:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.155212:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.155216:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b13 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065079.155218:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261379584:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2329us (2468us total) trans 4294975431 rc 0/0 00000100:00100000:2.0:1746065079.155224:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12056 00000100:00100000:3.0:1746065079.155349:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262622592:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.155492:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262622464:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.155534:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.155612:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262622720:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.155634:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.155655:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622592 00000100:00100000:3.0:1746065079.155658:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622592 00000100:00100000:3.0:1746065079.155675:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622720 00000100:00100000:3.0:1746065079.155677:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622720 00000100:00100000:3.0:1746065079.155703:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8480 00000100:00100000:3.0:1746065079.155709:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+42:3761:x1830881262622592:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.155825:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+43:3761:x1830881262622592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 116us (291us total) trans 17179872499 rc 0/0 00000100:00100000:1.0:1746065079.155860:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8481 00000100:00100000:1.0:1746065079.155869:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3762:x1830881262622720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.155915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.155943:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065079.155945:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3762:x1830881262622720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (310us total) trans 21474839775 rc 0/0 00000100:00100000:2.0:1746065079.155948:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262622848:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.155971:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.156020:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622464 00000100:00100000:0.0:1746065079.156024:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622464 00000100:00100000:3.0:1746065079.156242:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8480 00000100:00100000:1.0:1746065079.156248:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8481 00000100:00100000:3.0:1746065079.156254:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622848 00000100:00100000:3.0:1746065079.156257:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622848 00000100:00100000:3.0:1746065079.156271:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8482 00000100:00100000:3.0:1746065079.156275:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3760:x1830881262622848:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065079.156282:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a64b100/2, rc 0, transno 21474839775 00000100:00100000:1.0:1746065079.156287:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262622720:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.156403:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8483 00000100:00100000:0.0:1746065079.156409:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+43:3760:x1830881262622464:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.156654:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3760:x1830881262622848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 377us (680us total) trans 21474839776 rc 0/0 00000100:00100000:3.0:1746065079.156659:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8482 00000004:00080000:3.0:1746065079.156684:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a649f80/2, rc 0, transno 17179872499 00000100:00100000:3.0:1746065079.156688:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262622592:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.156727:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+44:3760:x1830881262622464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 318us (811us total) trans 17179872500 rc 0/0 00000100:00100000:0.0:1746065079.156733:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8483 00000004:00080000:2.0:1746065079.156798:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a649500/2, rc 0, transno 21474839776 00000100:00100000:2.0:1746065079.156801:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262622848:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065079.156808:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a64a680/2, rc 0, transno 17179872500 00000100:00100000:2.0:1746065079.156811:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262622464:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.157248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.157293:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380096 00000100:00100000:1.0:1746065079.157296:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380096 00000100:00100000:1.0:1746065079.157365:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8484 00000100:00100000:1.0:1746065079.157370:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+18:26180:x1830881261380096:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.157379:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.157388:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c63f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065079.157401:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.157412:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.157414:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.157419:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.157429:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.157436:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97200, rc 0) 00000100:00100000:1.0:1746065079.157458:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+19:26180:x1830881261380096:12345-192.168.202.27@tcp:101:bash.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.157463:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8484 00000100:00100000:0.0:1746065079.157514:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262622336:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065079.157526:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065079.158667:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.158987:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.159160:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380224 00000100:00100000:3.0:1746065079.159164:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380224 00010000:00010000:3.0:1746065079.159182:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 274 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.159199:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3578 00000100:00100000:3.0:1746065079.159204:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261380224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.159212:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.159216:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 274 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.159224:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 274 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.159238:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461ab8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c60e expref: 274 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.159251:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065079.159255:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.159261:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.159265:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.159282:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.159399:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.159409:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:1.0:1746065079.159581:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2387, 88 off197872 00000004:00080000:1.0:1746065079.159586:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675177812326ns, next at 675481510748ns, rc = 0 00000040:00080000:1.0:1746065079.159608:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2383, 88 off197440 00000004:00080000:1.0:1746065079.159610:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675177836683ns, next at 675481534386ns, rc = 0 00000040:00080000:1.0:1746065079.159620:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2384, 88 off197528 00000004:00080000:1.0:1746065079.159622:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675177848718ns, next at 675481534386ns, rc = 0 00000040:00080000:1.0:1746065079.159629:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2388, 88 off197960 00000004:00080000:1.0:1746065079.159632:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675177858428ns, next at 675481510748ns, rc = 0 00000100:00100000:2.0:1746065079.159980:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380352 00000100:00100000:2.0:1746065079.159984:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380352 00000100:00100000:2.0:1746065079.160013:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8485 00000100:00100000:2.0:1746065079.160019:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+33:26180:x1830881261380352:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.160029:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.160039:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c646 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.160055:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.160065:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.160067:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.160072:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.160082:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.160088:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:3.0:1746065079.160219:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+274:2004:x1830881261380224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1013us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.160224:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3578 00000100:00100000:2.0:1746065079.160277:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:26180:x1830881261380352:12345-192.168.202.27@tcp:101:bash.0 Request processed in 258us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.160282:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8485 00000100:00100000:0.0:1746065079.162041:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.162225:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.162290:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380480 00000100:00100000:1.0:1746065079.162295:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380480 00002000:00010000:1.0:1746065079.162320:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/854 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.162323:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881261380480 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.162332:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f480. 00000100:00100000:1.0:1746065079.162503:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380608 00000100:00100000:1.0:1746065079.162506:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380608 00002000:00010000:1.0:1746065079.162515:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/855 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.162518:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881261380608 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.162523:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f800. 00000100:00100000:2.0:1746065079.162582:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1253 00000100:00100000:2.0:1746065079.162589:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881261380480:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.162717:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.162720:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.162722:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.162724:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.162726:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.162827:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1254 00000100:00100000:1.0:1746065079.162833:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261380608:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065079.162896:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x357:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.162898:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x357:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.162900:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x357:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.162902:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x357:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.162904:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x357:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.163091:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261380480:12345-192.168.202.27@tcp:10:bash.0 Request processed in 502us (1055us total) trans 21474839777 rc 0/0 00000100:00100000:2.0:1746065079.163096:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1253 00002000:00010000:2.0:1746065079.163099:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/854 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.163101:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881261380480 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.163105:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f480. 00000100:00100000:1.0:1746065079.163144:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261380608:12345-192.168.202.27@tcp:10:bash.0 Request processed in 311us (919us total) trans 17179872501 rc 0/0 00000100:00100000:1.0:1746065079.163150:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1254 00002000:00010000:1.0:1746065079.163153:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/855 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.163154:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881261380608 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.163158:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f800. 00000001:00080000:2.0:1746065079.164992:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975432 is committed 00000004:00080000:2.0:1746065079.164999:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1614 committed 00000004:00080000:2.0:1746065079.165013:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1604 committed 00000004:00080000:2.0:1746065079.165023:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1603 committed 00000004:00080000:2.0:1746065079.165025:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1613 committed 00000100:00100000:1.0:1746065079.165113:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065079.165128:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262623104:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.165167:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.165209:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262623104 00000100:00100000:1.0:1746065079.165212:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262623104 00000100:00100000:1.0:1746065079.165238:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8486 00000100:00100000:1.0:1746065079.165243:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+44:3762:x1830881262623104:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.165334:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3762:x1830881262623104:12345-0@lo:2:osp-syn-1-1.0 Request processed in 90us (166us total) trans 17179872502 rc 0/0 00000100:00100000:1.0:1746065079.165339:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8486 00000004:00080000:1.0:1746065079.165367:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982de680/2, rc 0, transno 17179872502 00000100:00100000:1.0:1746065079.165371:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262623104:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.165437:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065079.165444:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262623232:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.165467:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1746065079.165537:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f3e4e00 reply state ffff880090644c00 transno 4294975432 ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.165551:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.165558:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:0.0:1746065079.165570:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065079.165574:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065079.165578:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:0.0:1746065079.165580:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065079.165585:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1461a17 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5dd expref: 272 pid: 7204 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065079.165646:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065079.165654:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+272:27876:x1830881261379968:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 10799us (11099us total) trans 4294975432 rc 0/0 00000100:00100000:0.0:1746065079.165661:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4149 00000100:00100000:0.0:1746065079.165679:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262623232 00000100:00100000:0.0:1746065079.165682:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262623232 00000100:00100000:0.0:1746065079.165697:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8487 00000100:00100000:0.0:1746065079.165701:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3761:x1830881262623232:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065079.165759:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065079.165762:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:0.0:1746065079.165764:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.165766:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:0.0:1746065079.165768:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x354:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065079.165813:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3761:x1830881262623232:12345-0@lo:2:osp-syn-0-1.0 Request processed in 111us (345us total) trans 21474839778 rc 0/0 00000100:00100000:0.0:1746065079.165818:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8487 00000004:00080000:0.0:1746065079.165838:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222300/2, rc 0, transno 21474839778 00000100:00100000:0.0:1746065079.165841:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262623232:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065079.165885:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.165892:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.165896:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.165901:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.165904:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.165909:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.165917:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065079.165919:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.165922:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.165925:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd81e00/0xad6b7ddc1461b28 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:2.0:1746065079.165987:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262623360:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.166010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.166040:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065079.166044:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262622976:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.166059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.166310:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262623360 00000100:00100000:3.0:1746065079.166314:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262623360 00000100:00100000:3.0:1746065079.166330:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622976 00000100:00100000:3.0:1746065079.166332:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622976 00000100:00100000:3.0:1746065079.166342:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8488 00000100:00100000:3.0:1746065079.166347:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3759:x1830881262623360:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.166406:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+13:3759:x1830881262623360:12345-0@lo:2:osp-syn-0-1.0 Request processed in 59us (396us total) trans 21474839779 rc 0/0 00000100:00100000:3.0:1746065079.166411:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8488 00000100:00100000:3.0:1746065079.166490:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8489 00000100:00100000:3.0:1746065079.166494:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+45:3759:x1830881262622976:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065079.166529:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065079.166531:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:3.0:1746065079.166533:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb atime from disk: 1746065079 -> 1746065079 00002000:00010000:3.0:1746065079.166534:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:3.0:1746065079.166536:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x355:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065079.166549:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+46:3759:x1830881262622976:12345-0@lo:2:osp-syn-1-1.0 Request processed in 55us (489us total) trans 17179872503 rc 0/0 00000100:00100000:3.0:1746065079.166553:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8489 00000004:00080000:2.0:1746065079.166734:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dca80/2, rc 0, transno 17179872503 00000100:00100000:2.0:1746065079.166738:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262622976:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065079.166744:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223480/2, rc 0, transno 21474839779 00000100:00100000:2.0:1746065079.166746:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262623360:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.166936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.167002:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380864 00000100:00100000:0.0:1746065079.167005:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380864 00000100:00100000:0.0:1746065079.167332:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4150 00000100:00100000:0.0:1746065079.167338:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+271:26180:x1830881261380864:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065079.167660:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+272:26180:x1830881261380864:12345-192.168.202.27@tcp:35:bash.0 Request processed in 321us (724us total) trans 4294975433 rc 0/0 00000100:00100000:0.0:1746065079.167666:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4150 00000100:00100000:0.0:1746065079.169485:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.169722:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261380992 00000100:00100000:2.0:1746065079.169727:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261380992 00000100:00100000:2.0:1746065079.169763:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12057 00000100:00100000:2.0:1746065079.169768:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+272:27876:x1830881261380992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.169804:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.169818:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc1461b3d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c64d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.169855:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc1461b3d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c64d expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.169865:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb400/0xad6b7ddc1461b3d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x331:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c64d expref: 273 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.169877:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012e3d9a00) 00010000:00010000:2.0:1746065079.169880:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.169882:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb400, rc 0) 00000100:00100000:2.0:1746065079.169916:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+273:27876:x1830881261380992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 148us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.169920:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12057 00000100:00100000:0.0:1746065079.175486:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.175577:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.175607:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261381376 00000100:00100000:0.0:1746065079.175614:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261381376 00000100:00100000:1.0:1746065079.175698:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261381248 00000100:00100000:1.0:1746065079.175701:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261381248 00000100:00100000:0.0:1746065079.176072:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12058 00000100:00100000:0.0:1746065079.176080:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27879:x1830881261381376:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1746065079.176099:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.176114:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461b44 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c654 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.176164:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.176174:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176182:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176191:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.176196:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176202:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176255:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.176261:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176266:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065079.176293:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x332:0x0]: returning size 5 00000004:00200000:0.0:1746065079.176297:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065079.176308:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176316:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176323:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176329:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176334:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176339:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176343:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.176347:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176352:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176360:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f300) 00010000:00010000:0.0:1746065079.176362:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.176365:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176370:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b800/0xad6b7ddc1461b4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176378:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176383:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176388:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176392:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.176393:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176398:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176402:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009554f200) 00010000:00010000:0.0:1746065079.176404:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.176406:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176410:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461b52 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.176428:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461b44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c654 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.176438:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c654 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.176443:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:0.0:1746065079.176445:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.176446:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a600, rc 0) 00000100:00100000:0.0:1746065079.176482:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27879:x1830881261381376:12345-192.168.202.27@tcp:101:rm.0 Request processed in 403us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.176487:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12058 00000100:00100000:1.0:1746065079.176835:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4151 00000100:00100000:1.0:1746065079.176843:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27876:x1830881261381248:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065079.176983:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x331:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065079.177023:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2389, 64 off198024 00000040:00080000:1.0:1746065079.177038:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2385, 64 off197592 00000040:00080000:1.0:1746065079.177045:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2386, 64 off197656 00000040:00080000:1.0:1746065079.177052:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2390, 64 off198088 00010000:00010000:1.0:1746065079.177083:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065079.177091:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.177097:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.177103:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.177107:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.177111:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.177124:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065079.177238:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27876:x1830881261381248:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 395us (1803us total) trans 4294975434 rc 0/0 00000100:00100000:1.0:1746065079.177243:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4151 00010000:00010000:0.0:1746065079.177731:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065079.177737:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.177742:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065079.177744:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.177749:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.177757:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x331:0x0].0x0 (ffff88012e3d9a00) 00010000:00010000:0.0:1746065079.177759:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065079.177762:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.177767:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1461b60 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x331:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.178029:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.178031:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.178033:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.178449:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.179870:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261381632 00000100:00100000:2.0:1746065079.179877:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261381632 00000100:00100000:2.0:1746065079.179924:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12059 00000100:00100000:2.0:1746065079.179930:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27879:x1830881261381632:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065079.179969:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065079.179988:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461b21 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x332:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c638 expref: 275 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.180015:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1461b59 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c654 expref: 274 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.180026:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc1461afe lrc: 0/0,0 mode: --/PR res: [0x240000403:0x332:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c62a expref: 273 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.180039:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff880098c34c00) 00010000:00010000:2.0:1746065079.180045:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.180062:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.180071:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180078:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180087:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.180092:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180097:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180158:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.180163:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180168:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:2.0:1746065079.180318:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2387, 64 off197720 00000040:00080000:2.0:1746065079.180334:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2391, 64 off198152 00000040:00080000:2.0:1746065079.180341:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2392, 64 off198216 00000040:00080000:2.0:1746065079.180348:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2388, 64 off197784 00010000:00010000:2.0:1746065079.180383:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x332:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.180389:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180395:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180400:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180405:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180409:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180422:0:7204:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065079.180434:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.180438:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180443:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdbe00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.180446:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180451:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180457:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065079.180459:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065079.180462:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 1/0,0 mode: --/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180469:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461b7c lrc: 0/0,0 mode: --/PW res: [0x240000403:0x332:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180476:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.180477:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.180478:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.180486:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180490:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180494:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180497:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.180500:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180504:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180508:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x332:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065079.180510:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065079.180511:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180515:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461b75 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180609:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180614:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180618:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180622:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180626:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.180628:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180632:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180638:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065079.180640:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.180642:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180646:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461b67 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:2.0:1746065079.180654:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009577ce00 reply state ffff88012c454000 transno 4294975435 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180660:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.180664:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:2.0:1746065079.180666:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.180668:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065079.180738:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27879:x1830881261381632:12345-192.168.202.27@tcp:36:rm.0 Request processed in 807us (2290us total) trans 4294975435 rc 0/0 00000100:00100000:2.0:1746065079.180747:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12059 00000100:00100000:0.0:1746065079.188111:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.190307:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261381888 00000100:00100000:2.0:1746065079.190319:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261381888 00000100:00100000:2.0:1746065079.190373:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12060 00000100:00100000:2.0:1746065079.190380:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27880:x1830881261381888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.190404:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.190422:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461b83 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c65b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.190493:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.190503:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190512:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190521:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.190526:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190532:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190576:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190581:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190586:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190591:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190595:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.190598:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190603:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190612:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac599b00) 00010000:00010000:2.0:1746065079.190614:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.190618:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190622:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461b8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190632:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190636:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190640:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190643:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.190645:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190652:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190657:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:2.0:1746065079.190659:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.190660:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190664:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97000/0xad6b7ddc1461b91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.190685:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461b83 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c65b expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.190691:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461b83 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c65b expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.190702:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00000100:00100000:2.0:1746065079.193219:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27880:x1830881261381888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2829us (5106us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.193230:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12060 00000100:00100000:0.0:1746065079.196948:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.197027:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261382016 00000100:00100000:2.0:1746065079.197035:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261382016 00000100:00100000:2.0:1746065079.197073:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12061 00000100:00100000:2.0:1746065079.197080:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27880:x1830881261382016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.197096:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.197112:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461b98 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c662 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.197166:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.197175:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197183:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197190:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.197196:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197200:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197228:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197233:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197238:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197242:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197247:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.197250:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197258:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197266:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a3f1da00) 00010000:00010000:2.0:1746065079.197269:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.197272:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197276:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461b9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197391:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197397:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197401:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197405:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.197407:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197412:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197418:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:2.0:1746065079.197420:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.197422:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197426:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461ba6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.197452:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461b98 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c662 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.197458:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461b98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c662 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.197467:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96400, rc 0) 00000100:00100000:2.0:1746065079.197608:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27880:x1830881261382016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 527us (666us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.197614:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12061 00000100:00100000:0.0:1746065079.200976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.201053:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261382144 00000100:00100000:2.0:1746065079.201060:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261382144 00000100:00100000:2.0:1746065079.201094:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12062 00000100:00100000:2.0:1746065079.201099:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27881:x1830881261382144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.201113:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.201127:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461bad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c669 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.201169:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.201178:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201186:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201192:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.201201:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201205:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201230:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201234:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201238:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201243:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201247:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.201250:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201254:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201261:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac599b00) 00010000:00010000:2.0:1746065079.201263:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.201266:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.201270:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc1461bb4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212209:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212221:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212228:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212232:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.212236:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212241:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212256:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:2.0:1746065079.212258:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.212261:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212266:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96c00/0xad6b7ddc1461bbb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.212316:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461bad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c669 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.212323:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461bad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c669 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.212335:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96000, rc 0) 00000100:00100000:2.0:1746065079.212398:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27881:x1830881261382144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11297us (11427us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.212406:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12062 00000100:00100000:0.0:1746065079.214115:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.214192:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261382272 00000100:00100000:2.0:1746065079.214199:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261382272 00000100:00100000:2.0:1746065079.214249:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12063 00000100:00100000:2.0:1746065079.214255:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27881:x1830881261382272:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.214269:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.214283:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461bc2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c670 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.214329:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.214339:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214347:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214355:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.214361:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214365:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214396:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214401:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214405:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214413:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214416:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.214419:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214424:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214432:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065079.214434:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.214437:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214441:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461bc9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214449:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214454:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214457:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214461:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.214463:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214467:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214475:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:2.0:1746065079.214476:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.214478:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214483:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1461bd0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.214502:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461bc2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c670 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.214509:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461bc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c670 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.214518:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:2.0:1746065079.216030:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27881:x1830881261382272:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1769us (1913us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.216038:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12063 00000100:00100000:0.0:1746065079.217695:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.218364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.218453:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261382400 00000100:00100000:2.0:1746065079.218461:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261382400 00000100:00100000:2.0:1746065079.218497:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12064 00000100:00100000:2.0:1746065079.218503:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27881:x1830881261382400:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.218518:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.218533:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461bd7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c677 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.218586:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461bde lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.218600:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461bde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.218608:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461bde lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065079.218644:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065079.218648:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065079.218672:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda400/0xad6b7ddc1461bd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c677 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.218685:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461bde lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c677 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.218692:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065079.218695:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065079.218697:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbe00, rc 0) 00000100:00100000:3.0:1746065079.218900:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261382656 00000100:00100000:3.0:1746065079.218903:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261382656 00000100:00100000:3.0:1746065079.218927:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12065 00000100:00100000:3.0:1746065079.218931:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27882:x1830881261382656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.218938:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.218944:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461be5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c67e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.218980:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.218987:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.218993:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219000:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.219005:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219010:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219035:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219039:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219044:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219054:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219059:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.219062:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219067:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219074:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:3.0:1746065079.219075:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.219078:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219082:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219093:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219098:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219102:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219106:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.219108:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219112:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219121:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:3.0:1746065079.219122:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.219124:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219129:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31800/0xad6b7ddc1461bf3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.219142:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461be5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c67e expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.219148:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1461be5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c67e expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.219153:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67a00, rc 0) 00000100:00100000:2.0:1746065079.219628:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27881:x1830881261382400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1123us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.219633:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12064 00000100:00100000:3.0:1746065079.219933:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27882:x1830881261382656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1000us (1570us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.219938:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12065 00000100:00100000:0.0:1746065079.224850:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.224904:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261382912 00000100:00100000:3.0:1746065079.224912:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261382912 00000100:00100000:3.0:1746065079.224960:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12066 00000100:00100000:3.0:1746065079.224967:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27881:x1830881261382912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.224984:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.224986:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065079.225008:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461bde lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c677 expref: 275 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.225036:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:3.0:1746065079.225045:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.225056:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bfa lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c685 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.225133:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.225142:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225149:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225156:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.225161:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225165:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225422:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.225429:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225434:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065079.225441:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 0 00010000:00010000:3.0:1746065079.225460:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225465:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225470:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225474:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225478:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.225481:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225486:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225492:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065079.225494:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.225497:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225500:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30e00/0xad6b7ddc1461c01 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:3.0:1746065079.225509:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009577ed80 reply state ffff88009851a000 transno 4294975436 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225515:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.225520:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:3.0:1746065079.225521:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.225523:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065079.225541:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1461bfa lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.225557:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 276 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.225572:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:3.0:1746065079.225574:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.225576:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:3.0:1746065079.225616:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27881:x1830881261382912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 650us (773us total) trans 4294975436 rc 0/0 00000100:00100000:3.0:1746065079.225622:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12066 00000100:00100000:0.0:1746065079.229885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.229934:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261383168 00000100:00100000:2.0:1746065079.229941:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261383168 00000100:00100000:2.0:1746065079.229992:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12067 00000100:00100000:2.0:1746065079.230000:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27881:x1830881261383168:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.230018:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.230033:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461c1d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c68c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.230141:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.230152:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.230157:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.230181:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.230191:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 278 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.230201:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262623488:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.230287:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.232428:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.232553:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261383424 00000100:00100000:2.0:1746065079.232558:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261383424 00000100:00100000:2.0:1746065079.232599:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12068 00000100:00100000:2.0:1746065079.232605:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27883:x1830881261383424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.232620:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.232634:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461c2b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c693 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.232709:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.232718:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232727:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065079.232737:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 0 00010000:00010000:2.0:1746065079.232824:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232830:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232836:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232840:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.232843:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232849:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232859:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:2.0:1746065079.232862:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065079.232865:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232869:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1461c32 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.232912:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461c2b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c693 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.232919:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc1461c2b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c693 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.232927:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:2.0:1746065079.232961:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27883:x1830881261383424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 356us (539us total) trans 4294975437 rc 301/301 00000100:00100000:2.0:1746065079.232967:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12068 00000100:00100000:2.0:1746065079.235080:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262623488:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.235103:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065079.235431:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.235704:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261383552 00000100:00100000:3.0:1746065079.235710:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261383552 00010000:00010000:3.0:1746065079.235734:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.235866:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3579 00000100:00100000:3.0:1746065079.235873:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+280:2004:x1830881261383552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.235883:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.235888:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.235898:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.235915:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461c0f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c685 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.235939:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:3.0:1746065079.235945:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.235952:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.235957:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.236020:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.236035:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236041:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065079.236060:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 0 00000004:00080000:2.0:1746065079.236184:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x359:0x0], index 1: 0 00000100:00100000:3.0:1746065079.236187:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+279:2004:x1830881261383552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 314us (756us total) trans 0 rc 0/0 00000004:00080000:2.0:1746065079.236189:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x358:0x0], index 0: 0 00000004:00080000:2.0:1746065079.236192:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x359:0x0], index 0: 0 00000100:00100000:3.0:1746065079.236194:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3579 00000004:00080000:2.0:1746065079.236195:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x35a:0x0], index 1: 0 00010000:00010000:2.0:1746065079.236271:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236278:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236283:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236287:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.236291:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236296:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236304:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:2.0:1746065079.236306:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.236308:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236312:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c24 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.236344:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461c1d lrc: 1/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c68c expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.236350:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1461c1d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c68c expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.236361:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdac00, rc 0) 00000100:00100000:2.0:1746065079.236663:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27881:x1830881261383168:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6663us (6784us total) trans 4294975438 rc 301/301 00000100:00100000:2.0:1746065079.236670:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12067 00000100:00100000:0.0:1746065079.240157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.240264:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261383808 00000100:00100000:2.0:1746065079.240271:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261383808 00000100:00100000:2.0:1746065079.240492:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4152 00000100:00100000:2.0:1746065079.240500:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27881:x1830881261383808:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.240700:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27881:x1830881261383808:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 200us (548us total) trans 4294975439 rc 0/0 00000100:00100000:2.0:1746065079.240705:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4152 00000100:00100000:0.0:1746065079.244353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.244387:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.244463:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261384064 00000100:00100000:1.0:1746065079.244470:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261384064 00000100:00100000:1.0:1746065079.244499:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4153 00000100:00100000:1.0:1746065079.244505:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27881:x1830881261384064:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065079.244673:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27881:x1830881261384064:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 168us (325us total) trans 4294975440 rc 0/0 00000100:00100000:1.0:1746065079.244682:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4153 00000100:00100000:3.0:1746065079.244760:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261384192 00000100:00100000:3.0:1746065079.244763:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261384192 00000100:00100000:3.0:1746065079.244797:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12069 00000100:00100000:3.0:1746065079.244801:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27883:x1830881261384192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.244809:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.244822:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c47 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c69a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.244869:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc1461c4e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.244880:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc1461c4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.244888:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc1461c4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065079.244905:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 0 00000004:00200000:3.0:1746065079.244908:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.244916:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc1461c4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.244932:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c47 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c69a expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.244944:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc1461c4e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c69a expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.244952:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.244954:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.244957:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:3.0:1746065079.244974:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27883:x1830881261384192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 172us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.244978:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12069 00000100:00100000:0.0:1746065079.247412:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.247466:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261384320 00000100:00100000:2.0:1746065079.247470:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261384320 00000100:00100000:2.0:1746065079.247508:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8490 00000100:00100000:2.0:1746065079.247513:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261384320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.247526:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.247585:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6a1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.247602:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.247617:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.247618:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.247625:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 36 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.247637:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 36 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.247646:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb000, rc 0) 00000100:00100000:2.0:1746065079.247676:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261384320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 163us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.247681:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8490 00000100:00100000:0.0:1746065079.249771:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.249845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.250105:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261384576 00000100:00100000:3.0:1746065079.250111:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261384576 00000100:00100000:3.0:1746065079.250142:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12070 00000100:00100000:3.0:1746065079.250147:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261384576:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.250163:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.250177:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc1461c5c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6a8 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.250275:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.250286:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250294:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250337:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.250343:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250348:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250383:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1461c71 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.250389:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1461c71 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250394:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1461c71 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.250401:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 0 00010000:00010000:3.0:1746065079.250452:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250458:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250463:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250468:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250473:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.250476:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250485:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250494:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2ac00) 00010000:00010000:3.0:1746065079.250496:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.250499:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250504:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250515:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250519:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250524:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250528:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.250530:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250534:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250539:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:3.0:1746065079.250541:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.250543:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250547:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.250583:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45c00/0xad6b7ddc1461c5c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a8 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.250596:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1461c71 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a8 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.250602:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.250604:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.250606:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45600, rc 0) 00000100:00100000:3.0:1746065079.250639:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261384576:12345-192.168.202.27@tcp:101:bash.0 Request processed in 492us (874us total) trans 4294975441 rc 0/0 00000100:00100000:3.0:1746065079.250644:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12070 00000100:00100000:0.0:1746065079.250867:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261384832 00000100:00100000:0.0:1746065079.250871:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261384832 00000100:00100000:0.0:1746065079.250948:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4154 00000100:00100000:0.0:1746065079.250955:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27883:x1830881261384832:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065079.251140:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27883:x1830881261384832:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 185us (1294us total) trans 4294975442 rc 0/0 00000100:00100000:0.0:1746065079.251145:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4154 00000100:00100000:0.0:1746065079.254796:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.255663:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.256085:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261384960 00000100:00100000:2.0:1746065079.256093:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261384960 00000100:00100000:2.0:1746065079.256137:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 548 00000100:00100000:2.0:1746065079.256144:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+284:2005:x1830881261384960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.256154:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.256175:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1461c71 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a8 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.256198:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:2.0:1746065079.256201:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.256249:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+283:2005:x1830881261384960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.256254:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 548 00000100:00100000:0.0:1746065079.257055:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.257099:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261385344 00000100:00100000:3.0:1746065079.257103:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261385344 00000100:00100000:3.0:1746065079.257124:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261385088 00000100:00100000:3.0:1746065079.257125:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261385088 00000100:00100000:3.0:1746065079.257137:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12071 00000100:00100000:3.0:1746065079.257142:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27883:x1830881261385344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.257158:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.257169:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c7f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6b6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.257242:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c86 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.257252:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c86 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.257264:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c86 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.257273:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 0 00010000:00010000:3.0:1746065079.257342:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461c7f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6b6 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.257354:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c86 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6b6 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.257360:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.257363:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065079.257365:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45a00, rc 0) 00000100:00100000:3.0:1746065079.257386:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27883:x1830881261385344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 244us (1726us total) trans 4294975443 rc 0/0 00000100:00100000:3.0:1746065079.257391:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12071 00000100:00100000:3.0:1746065079.257400:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12072 00000100:00100000:3.0:1746065079.257405:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261385088:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.257410:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.257415:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461c94 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6af expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.257426:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c9b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.257432:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c9b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.257438:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c9b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.257486:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461c94 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6af expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.257495:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c9b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6af expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.257500:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.257502:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065079.257504:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45400, rc 0) 00000100:00100000:3.0:1746065079.257517:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261385088:12345-192.168.202.27@tcp:101:bash.0 Request processed in 113us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.257522:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12072 00000100:00100000:0.0:1746065079.260114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.260460:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.260585:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261385472 00000100:00100000:2.0:1746065079.260591:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261385472 00000100:00100000:2.0:1746065079.260631:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4155 00000100:00100000:2.0:1746065079.260637:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27883:x1830881261385472:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065079.260741:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27883:x1830881261385472:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 104us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.260747:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4155 00000100:00100000:3.0:1746065079.261099:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261385728 00000100:00100000:3.0:1746065079.261103:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261385728 00000100:00100000:3.0:1746065079.261161:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12073 00000100:00100000:3.0:1746065079.261219:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261385728:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065079.261244:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.261264:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45800/0xad6b7ddc1461c4e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c69a expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.261277:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.261280:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.261383:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.261394:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.261404:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065079.261427:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975444 00000004:00010000:3.0:1746065079.261440:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800982cd180 reply state ffff88009aa03000 transno 4294975445 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.261446:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.261450:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.261453:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.261455:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.261496:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261385728:12345-192.168.202.27@tcp:36:bash.0 Request processed in 329us (1035us total) trans 4294975445 rc 0/0 00000100:00100000:3.0:1746065079.261500:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12073 00000020:00080000:3.0:1746065079.261503:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065079.263676:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.263838:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261385984 00000100:00100000:1.0:1746065079.263845:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261385984 00000100:00100000:1.0:1746065079.264043:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4156 00000100:00100000:1.0:1746065079.264049:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261385984:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065079.264279:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261385984:12345-192.168.202.27@tcp:35:bash.0 Request processed in 230us (608us total) trans 4294975446 rc 0/0 00000100:00100000:1.0:1746065079.264285:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4156 00000100:00100000:0.0:1746065079.267376:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.267517:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261386240 00000100:00100000:2.0:1746065079.267525:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261386240 00000100:00100000:2.0:1746065079.267621:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12074 00000100:00100000:2.0:1746065079.267628:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261386240:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.267648:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.267651:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065079.267676:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461c86 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6b6 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.270209:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:2.0:1746065079.270217:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.270235:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461ca9 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6bd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.270292:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461cb0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.270308:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461cb0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.270318:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461cb0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:2.0:1746065079.270502:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2393, 88 off198304 00000004:00080000:2.0:1746065079.270508:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675288733876ns, next at 675481510748ns, rc = 0 00000040:00080000:2.0:1746065079.270543:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2389, 88 off197872 00000004:00080000:2.0:1746065079.270547:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675288773552ns, next at 675481534386ns, rc = 0 00000040:00080000:2.0:1746065079.270598:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2390, 88 off197960 00000004:00080000:2.0:1746065079.270601:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675288827776ns, next at 675481534386ns, rc = 0 00000040:00080000:2.0:1746065079.270610:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2394, 88 off198392 00000004:00080000:2.0:1746065079.270612:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675288838750ns, next at 675481510748ns, rc = 0 00000100:00100000:1.0:1746065079.271335:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.271395:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261386496 00000100:00100000:3.0:1746065079.271401:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261386496 00000100:00100000:3.0:1746065079.271440:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12075 00000100:00100000:3.0:1746065079.271447:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27884:x1830881261386496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.271460:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.271470:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45e00/0xad6b7ddc1461cb7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6c4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.271513:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.271520:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271530:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271538:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.271544:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271548:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271614:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.271620:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271626:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065079.271633:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 2 00010000:00010000:3.0:1746065079.271670:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271675:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271681:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271685:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.271689:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271698:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271705:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.271707:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746065079.271710:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 2/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271714:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461ccc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271724:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271729:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271733:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271738:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271741:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.271743:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271747:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271752:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a100) 00010000:00010000:3.0:1746065079.271753:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.271755:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271760:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461cbe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271766:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271770:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271792:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271796:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.271798:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271803:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271808:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:3.0:1746065079.271810:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.271812:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271816:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc1461cc5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.271840:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45e00/0xad6b7ddc1461cb7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6c4 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.271846:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45e00/0xad6b7ddc1461cb7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6c4 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.271860:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000001:00080000:2.0:1746065079.272849:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975447 is committed 00000004:00080000:2.0:1746065079.272855:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1616 committed 00000100:00100000:3.0:1746065079.273043:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27884:x1830881261386496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1594us (1710us total) trans 4294975448 rc 301/301 00000100:00100000:3.0:1746065079.273051:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12075 00010000:00010000:3.0:1746065079.273073:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273079:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273084:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273088:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.273091:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273096:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273104:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:3.0:1746065079.273107:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.273109:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273113:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1461b6e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273123:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273130:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273135:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273139:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.273141:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273146:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273151:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9300) 00010000:00010000:3.0:1746065079.273153:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.273155:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273160:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461c08 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.273170:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.273174:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.273178:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.273182:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.273185:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.273190:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.273195:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.273196:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.273198:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.273202:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1461ca2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00080000:2.0:1746065079.273476:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1606 committed 00000004:00080000:2.0:1746065079.273486:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1605 committed 00000004:00080000:2.0:1746065079.273488:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1615 committed 00010000:00010000:2.0:1746065079.273536:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461cb0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6bd expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.273543:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:2.0:1746065079.273545:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.273552:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc1461ca9 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6bd expref: 274 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065079.273575:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461cb0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6bd expref: 273 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.273592:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:2.0:1746065079.273594:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.273596:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00000100:00100000:2.0:1746065079.273623:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:26180:x1830881261386240:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5996us (6256us total) trans 4294975447 rc 0/0 00000100:00100000:2.0:1746065079.273629:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12074 00000100:00100000:1.0:1746065079.273858:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262623872:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.273890:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.273925:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065079.273929:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262623744:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.273941:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.273950:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262624256:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.273960:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.273977:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262623872 00000100:00100000:1.0:1746065079.273981:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262623872 00000100:00100000:1.0:1746065079.274001:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262623744 00000100:00100000:1.0:1746065079.274002:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262623744 00000100:00100000:1.0:1746065079.274009:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624256 00000100:00100000:1.0:1746065079.274011:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624256 00000100:00100000:1.0:1746065079.274020:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8491 00000100:00100000:1.0:1746065079.274024:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+48:3762:x1830881262623872:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065079.274040:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:855 count 1 00010000:00010000:1.0:1746065079.274054:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.274066:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.274072:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.274074:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.274076:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.274094:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.274104:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 35 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.274113:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262624384:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065079.274147:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.274234:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8492 00000100:00100000:0.0:1746065079.274241:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+48:3762:x1830881262623744:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065079.274251:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:854 count 1 00002000:00010000:0.0:1746065079.274265:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065079.274270:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.274280:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.274282:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.274285:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.274294:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.274300:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.274306:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.274316:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065079.274448:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+49:3762:x1830881262623744:12345-0@lo:6:osp-syn-1-1.0 Request processed in 207us (505us total) trans 17179872504 rc 0/0 00000100:00100000:0.0:1746065079.274453:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8492 00000100:00100000:0.0:1746065079.274463:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8493 00000100:00100000:0.0:1746065079.274467:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+48:3762:x1830881262624256:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.274522:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+49:3762:x1830881262624256:12345-0@lo:2:osp-syn-1-1.0 Request processed in 55us (561us total) trans 17179872505 rc 0/0 00000100:00100000:0.0:1746065079.274527:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8493 00000100:00100000:2.0:1746065079.274794:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262623616:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.274817:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.274838:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624128:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.274852:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.274859:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624768:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.274871:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.274881:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746065079.274884:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624000:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.274896:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.274904:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624640:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.274915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.274925:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262625152:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.274937:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.274958:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262623616 00000100:00100000:2.0:1746065079.274960:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262623616 00000100:00100000:2.0:1746065079.274978:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624128 00000100:00100000:2.0:1746065079.274980:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624128 00000100:00100000:2.0:1746065079.274988:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624768 00000100:00100000:2.0:1746065079.274989:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624768 00000100:00100000:2.0:1746065079.274995:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624000 00000100:00100000:2.0:1746065079.274996:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624000 00000100:00100000:2.0:1746065079.275002:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624640 00000100:00100000:2.0:1746065079.275003:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624640 00000100:00100000:2.0:1746065079.275008:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262625152 00000100:00100000:2.0:1746065079.275010:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262625152 00000100:00100000:2.0:1746065079.275018:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8494 00000100:00100000:2.0:1746065079.275021:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+51:3760:x1830881262623616:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065079.275030:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:853 count 1 00010000:00010000:2.0:1746065079.275039:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275048:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 35 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.275054:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.275055:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.275057:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275070:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 35 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.275077:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 35 pid: 9549 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.275085:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262625280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.275121:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.275134:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8495 00000100:00100000:2.0:1746065079.275139:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+51:3760:x1830881262624128:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065079.275189:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.275191:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.275193:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.275194:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.275196:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.275218:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+52:3760:x1830881262624128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 79us (365us total) trans 17179872506 rc 0/0 00000100:00100000:2.0:1746065079.275223:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8495 00000100:00100000:2.0:1746065079.275233:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8496 00000100:00100000:2.0:1746065079.275236:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262624768:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.275246:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:854 count 1 00010000:00010000:2.0:1746065079.275256:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275265:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275270:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.275271:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.275273:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275288:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275299:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 19 pid: 3067 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.275307:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262625408:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.275325:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f480 going to sleep for 11 seconds 00000004:00080000:2.0:1746065079.275347:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dce00/2, rc 0, transno 17179872506 00000100:00100000:2.0:1746065079.275352:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624128:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.275366:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8497 00000100:00100000:2.0:1746065079.275371:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+51:3760:x1830881262624000:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065079.275381:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:856 count 1 00002000:00010000:2.0:1746065079.275393:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.275397:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275402:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.275403:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.275406:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275413:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275419:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275428:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275440:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065079.275527:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+52:3760:x1830881262624000:12345-0@lo:6:osp-syn-1-1.0 Request processed in 156us (629us total) trans 17179872507 rc 0/0 00000100:00100000:2.0:1746065079.275532:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8497 00000100:00100000:2.0:1746065079.275542:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8498 00000100:00100000:2.0:1746065079.275546:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262624640:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.275554:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:853 count 1 00002000:00010000:2.0:1746065079.275574:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.275578:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275583:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.275584:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.275586:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275594:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275599:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275603:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275613:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1746065079.275702:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3760:x1830881262624640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 156us (785us total) trans 21474839780 rc 0/0 00000100:00100000:2.0:1746065079.275707:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8498 00000100:00100000:2.0:1746065079.275716:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8499 00000100:00100000:2.0:1746065079.275719:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3760:x1830881262625152:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.275769:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3760:x1830881262625152:12345-0@lo:2:osp-syn-0-1.0 Request processed in 50us (831us total) trans 21474839781 rc 0/0 00000100:00100000:2.0:1746065079.275797:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8499 00010000:00010000:2.0:1746065079.275810:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1746065079.275816:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275823:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ac00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.275826:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275832:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275843:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275848:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1461ce1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275863:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1746065079.275865:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275870:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800906d0a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.275871:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275876:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275882:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275888:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275897:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.275899:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275903:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.275906:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275911:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275917:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275921:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1461cfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.275928:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.275929:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.275931:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.275936:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065079.275953:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982df800/2, rc 0, transno 17179872507 00000100:00100000:2.0:1746065079.275957:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624000:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065079.275963:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223100/2, rc 0, transno 21474839780 00000100:00100000:2.0:1746065079.275966:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624640:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065079.275971:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222680/2, rc 0, transno 21474839781 00000100:00100000:2.0:1746065079.275973:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262625152:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.276274:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262624896:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.276297:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.276314:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065079.276320:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262624512:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.276334:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.276343:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262625024:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.276354:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065079.276555:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065079.276577:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624896 00000100:00100000:1.0:1746065079.276582:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624896 00000100:00100000:1.0:1746065079.276600:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262624512 00000100:00100000:1.0:1746065079.276603:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262624512 00000100:00100000:1.0:1746065079.276612:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262625024 00000100:00100000:1.0:1746065079.276613:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262625024 00000100:00100000:1.0:1746065079.276622:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8500 00000100:00100000:1.0:1746065079.276626:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3761:x1830881262624896:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065079.276638:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:855 count 1 00002000:00010000:1.0:1746065079.276652:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1746065079.276662:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8501 00010000:00010000:1.0:1746065079.276662:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.276669:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3761:x1830881262624512:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065079.276671:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.276672:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.276675:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1746065079.276681:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:852 count 1 00010000:00010000:1.0:1746065079.276683:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.276689:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.276690:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.276694:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.276700:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.276704:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065079.276705:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065079.276706:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065079.276708:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.276723:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.276731:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.276739:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262625536:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.276790:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.276802:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8502 00000100:00100000:3.0:1746065079.276807:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3761:x1830881262625024:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.276822:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+19:3761:x1830881262624896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 195us (523us total) trans 21474839782 rc 0/0 00000100:00100000:1.0:1746065079.276828:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8500 00000004:00080000:1.0:1746065079.276858:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982dc380/2, rc 0, transno 17179872504 00000100:00100000:1.0:1746065079.276862:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262623744:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.276869:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3761:x1830881262625024:12345-0@lo:2:osp-syn-0-1.0 Request processed in 61us (513us total) trans 21474839783 rc 0/0 00000004:00080000:1.0:1746065079.276869:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d0380/2, rc 0, transno 17179872505 00000100:00100000:1.0:1746065079.276872:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262624256:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.276874:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8502 00000004:00080000:0.0:1746065079.277001:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221880/2, rc 0, transno 21474839783 00000100:00100000:0.0:1746065079.277005:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262625024:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065079.277012:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223b80/2, rc 0, transno 21474839782 00000100:00100000:0.0:1746065079.277014:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262624896:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.277057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.277076:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261386624 00000100:00100000:0.0:1746065079.277079:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261386624 00000100:00100000:0.0:1746065079.277102:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12076 00000100:00100000:0.0:1746065079.277107:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+273:27884:x1830881261386624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.277116:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.277127:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461d12 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6cb expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.277185:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461d19 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065079.277193:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461d19 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065079.277200:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461d19 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065079.277221:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 2 00000004:00200000:0.0:1746065079.277224:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065079.277237:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461d19 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065079.277257:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1461d12 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6cb expref: 275 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.277268:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461d19 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6cb expref: 274 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.277275:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:0.0:1746065079.277278:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.277280:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84be00, rc 0) 00000100:00100000:0.0:1746065079.277300:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+274:27884:x1830881261386624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 192us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.277305:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12076 00010000:00010000:2.0:1746065079.277803:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.277809:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.277815:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.277818:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.277824:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.277833:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.277838:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1461d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.277849:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.277850:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.277851:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.278416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.278499:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261386752 00000100:00100000:2.0:1746065079.278503:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261386752 00000100:00100000:2.0:1746065079.278531:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8503 00000100:00100000:2.0:1746065079.278536:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:26180:x1830881261386752:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.278545:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.278552:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6d2 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.278575:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 37 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.278581:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.278582:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.278585:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.278602:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 37 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.278615:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 37 pid: 3067 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.278623:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262625664:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.278667:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.278757:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262624384:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.278790:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.279887:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262625280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.279900:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.281534:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.281571:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.282157:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262625408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.282175:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.282297:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.282574:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261386880 00000100:00100000:1.0:1746065079.282579:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261386880 00010000:00010000:1.0:1746065079.282608:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 38 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.282627:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387136 00000100:00100000:1.0:1746065079.282630:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387136 00010000:00010000:1.0:1746065079.282637:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 20 pid: 3067 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.282657:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387008 00000100:00100000:1.0:1746065079.282659:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387008 00010000:00010000:1.0:1746065079.282666:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 39 pid: 9549 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746065079.282679:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3580 00000100:00100000:1.0:1746065079.282685:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261386880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.282695:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.282699:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 39 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.282707:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 39 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.282726:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1461b36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c646 expref: 39 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.282741:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.282743:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.282747:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.282754:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.282769:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.282814:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261386880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.282820:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3580 00000100:00100000:1.0:1746065079.282854:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3581 00000100:00100000:1.0:1746065079.282858:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261387136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.282864:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.282868:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 20 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.282875:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 20 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.282886:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97200/0xad6b7ddc1461b2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c63f expref: 20 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.282893:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.282895:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.282897:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.282903:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.282913:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.282924:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881261387136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.282928:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3581 00000100:00100000:1.0:1746065079.282935:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3582 00000100:00100000:1.0:1746065079.282939:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261387008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.282944:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.282947:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 37 pid: 9549 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746065079.282954:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 37 pid: 9549 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746065079.282963:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc1461ae2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c61c expref: 37 pid: 9549 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746065079.282970:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.282971:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.282973:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.282979:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.282989:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.282999:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881261387008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.283004:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3582 00010000:00010000:1.0:1746065079.283019:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283026:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283033:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283039:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283049:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065079.283208:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+52:3762:x1830881262623872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9182us (9316us total) trans 17179872508 rc 0/0 00000100:00100000:1.0:1746065079.283214:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8491 00000004:00080000:1.0:1746065079.283242:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982ded80/2, rc 0, transno 17179872508 00000100:00100000:1.0:1746065079.283247:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262623872:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.283256:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065079.283260:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283270:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.283274:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283280:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283289:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283294:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461cda lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.283304:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.283306:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.283307:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.283352:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.283359:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.283365:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.283370:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.283379:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065079.283472:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+19:3760:x1830881262624768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8234us (8599us total) trans 21474839784 rc 0/0 00000100:00100000:3.0:1746065079.283477:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8496 00000004:00080000:3.0:1746065079.283500:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223800/2, rc 0, transno 21474839784 00000100:00100000:3.0:1746065079.283503:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262624768:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065079.283920:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.283927:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.283933:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.283939:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.283956:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065079.284104:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+52:3760:x1830881262623616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9081us (9286us total) trans 17179872509 rc 0/0 00000100:00100000:2.0:1746065079.284110:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8494 00000004:00080000:3.0:1746065079.284165:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982ddc00/2, rc 0, transno 17179872509 00000100:00100000:3.0:1746065079.284168:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262623616:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065079.284176:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065079.284180:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284186:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.284189:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284194:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284203:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284208:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96400/0xad6b7ddc1461cef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284218:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.284220:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284230:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdaa00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.284232:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284237:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284243:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284248:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1461ce8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.284257:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.284258:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.284259:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.284363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.284481:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262625536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.284494:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.284535:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262625664:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.284549:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 35 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.284559:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c600, rc 0) 00000100:00100000:2.0:1746065079.284591:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+35:26180:x1830881261386752:12345-192.168.202.27@tcp:101:bash.0 Request processed in 6054us (6176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.284596:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8503 00000100:00100000:0.0:1746065079.285303:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387392 00000100:00100000:0.0:1746065079.285308:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387392 00010000:00010000:1.0:1746065079.285365:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.285488:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4157 00000100:00100000:0.0:1746065079.285494:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+274:27884:x1830881261387392:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065079.285753:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27884:x1830881261387392:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 257us (1389us total) trans 4294975449 rc 0/0 00000100:00100000:0.0:1746065079.285759:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4157 00000100:00100000:0.0:1746065079.286296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.286328:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.286383:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387520 00000100:00100000:2.0:1746065079.286387:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387520 00010000:00010000:2.0:1746065079.286404:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.286604:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387648 00000100:00100000:2.0:1746065079.286608:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387648 00010000:00010000:2.0:1746065079.286619:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 35 pid: 3067 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746065079.286666:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3583 00000100:00100000:1.0:1746065079.286673:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881261387520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.286682:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.286686:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.286694:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.286715:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc14619b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c5c1 expref: 19 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.286726:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.286728:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.286731:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.286738:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.286763:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.286803:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+18:2004:x1830881261387520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 132us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.286809:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3583 00000100:00100000:1.0:1746065079.286820:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3584 00000100:00100000:1.0:1746065079.286824:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261387648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.286831:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.286834:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 35 pid: 3067 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746065079.286842:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 35 pid: 3067 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746065079.286853:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1461c55 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6a1 expref: 35 pid: 3067 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746065079.286865:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.286867:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.286871:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.286877:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.286898:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.286908:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881262625792:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065079.286946:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065079.289303:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.289315:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.289329:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.289334:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.289347:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065079.289549:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3761:x1830881262624512:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12877us (13210us total) trans 21474839785 rc 0/0 00000100:00100000:3.0:1746065079.289558:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8501 00010000:00010000:1.0:1746065079.289649:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065079.289654:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.289661:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.289665:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.289671:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.289687:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.289698:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44600/0xad6b7ddc1461d0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.289712:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.289714:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.289715:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065079.289964:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135220380/2, rc 0, transno 21474839785 00000100:00100000:0.0:1746065079.289971:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262624512:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.290144:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.291251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.291254:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881262625792:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065079.291301:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387904 00000100:00100000:2.0:1746065079.291307:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387904 00000100:00100000:3.0:1746065079.291331:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261387776 00000100:00100000:3.0:1746065079.291334:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261387776 00000100:00100000:2.0:1746065079.291340:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8504 00000100:00100000:2.0:1746065079.291345:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+18:26180:x1830881261387904:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.291360:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065079.291364:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12077 00000100:00100000:3.0:1746065079.291368:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27884:x1830881261387776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.291376:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6e0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.291378:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.291387:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461d2e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6d9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.291393:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.291406:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.291408:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.291414:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.291424:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.291428:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.291431:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6ce00, rc 0) 00010000:00010000:3.0:1746065079.291435:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.291442:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.291450:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.291455:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.291460:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065079.291463:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+19:26180:x1830881261387904:12345-192.168.202.27@tcp:101:bash.0 Request processed in 118us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.291468:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8504 00010000:00010000:0.0:1746065079.291517:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.291536:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881261387648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4711us (5207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.291543:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3584 00010000:00010000:3.0:1746065079.292438:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.292448:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292455:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065079.292487:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 2 00000004:00200000:3.0:1746065079.292490:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.292503:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292510:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292518:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292523:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292527:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292533:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292541:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a174c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.292544:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292549:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292557:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065079.292570:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.292573:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292578:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174c00/0xad6b7ddc1461d35 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292589:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292593:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292598:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292601:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.292603:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292607:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292612:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.292614:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.292617:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292621:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1461d3c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.292645:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461d2e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d9 expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.292655:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d9 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.292660:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.292662:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.292664:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:3.0:1746065079.292690:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27884:x1830881261387776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1321us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.292695:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12077 00000100:00100000:0.0:1746065079.293316:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.293356:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261388032 00000100:00100000:2.0:1746065079.293361:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261388032 00000100:00100000:0.0:1746065079.293404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.293665:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261388160 00000100:00100000:3.0:1746065079.293669:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261388160 00002000:00010000:2.0:1746065079.294286:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/857 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.294290:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5180 with x1830881261388032 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.294298:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5180. 00000100:00100000:2.0:1746065079.294496:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1255 00000100:00100000:2.0:1746065079.294506:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881261388032:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.294656:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.294659:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.294661:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.294662:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.294664:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x359:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.294705:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881261388032:12345-192.168.202.27@tcp:10:bash.0 Request processed in 201us (1391us total) trans 17179872510 rc 0/0 00000100:00100000:2.0:1746065079.294711:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1255 00002000:00010000:2.0:1746065079.294714:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/857 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.294717:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5180 with x1830881261388032 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.294721:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5180. 00002000:00010000:3.0:1746065079.295127:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/856 (0->18446744073709551615) 00002000:00100000:3.0:1746065079.295130:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5c00 with x1830881261388160 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065079.295136:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5c00. 00000100:00100000:3.0:1746065079.295159:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1256 00000100:00100000:3.0:1746065079.295165:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+19:2006:x1830881261388160:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065079.295241:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065079.295243:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:3.0:1746065079.295245:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065079.295247:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:3.0:1746065079.295249:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065079.295282:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261388160:12345-192.168.202.27@tcp:10:bash.0 Request processed in 118us (1878us total) trans 21474839786 rc 0/0 00000100:00100000:3.0:1746065079.295287:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1256 00002000:00010000:3.0:1746065079.295290:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/856 (0->18446744073709551615) 00002000:00100000:3.0:1746065079.295292:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5c00 with x1830881261388160 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065079.295296:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5c00. 00000100:00100000:0.0:1746065079.296844:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.296986:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261388288 00000100:00100000:1.0:1746065079.296992:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261388288 00000100:00100000:1.0:1746065079.298379:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 549 00000100:00100000:1.0:1746065079.298390:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+276:2004:x1830881261388288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.298403:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.298425:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461d43 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d9 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.298439:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:1.0:1746065079.298442:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.298484:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+275:2004:x1830881261388288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.298490:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 549 00000100:00100000:3.0:1746065079.305026:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.305136:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261388544 00000100:00100000:1.0:1746065079.305145:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261388544 00000100:00100000:1.0:1746065079.305184:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4158 00000100:00100000:1.0:1746065079.305190:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+275:26180:x1830881261388544:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065079.305417:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261388544:12345-192.168.202.27@tcp:35:bash.0 Request processed in 225us (397us total) trans 4294975450 rc 0/0 00000100:00100000:1.0:1746065079.305424:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4158 00000100:00100000:3.0:1746065079.312465:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.312672:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261388800 00000100:00100000:0.0:1746065079.312680:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261388800 00000100:00100000:0.0:1746065079.312893:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12078 00000100:00100000:0.0:1746065079.312900:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27885:x1830881261388800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.312917:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.312932:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461d4a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6e7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.313017:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065079.313616:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.313628:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065079.313639:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 5 00010000:00010000:0.0:1746065079.313726:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461d4a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.314053:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.314060:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:0.0:1746065079.314063:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065079.314065:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:0.0:1746065079.314395:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27885:x1830881261388800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1493us (1936us total) trans 4294975451 rc 0/0 00000100:00100000:0.0:1746065079.314402:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12078 00000100:00100000:0.0:1746065079.317992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.318128:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389056 00000100:00100000:2.0:1746065079.318136:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389056 00000100:00100000:2.0:1746065079.318185:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12079 00000100:00100000:2.0:1746065079.318192:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27886:x1830881261389056:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065079.318233:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065079.318253:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc1461cb0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6bd expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.318272:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1461d19 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6cb expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.318283:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461c9b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6af expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.318291:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:2.0:1746065079.319204:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.319296:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.319308:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.319316:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.319325:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.319330:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.319335:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.319392:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.319400:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.319411:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 4/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.319435:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 275 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.319446:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 275 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.319458:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262625920:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.320011:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.322168:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262625920:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.322187:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065079.322294:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.322599:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389184 00000100:00100000:3.0:1746065079.322604:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389184 00010000:00010000:3.0:1746065079.322628:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 276 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.322659:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3585 00000100:00100000:3.0:1746065079.322665:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+276:2005:x1830881261389184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.322674:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.322679:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 276 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.322688:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 276 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.322706:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b000/0xad6b7ddc1461d51 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e7 expref: 276 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.322808:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:3.0:1746065079.322812:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.322820:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.322825:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.322844:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.322865:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.322870:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065079.322885:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+275:2005:x1830881261389184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 220us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.322891:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3585 00000004:00080000:2.0:1746065079.323142:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x334:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1746065079.323197:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323204:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323213:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323218:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.323221:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323226:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323232:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:2.0:1746065079.323234:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065079.323237:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323241:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461d6d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x334:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323255:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323259:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323263:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323267:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323270:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.323272:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323280:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323284:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065079.323286:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.323287:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323291:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461d5f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065079.323299:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f1a4700 reply state ffff88009a99b000 transno 4294975452 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323306:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.323310:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:2.0:1746065079.323312:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.323313:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065079.323688:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27886:x1830881261389056:12345-192.168.202.27@tcp:36:rm.0 Request processed in 5495us (5702us total) trans 4294975452 rc 0/0 00000100:00100000:2.0:1746065079.323694:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12079 00000100:00100000:2.0:1746065079.330145:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.330209:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389312 00000100:00100000:0.0:1746065079.330217:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389312 00000100:00100000:0.0:1746065079.330256:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12080 00000100:00100000:0.0:1746065079.330264:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27885:x1830881261389312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.330283:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.330300:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461d74 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6ee expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.330358:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461d7b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065079.330368:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461d7b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.330377:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461d7b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065079.330417:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x334:0x0]: returning size 5 00000004:00200000:0.0:1746065079.330421:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065079.330435:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461d7b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.330454:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1461d74 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x334:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6ee expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.330480:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44800/0xad6b7ddc1461d7b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x334:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6ee expref: 277 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.330487:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88009554fa00) 00010000:00010000:0.0:1746065079.330489:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065079.330492:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44800, rc 0) 00000100:00100000:0.0:1746065079.330533:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27885:x1830881261389312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 270us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.330539:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12080 00000100:00100000:0.0:1746065079.330841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.330892:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389440 00000100:00100000:1.0:1746065079.330896:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389440 00000100:00100000:1.0:1746065079.330915:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12081 00000100:00100000:1.0:1746065079.330919:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27887:x1830881261389440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.330926:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.330934:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461d82 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6f5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.330960:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.330966:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.330972:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.330980:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.330986:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.330991:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331023:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331028:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331035:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331040:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331045:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.331049:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331054:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331062:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4e2800) 00010000:00010000:1.0:1746065079.331064:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.331066:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331071:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1461d89 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331093:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331097:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331102:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331105:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.331107:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331115:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331121:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.331122:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.331124:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331128:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461d90 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.331144:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461d82 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6f5 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.331150:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461d82 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6f5 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.331160:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00400, rc 0) 00000100:00100000:1.0:1746065079.331190:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27887:x1830881261389440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 270us (350us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065079.331195:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12081 00000100:00100000:0.0:1746065079.338817:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.338899:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.338947:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389824 00000100:00100000:1.0:1746065079.338954:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389824 00000100:00100000:1.0:1746065079.338997:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12082 00000100:00100000:1.0:1746065079.339004:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+277:27887:x1830881261389824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.339019:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.339038:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461d97 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c6fc expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.339098:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389696 00010000:00010000:1.0:1746065079.339098:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065079.339102:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389696 00010000:00010000:1.0:1746065079.339107:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339115:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065079.339130:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4159 00000100:00100000:3.0:1746065079.339135:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27885:x1830881261389696:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:1.0:1746065079.339143:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.339148:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339153:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339181:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339185:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339190:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339194:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339198:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.339201:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339207:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339215:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4e2900) 00010000:00010000:1.0:1746065079.339217:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.339220:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339223:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461d9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339231:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339235:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339239:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339243:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.339245:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339248:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339252:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.339254:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.339256:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339259:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00c00/0xad6b7ddc1461da5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.339280:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461d97 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6fc expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065079.339285:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x334:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1746065079.339286:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461d97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6fc expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.339296:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01a00, rc 0) 00000040:00080000:3.0:1746065079.339335:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2395, 64 off198456 00000100:00100000:1.0:1746065079.339337:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27887:x1830881261389824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 334us (438us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065079.339342:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12082 00000040:00080000:3.0:1746065079.339354:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2391, 64 off198024 00000040:00080000:3.0:1746065079.339362:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2392, 64 off198088 00000040:00080000:3.0:1746065079.339370:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2396, 64 off198520 00010000:00010000:3.0:1746065079.339411:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 3/0,1 mode: --/PW res: [0x240000403:0x334:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065079.339421:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.339427:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.339432:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.339436:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.339439:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.339944:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.339949:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.339954:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.339957:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.339964:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 5/0,0 mode: PW/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.339971:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x334:0x0].0x0 (ffff88009554fa00) 00010000:00010000:2.0:1746065079.339974:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065079.339976:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 3/0,0 mode: --/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.339981:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.339982:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.339983:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.340012:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1746065079.340016:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461dac lrc: 0/0,0 mode: --/PW res: [0x240000403:0x334:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00000100:00100000:3.0:1746065079.340397:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27885:x1830881261389696:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1259us (1585us total) trans 4294975453 rc 0/0 00000100:00100000:3.0:1746065079.340404:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4159 00000100:00100000:0.0:1746065079.341514:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.341596:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261389952 00000100:00100000:1.0:1746065079.341601:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261389952 00000100:00100000:1.0:1746065079.341920:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12083 00000100:00100000:1.0:1746065079.341928:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:27887:x1830881261389952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.341941:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.341954:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461db3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c703 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.341996:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461dba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.342004:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461dba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.342012:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461dba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.342047:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065079.342050:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065079.342073:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461db3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c703 expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.342086:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461dba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c703 expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.342091:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4939900) 00010000:00010000:1.0:1746065079.342094:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065079.342096:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:1.0:1746065079.342724:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27887:x1830881261389952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 794us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.342730:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12083 00000100:00100000:0.0:1746065079.343345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.343378:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261390080 00000100:00100000:1.0:1746065079.343381:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261390080 00000100:00100000:1.0:1746065079.343399:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12084 00000100:00100000:1.0:1746065079.343404:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27885:x1830881261390080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.343417:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.343424:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1461dc1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c70a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.343457:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.343465:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343471:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343478:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.343484:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343488:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343515:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343524:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343529:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343534:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343539:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b21f5600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.343543:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343548:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343556:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4939900) 00010000:00010000:1.0:1746065079.343569:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.343572:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343578:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461dc8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343586:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343591:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343595:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343599:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.343601:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343605:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343610:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.343612:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.343614:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343618:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461dcf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.343636:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1461dc1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c70a expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.343642:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1461dc1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c70a expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.343649:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:1.0:1746065079.343676:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27885:x1830881261390080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 271us (331us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065079.343681:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12084 00000100:00100000:0.0:1746065079.348854:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.348898:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261390336 00000100:00100000:1.0:1746065079.348906:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261390336 00000100:00100000:1.0:1746065079.348949:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12085 00000100:00100000:1.0:1746065079.348955:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27887:x1830881261390336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.348971:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.348974:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065079.348995:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461dba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c703 expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.349017:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4939900) 00010000:00010000:1.0:1746065079.349025:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.349034:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc1461dd6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c711 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.349117:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.349126:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.349133:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.349144:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.349150:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.351686:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352010:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.352020:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352027:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.352035:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 0 00010000:00010000:1.0:1746065079.352052:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352057:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352062:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352067:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352072:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.352076:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352082:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352090:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.352092:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.352095:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352103:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ddd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065079.352111:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f1a5500 reply state ffff88009a518000 transno 4294975454 ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352118:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.352122:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:1.0:1746065079.352124:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065079.352127:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065079.352152:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779c00/0xad6b7ddc1461dd6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.352164:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.352170:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88012f893000) 00010000:00010000:1.0:1746065079.352172:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065079.352174:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01600, rc 0) 00000100:00100000:1.0:1746065079.352236:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:27887:x1830881261390336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3280us (3390us total) trans 4294975454 rc 0/0 00000100:00100000:1.0:1746065079.352242:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12085 00000100:00100000:2.0:1746065079.355666:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.356042:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.356095:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261390592 00000100:00100000:0.0:1746065079.356102:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261390592 00000100:00100000:0.0:1746065079.356132:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261390848 00000100:00100000:0.0:1746065079.356133:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261390848 00000100:00100000:0.0:1746065079.356586:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12086 00000100:00100000:0.0:1746065079.356594:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27887:x1830881261390592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.356612:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.356626:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461df9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c718 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.356704:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065079.356714:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 283 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.356720:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.356743:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 283 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.356752:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 283 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.356761:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262626048:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.356835:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.357329:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12087 00000100:00100000:1.0:1746065079.357338:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27888:x1830881261390848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.357346:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.357354:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461e07 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c71f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.357395:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.357402:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357412:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.357421:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 0 00010000:00010000:1.0:1746065079.357477:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357483:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357488:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357493:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.357496:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357501:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357509:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88012f893000) 00010000:00010000:1.0:1746065079.357511:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065079.357514:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 2/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357519:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461e0e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.357547:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461e07 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c71f expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.357553:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461e07 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c71f expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.357568:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00400, rc 0) 00000100:00100000:1.0:1746065079.357594:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27888:x1830881261390848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 258us (1552us total) trans 4294975455 rc 301/301 00000100:00100000:1.0:1746065079.357599:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12087 00000100:00100000:0.0:1746065079.358964:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262626048:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065079.358981:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065079.359866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.360038:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261390976 00000100:00100000:3.0:1746065079.360043:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261390976 00010000:00010000:3.0:1746065079.360068:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 284 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.360095:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3586 00000100:00100000:3.0:1746065079.360101:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+284:2004:x1830881261390976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.360111:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.360116:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 284 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.360126:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 284 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.360142:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01600/0xad6b7ddc1461deb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c711 expref: 284 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.360164:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88012f893000) 00010000:00010000:3.0:1746065079.360168:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.360175:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.360181:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.360198:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.360226:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+283:2004:x1830881261390976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.360231:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3586 00010000:00010000:0.0:1746065079.360476:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360485:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065079.360503:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 0 00000004:00080000:0.0:1746065079.360646:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x35a:0x0], index 0: 0 00000004:00080000:0.0:1746065079.360651:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x35b:0x0], index 1: 0 00000004:00080000:0.0:1746065079.360654:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x35c:0x0], index 1: 0 00000004:00080000:0.0:1746065079.360656:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x35b:0x0], index 0: 0 00010000:00010000:0.0:1746065079.360733:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360739:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360744:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360749:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.360752:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360758:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360766:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88012f893000) 00010000:00010000:0.0:1746065079.360768:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065079.360771:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360796:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e00 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.360834:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461df9 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c718 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.360840:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461df9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c718 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.360850:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45a00, rc 0) 00000100:00100000:0.0:1746065079.360872:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27887:x1830881261390592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4280us (5214us total) trans 4294975456 rc 301/301 00000100:00100000:0.0:1746065079.360878:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12086 00000100:00100000:0.0:1746065079.362956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.363334:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261391232 00000100:00100000:3.0:1746065079.363340:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261391232 00000100:00100000:3.0:1746065079.363693:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4160 00000100:00100000:3.0:1746065079.363700:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27887:x1830881261391232:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.364228:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27887:x1830881261391232:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 527us (1277us total) trans 4294975457 rc 0/0 00000100:00100000:3.0:1746065079.364235:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4160 00000100:00100000:0.0:1746065079.366219:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.366262:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.366332:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261391616 00000100:00100000:2.0:1746065079.366339:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261391616 00000100:00100000:2.0:1746065079.366386:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12088 00000100:00100000:2.0:1746065079.366392:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27888:x1830881261391616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.366408:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.366423:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461e23 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c726 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.366490:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461e2a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.366500:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461e2a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.366509:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461e2a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065079.366527:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 0 00000004:00200000:2.0:1746065079.366531:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065079.366542:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461e2a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.366558:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461e23 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c726 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.366586:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461e2a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c726 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.366593:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:2.0:1746065079.366596:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.366598:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d800, rc 0) 00000100:00100000:2.0:1746065079.366650:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27888:x1830881261391616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 258us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.366655:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12088 00000100:00100000:3.0:1746065079.366707:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261391488 00000100:00100000:3.0:1746065079.366710:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261391488 00000100:00100000:3.0:1746065079.366730:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4161 00000100:00100000:3.0:1746065079.366734:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27887:x1830881261391488:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.366838:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27887:x1830881261391488:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 103us (575us total) trans 4294975458 rc 0/0 00000100:00100000:3.0:1746065079.366844:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4161 00000100:00100000:0.0:1746065079.371728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.372427:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261391744 00000100:00100000:2.0:1746065079.372435:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261391744 00000100:00100000:2.0:1746065079.372471:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8505 00000100:00100000:2.0:1746065079.372477:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261391744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.372491:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.372507:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c72d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.372528:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.372544:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.372546:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.372553:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 21 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.372583:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 21 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.372592:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d600, rc 0) 00000100:00100000:2.0:1746065079.372644:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261391744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 167us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.372649:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8505 00000100:00100000:2.0:1746065079.372858:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.372902:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261392000 00000100:00100000:0.0:1746065079.372905:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261392000 00000100:00100000:0.0:1746065079.372926:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12089 00000100:00100000:0.0:1746065079.372931:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261392000:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065079.372942:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.372953:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461e38 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c734 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.373057:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.373067:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373078:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373086:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.373091:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373095:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373133:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e4d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065079.373139:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e4d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373145:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e4d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065079.373153:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 0 00010000:00010000:0.0:1746065079.373218:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373223:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373227:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373232:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373237:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.373878:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373886:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373895:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065079.373898:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.373901:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373906:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44600/0xad6b7ddc1461e3f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373930:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373935:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373939:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373943:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.373945:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.373950:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.374067:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:0.0:1746065079.374069:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.374072:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.374081:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45a00/0xad6b7ddc1461e46 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.374113:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1461e38 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c734 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.374124:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e4d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c734 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.374130:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:0.0:1746065079.374132:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.374134:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44c00, rc 0) 00000100:00100000:0.0:1746065079.375479:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261392000:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2542us (2616us total) trans 4294975459 rc 0/0 00000100:00100000:0.0:1746065079.375487:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12089 00000100:00100000:1.0:1746065079.375533:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.375575:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261392256 00000100:00100000:0.0:1746065079.375580:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261392256 00000100:00100000:0.0:1746065079.375614:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4162 00000100:00100000:0.0:1746065079.375620:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27888:x1830881261392256:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065079.375746:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27888:x1830881261392256:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 125us (213us total) trans 4294975460 rc 0/0 00000100:00100000:0.0:1746065079.375751:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4162 00000100:00100000:0.0:1746065079.377399:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.377439:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261392384 00000100:00100000:1.0:1746065079.377443:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261392384 00000100:00100000:1.0:1746065079.377485:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 550 00000100:00100000:1.0:1746065079.377492:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+288:2005:x1830881261392384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.377503:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.377522:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1461e4d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c734 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.377549:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:1.0:1746065079.377553:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.377595:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+287:2005:x1830881261392384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.377600:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 550 00000100:00100000:0.0:1746065079.378610:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.378676:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261392512 00000100:00100000:2.0:1746065079.378680:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261392512 00000100:00100000:2.0:1746065079.378706:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12090 00000100:00100000:2.0:1746065079.378712:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261392512:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.378729:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.378740:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461e5b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c73b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.378763:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1461e62 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.378789:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1461e62 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.378796:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1461e62 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.378873:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461e5b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c73b expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.378906:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1461e62 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c73b expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.378912:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:2.0:1746065079.378915:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065079.378917:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6da00, rc 0) 00000100:00100000:2.0:1746065079.378951:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261392512:12345-192.168.202.27@tcp:101:bash.0 Request processed in 239us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.378956:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12090 00000100:00100000:0.0:1746065079.379611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.380649:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.380747:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261392768 00000100:00100000:3.0:1746065079.380752:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261392768 00000100:00100000:3.0:1746065079.380796:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393024 00000100:00100000:3.0:1746065079.380798:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393024 00000100:00100000:3.0:1746065079.381002:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12091 00000100:00100000:3.0:1746065079.381009:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27888:x1830881261392768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.381022:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.381034:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1461e69 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c742 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.381096:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12092 00000100:00100000:0.0:1746065079.381102:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261393024:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:0.0:1746065079.381119:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.381132:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1461e2a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c726 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.381142:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:0.0:1746065079.381145:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065079.381256:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.381265:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.381272:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:0.0:1746065079.381297:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975461 00000004:00010000:0.0:1746065079.381308:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f1a6300 reply state ffff88011daa8000 transno 4294975462 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.381315:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.381320:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:0.0:1746065079.381322:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065079.381324:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065079.381372:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261393024:12345-192.168.202.27@tcp:36:bash.0 Request processed in 270us (724us total) trans 4294975462 rc 0/0 00000100:00100000:0.0:1746065079.381377:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12092 00000020:00080000:0.0:1746065079.381381:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1746065079.381475:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461e77 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.381483:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461e77 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.381489:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461e77 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.381496:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 0 00010000:00010000:3.0:1746065079.381547:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1461e69 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c742 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.381588:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461e77 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c742 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.381594:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:3.0:1746065079.381596:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065079.381598:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f600, rc 0) 00000100:00100000:3.0:1746065079.381618:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27888:x1830881261392768:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 610us (2008us total) trans 4294975463 rc 0/0 00000100:00100000:3.0:1746065079.381623:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12091 00000100:00100000:0.0:1746065079.383312:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.383352:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393152 00000100:00100000:1.0:1746065079.383357:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393152 00000100:00100000:1.0:1746065079.383391:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12093 00000100:00100000:1.0:1746065079.383397:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261393152:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.383410:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.383420:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc1461e85 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c749 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.383456:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc1461e85 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c749 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.383465:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc1461e85 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c749 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.383478:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:1.0:1746065079.383480:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.383482:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01400, rc 0) 00000100:00100000:1.0:1746065079.383520:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261393152:12345-192.168.202.27@tcp:101:bash.0 Request processed in 123us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.383525:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12093 00000100:00100000:0.0:1746065079.385694:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.385764:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.385916:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393408 00000100:00100000:3.0:1746065079.385923:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393408 00000100:00100000:3.0:1746065079.385951:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393536 00000100:00100000:3.0:1746065079.385953:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393536 00000100:00100000:3.0:1746065079.386630:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12094 00000100:00100000:3.0:1746065079.386638:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261393408:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.386657:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.386660:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746065079.386680:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc1461e85 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c749 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.386696:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f600/0xad6b7ddc1461e77 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c742 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.386704:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:3.0:1746065079.386708:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.386716:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461e8c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c750 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.386751:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.386760:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.386767:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:3.0:1746065079.386935:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2393, 88 off198176 00000004:00080000:3.0:1746065079.386941:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675405167015ns, next at 675481534386ns, rc = 0 00000040:00080000:3.0:1746065079.386978:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2397, 88 off198608 00000004:00080000:3.0:1746065079.386981:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675405207953ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065079.386999:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2398, 88 off198696 00000004:00080000:3.0:1746065079.387002:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675405228731ns, next at 675481510748ns, rc = 0 00000040:00080000:3.0:1746065079.387009:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2394, 88 off198264 00000004:00080000:3.0:1746065079.387011:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675405237692ns, next at 675481534386ns, rc = 0 00000100:00100000:1.0:1746065079.387204:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12095 00000100:00100000:1.0:1746065079.387231:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27888:x1830881261393536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.387239:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.387246:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461e9a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c757 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.387291:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.387298:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.387304:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.387317:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.387323:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065079.389041:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975464 is committed 00000004:00080000:2.0:1746065079.389049:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1608 committed 00000004:00080000:2.0:1746065079.389055:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1618 committed 00000004:00080000:2.0:1746065079.389065:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1617 committed 00000004:00080000:2.0:1746065079.389067:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1607 committed 00010000:00010000:2.0:1746065079.389128:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c750 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.389137:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:2.0:1746065079.389140:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.389142:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.389149:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.389153:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.389177:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461e8c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c750 expref: 279 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065079.389194:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c750 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.389217:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53d1000, rc 0) 00000100:00100000:2.0:1746065079.389264:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261393408:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2627us (3576us total) trans 4294975464 rc 0/0 00000100:00100000:2.0:1746065079.389271:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12094 00000100:00100000:1.0:1746065079.389398:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262626432:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.389437:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.389484:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065079.389488:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262626304:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.389503:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.389524:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626432 00000100:00100000:1.0:1746065079.389529:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626432 00000100:00100000:1.0:1746065079.389553:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626304 00000100:00100000:1.0:1746065079.389555:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626304 00000100:00100000:1.0:1746065079.389573:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8506 00000100:00100000:1.0:1746065079.389579:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+53:3762:x1830881262626432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.389685:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+54:3762:x1830881262626432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 106us (247us total) trans 17179872511 rc 0/0 00000100:00100000:1.0:1746065079.389690:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8506 00000100:00100000:1.0:1746065079.389700:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8507 00000100:00100000:1.0:1746065079.389704:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+53:3762:x1830881262626304:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065079.389714:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:858 count 1 00002000:00010000:1.0:1746065079.389730:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.389735:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389745:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.389746:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.389750:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389759:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389765:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389786:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389796:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065079.389892:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+54:3762:x1830881262626304:12345-0@lo:6:osp-syn-1-1.0 Request processed in 187us (387us total) trans 17179872512 rc 0/0 00000100:00100000:1.0:1746065079.389897:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8507 00000004:00080000:1.0:1746065079.389923:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d2a00/2, rc 0, transno 17179872512 00000100:00100000:1.0:1746065079.389927:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262626304:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065079.389933:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d0000/2, rc 0, transno 17179872511 00000100:00100000:1.0:1746065079.389936:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262626432:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.389944:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065079.389948:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389959:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.389962:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389969:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389978:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389983:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xad6b7ddc1461ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.389992:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.389994:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.389995:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.390001:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.390006:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.390031:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 2 00000004:00200000:1.0:1746065079.390034:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065079.390046:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.390067:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1461e9a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c757 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.390080:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c757 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.390085:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:1.0:1746065079.390088:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065079.390090:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:1.0:1746065079.390109:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27888:x1830881261393536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2899us (4345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.390114:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12095 00010000:00010000:3.0:1746065079.390596:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390603:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390608:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390612:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580ee00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.390615:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390620:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390628:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.390630:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.390632:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390637:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1461d66 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.390646:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390650:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390654:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390658:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.390660:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390664:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390668:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a300) 00010000:00010000:3.0:1746065079.390670:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.390672:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390676:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779400/0xad6b7ddc1461de4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.390685:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.390690:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.390694:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.390697:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.390699:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.390703:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.390708:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:3.0:1746065079.390710:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.390711:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.390715:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1461e70 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065079.390824:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262626816:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.390850:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.390882:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065079.390886:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262626944:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.390898:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.391057:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262626176:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.391079:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.391101:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262626688:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.391112:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.391122:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065079.391125:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262626560:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.391136:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.391143:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262627072:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.391153:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.391172:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626816 00000100:00100000:2.0:1746065079.391175:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626816 00000100:00100000:2.0:1746065079.391192:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626944 00000100:00100000:2.0:1746065079.391194:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626944 00000100:00100000:2.0:1746065079.391201:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626176 00000100:00100000:2.0:1746065079.391203:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626176 00000100:00100000:2.0:1746065079.391210:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626688 00000100:00100000:2.0:1746065079.391212:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626688 00000100:00100000:2.0:1746065079.391216:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262626560 00000100:00100000:2.0:1746065079.391218:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262626560 00000100:00100000:2.0:1746065079.391223:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262627072 00000100:00100000:2.0:1746065079.391224:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262627072 00000100:00100000:2.0:1746065079.391230:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8508 00000100:00100000:2.0:1746065079.391234:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3761:x1830881262626816:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.391246:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:857 count 1 00002000:00010000:2.0:1746065079.391262:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.391266:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391274:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.391276:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.391279:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391286:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391292:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391298:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391307:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.391416:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3761:x1830881262626816:12345-0@lo:6:osp-syn-0-1.0 Request processed in 180us (565us total) trans 21474839787 rc 0/0 00000100:00100000:2.0:1746065079.391420:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8508 00000100:00100000:2.0:1746065079.391429:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8509 00000100:00100000:2.0:1746065079.391433:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3761:x1830881262626944:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065079.391471:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.391473:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.391475:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.391477:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.391479:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.391491:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3761:x1830881262626944:12345-0@lo:2:osp-syn-0-1.0 Request processed in 59us (593us total) trans 21474839788 rc 0/0 00000100:00100000:2.0:1746065079.391496:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8509 00000100:00100000:2.0:1746065079.391502:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8510 00000100:00100000:2.0:1746065079.391506:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+55:3760:x1830881262626176:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065079.391513:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:857 count 1 00010000:00010000:2.0:1746065079.391521:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391531:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391536:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.391537:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.391539:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391555:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391577:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 34 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.391590:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262627200:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.391637:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.391651:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8511 00000100:00100000:2.0:1746065079.391656:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+22:3760:x1830881262626688:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.391665:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:856 count 1 00010000:00010000:2.0:1746065079.391674:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391682:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391687:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.391688:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.391690:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391703:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391710:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 20 pid: 10219 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.391719:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262627328:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.391738:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.391754:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8512 00000100:00100000:2.0:1746065079.391759:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+55:3760:x1830881262626560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.391846:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+56:3760:x1830881262626560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 86us (708us total) trans 17179872513 rc 0/0 00000100:00100000:2.0:1746065079.391851:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8512 00000100:00100000:2.0:1746065079.391861:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8513 00000100:00100000:2.0:1746065079.391865:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+22:3760:x1830881262627072:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.391916:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+23:3760:x1830881262627072:12345-0@lo:2:osp-syn-0-1.0 Request processed in 50us (761us total) trans 21474839789 rc 0/0 00000100:00100000:2.0:1746065079.391920:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8513 00010000:00010000:2.0:1746065079.391931:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.391935:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391941:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fa00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.391943:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391950:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391959:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391964:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1461eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.391974:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.391976:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.391977:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065079.391993:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d2300/2, rc 0, transno 17179872513 00000100:00100000:2.0:1746065079.391998:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262626560:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065079.392005:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85f800/2, rc 0, transno 21474839789 00000100:00100000:2.0:1746065079.392008:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262627072:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065079.392077:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85ea00/2, rc 0, transno 21474839788 00000100:00100000:0.0:1746065079.392081:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262626944:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065079.392088:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c700/2, rc 0, transno 21474839787 00000100:00100000:0.0:1746065079.392090:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262626816:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.394059:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.394350:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393664 00000100:00100000:1.0:1746065079.394355:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393664 00000100:00100000:1.0:1746065079.394386:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8514 00000100:00100000:1.0:1746065079.394391:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:26180:x1830881261393664:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.394402:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.394414:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c75e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.394433:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065079.394440:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.394441:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.394444:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.394465:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065079.394474:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 22 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746065079.394484:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262627200:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065079.394484:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262627456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.394502:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.394544:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.394571:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262627328:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.394583:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.395420:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.395447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.395477:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.395527:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393792 00000100:00100000:3.0:1746065079.395531:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393792 00010000:00010000:3.0:1746065079.395549:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 23 pid: 10219 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.395573:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261393920 00000100:00100000:3.0:1746065079.395576:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261393920 00010000:00010000:3.0:1746065079.395585:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 35 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.395599:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3587 00000100:00100000:3.0:1746065079.395604:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261393792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.395612:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.395615:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 23 pid: 10219 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.395623:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 23 pid: 10219 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.395627:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3588 00000100:00100000:1.0:1746065079.395634:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261393920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.395639:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6ce00/0xad6b7ddc1461d27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6e0 expref: 23 pid: 10219 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.395641:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.395645:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 35 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.395648:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.395650:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.395652:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395653:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 35 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.395659:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395664:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461d20 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c6d2 expref: 35 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.395672:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.395673:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.395674:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.395676:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395682:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.395695:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261393792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065079.395700:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.395701:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3587 00000100:00100000:1.0:1746065079.395716:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261393920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.395722:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3588 00010000:00010000:1.0:1746065079.395738:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395744:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395751:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395757:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395767:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065079.395802:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.395808:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.395814:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.395820:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.395830:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065079.395951:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3760:x1830881262626688:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4293us (4836us total) trans 21474839790 rc 0/0 00000100:00100000:1.0:1746065079.395952:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+56:3760:x1830881262626176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4444us (4871us total) trans 17179872514 rc 0/0 00000100:00100000:2.0:1746065079.395958:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8511 00000100:00100000:1.0:1746065079.395961:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8510 00010000:00010000:1.0:1746065079.395974:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1746065079.395977:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261394176 00010000:00010000:1.0:1746065079.395979:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.395980:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261394176 00010000:00010000:1.0:1746065079.395985:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.395988:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.395995:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.395999:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4163 00000100:00100000:2.0:1746065079.396004:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+274:27888:x1830881261394176:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:1.0:1746065079.396004:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396013:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461eb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396025:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065079.396027:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396033:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.396035:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396041:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396048:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396053:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1461ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396066:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.396068:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.396069:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.396073:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065079.396110:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+275:27888:x1830881261394176:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 105us (631us total) trans 4294975465 rc 0/0 00000100:00100000:2.0:1746065079.396115:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4163 00000004:00080000:3.0:1746065079.396209:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d3800/2, rc 0, transno 17179872514 00000100:00100000:3.0:1746065079.396214:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262626176:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065079.396224:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834fb80/2, rc 0, transno 21474839790 00000100:00100000:3.0:1746065079.396227:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262626688:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.396885:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262627456:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.396901:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.396911:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01600, rc 0) 00000100:00100000:1.0:1746065079.396931:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:26180:x1830881261393664:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2540us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.396936:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8514 00000100:00100000:0.0:1746065079.397885:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.398002:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261394304 00000100:00100000:2.0:1746065079.398007:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261394304 00010000:00010000:2.0:1746065079.398026:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 21 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.398054:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3589 00000100:00100000:2.0:1746065079.398059:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261394304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.398067:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.398071:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 21 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.398079:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 21 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.398095:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc1461e31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c72d expref: 21 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.398104:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.398106:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.398110:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.398121:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.398141:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.398149:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881262627584:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065079.398196:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.398571:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.398633:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261394560 00000100:00100000:1.0:1746065079.398637:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261394560 00000100:00100000:1.0:1746065079.398663:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12096 00000100:00100000:1.0:1746065079.398668:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+275:27888:x1830881261394560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.398681:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.398693:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461ecb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c765 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.398746:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.398755:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398763:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398799:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.398805:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398810:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398879:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461ee0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.398886:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398891:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461ee0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.398899:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 2 00010000:00010000:1.0:1746065079.398951:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398957:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398961:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398966:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398970:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3da00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.398973:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398981:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398988:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.398991:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.398993:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.398997:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461ed2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399004:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399007:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399011:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399014:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.399016:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399020:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399024:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:1.0:1746065079.399025:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.399027:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399030:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1461ed9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.399057:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461ecb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c765 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.399068:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c765 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.399074:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:1.0:1746065079.399075:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065079.399077:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:1.0:1746065079.399974:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:27888:x1830881261394560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1303us (1410us total) trans 4294975466 rc 0/0 00000100:00100000:1.0:1746065079.399981:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12096 00000100:00100000:2.0:1746065079.401509:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881262627584:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065079.401527:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.401572:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261394304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3511us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.401580:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3589 00000100:00100000:0.0:1746065079.401828:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.401866:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.401972:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261394688 00000100:00100000:1.0:1746065079.401977:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261394688 00000100:00100000:1.0:1746065079.402015:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8515 00000100:00100000:1.0:1746065079.402021:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:26180:x1830881261394688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.402035:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.402051:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c76c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065079.402069:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.402085:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.402087:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.402093:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.402104:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.402113:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:1.0:1746065079.402132:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:26180:x1830881261394688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 112us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.402137:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8515 00000100:00100000:2.0:1746065079.402183:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261394944 00000100:00100000:2.0:1746065079.402186:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261394944 00000100:00100000:2.0:1746065079.402218:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4164 00000100:00100000:2.0:1746065079.402223:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27888:x1830881261394944:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.402335:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27888:x1830881261394944:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 111us (468us total) trans 4294975467 rc 0/0 00000100:00100000:2.0:1746065079.402340:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4164 00000100:00100000:0.0:1746065079.404089:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.404130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.404238:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.404411:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261395072 00000100:00100000:2.0:1746065079.404416:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261395072 00002000:00010000:2.0:1746065079.404438:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/858 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.404442:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881261395072 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.404451:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9880. 00000100:00100000:2.0:1746065079.404461:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261395200 00000100:00100000:2.0:1746065079.404463:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261395200 00002000:00010000:2.0:1746065079.404469:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/859 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.404471:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881261395200 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.404476:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8a80. 00000100:00100000:2.0:1746065079.404485:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1257 00000100:00100000:2.0:1746065079.404490:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261395072:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.404614:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.404617:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.404619:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.404621:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.404622:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.404661:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261395072:12345-192.168.202.27@tcp:10:bash.0 Request processed in 170us (577us total) trans 21474839791 rc 0/0 00000100:00100000:2.0:1746065079.404667:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1257 00002000:00010000:2.0:1746065079.404669:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/858 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.404671:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881261395072 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.404675:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9880. 00000100:00100000:2.0:1746065079.404686:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1258 00000100:00100000:2.0:1746065079.404690:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261395200:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:3.0:1746065079.405120:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261395328 00000100:00100000:3.0:1746065079.405124:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261395328 00000100:00100000:3.0:1746065079.405144:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4165 00000100:00100000:3.0:1746065079.405149:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27888:x1830881261395328:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065079.405228:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27888:x1830881261395328:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 79us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.405233:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4165 00002000:00010000:2.0:1746065079.405609:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x35b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.405612:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x35b:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.405614:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x35b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.405616:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x35b:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.405618:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x35b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.405849:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881261395200:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1157us (1718us total) trans 17179872515 rc 0/0 00000100:00100000:2.0:1746065079.405856:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1258 00002000:00010000:2.0:1746065079.405858:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/859 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.405861:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881261395200 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.405865:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8a80. 00000100:00100000:0.0:1746065079.408829:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.409089:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261395584 00000100:00100000:3.0:1746065079.409096:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261395584 00000100:00100000:3.0:1746065079.409127:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4166 00000100:00100000:3.0:1746065079.409133:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261395584:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065079.409861:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261395584:12345-192.168.202.27@tcp:35:bash.0 Request processed in 725us (1036us total) trans 4294975468 rc 0/0 00000100:00100000:3.0:1746065079.409867:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4166 00000100:00100000:0.0:1746065079.416682:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.416746:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261395840 00000100:00100000:1.0:1746065079.416754:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261395840 00000100:00100000:1.0:1746065079.416810:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12097 00000100:00100000:1.0:1746065079.416816:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27889:x1830881261395840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.416833:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.416848:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461ef5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c773 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.416930:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461efc lrc: 3/1,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.416941:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461efc lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.416950:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461efc lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.416959:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 5 00010000:00010000:1.0:1746065079.417028:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461ef5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c773 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.417043:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461efc lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c773 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.417054:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:1.0:1746065079.417057:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065079.417059:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:1.0:1746065079.417096:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:27889:x1830881261395840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 280us (422us total) trans 4294975469 rc 0/0 00000100:00100000:1.0:1746065079.417101:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12097 00000100:00100000:0.0:1746065079.421392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.421490:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396096 00000100:00100000:3.0:1746065079.421497:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396096 00000100:00100000:3.0:1746065079.421545:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12098 00000100:00100000:3.0:1746065079.421551:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27890:x1830881261396096:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065079.421603:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1746065079.421625:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461efc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c773 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.421646:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1461e93 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c750 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.421658:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1461ee0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c765 expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.421668:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461ea1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c757 expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.421677:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1461e62 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c73b expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.421685:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:3.0:1746065079.421692:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.421710:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.421719:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.421726:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.421735:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.421740:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.421744:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.421843:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.421848:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.421853:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:3.0:1746065079.422000:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x336:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1746065079.422049:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422055:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422060:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422064:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.422067:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422072:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422079:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff8800929a3b00) 00010000:00010000:3.0:1746065079.422081:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065079.422084:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422088:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac31600/0xad6b7ddc1461f18 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x336:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422103:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422108:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422112:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422117:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422120:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800906d0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.422122:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422126:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422131:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065079.422133:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.422134:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422139:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1461f0a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:3.0:1746065079.422146:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc3800 reply state ffff88009c17a000 transno 4294975470 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422152:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.422157:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065079.422159:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.422161:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.422207:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27890:x1830881261396096:12345-192.168.202.27@tcp:36:rm.0 Request processed in 656us (823us total) trans 4294975470 rc 0/0 00000100:00100000:3.0:1746065079.422212:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12098 00000100:00100000:0.0:1746065079.425390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.425461:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396224 00000100:00100000:1.0:1746065079.425469:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396224 00000100:00100000:1.0:1746065079.425500:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12099 00000100:00100000:1.0:1746065079.425506:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:27889:x1830881261396224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.425522:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.425537:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461f1f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c77a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.425598:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461f26 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.425608:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461f26 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.425616:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461f26 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065079.425648:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x336:0x0]: returning size 5 00000004:00200000:1.0:1746065079.425651:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065079.425662:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461f26 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.425680:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc1461f1f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x336:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c77a expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.426648:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c800/0xad6b7ddc1461f26 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x336:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c77a expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.426656:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:1.0:1746065079.426658:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065079.426661:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c800, rc 0) 00000100:00100000:1.0:1746065079.426702:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27889:x1830881261396224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1197us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.426708:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12099 00000100:00100000:0.0:1746065079.431053:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.431128:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396480 00000100:00100000:3.0:1746065079.431135:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396480 00000100:00100000:3.0:1746065079.431169:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4167 00000100:00100000:3.0:1746065079.431175:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27889:x1830881261396480:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065079.431347:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x336:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065079.431391:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2395, 64 off198328 00000040:00080000:3.0:1746065079.431407:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2399, 64 off198760 00000040:00080000:3.0:1746065079.431414:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2400, 64 off198824 00000040:00080000:3.0:1746065079.431420:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2396, 64 off198392 00010000:00010000:3.0:1746065079.431458:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x336:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065079.431469:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.431478:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.431484:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.431488:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065079.431493:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.432987:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.432994:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.433000:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065079.433003:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.433009:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 5/0,0 mode: PW/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.433020:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x336:0x0].0x0 (ffff88012d56cf00) 00010000:00010000:2.0:1746065079.433023:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065079.433025:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 3/0,0 mode: --/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.433031:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.433032:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065079.433034:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.433055:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1746065079.433062:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1461f2d lrc: 0/0,0 mode: --/PW res: [0x240000403:0x336:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00000100:00100000:3.0:1746065079.433275:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27889:x1830881261396480:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2097us (2226us total) trans 4294975471 rc 0/0 00000100:00100000:3.0:1746065079.433282:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4167 00000100:00100000:0.0:1746065079.435527:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.435603:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396608 00000100:00100000:1.0:1746065079.435609:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396608 00000100:00100000:1.0:1746065079.435652:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12100 00000100:00100000:1.0:1746065079.435658:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27891:x1830881261396608:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.435674:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.435688:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461f34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c781 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.435736:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.435745:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435753:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435761:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.435771:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435798:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435827:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435832:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435837:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435842:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435846:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.435849:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435854:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435862:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065079.435864:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.435867:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435871:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1461f3b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435880:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435885:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435889:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435893:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.435895:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435899:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435904:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:1.0:1746065079.435906:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.435907:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435911:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc1461f42 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.435931:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461f34 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c781 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.435937:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1461f34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c781 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.435947:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:1.0:1746065079.435980:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27891:x1830881261396608:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 322us (459us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065079.435985:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12100 00000100:00100000:0.0:1746065079.438851:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.439257:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396736 00000100:00100000:3.0:1746065079.439264:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396736 00000100:00100000:3.0:1746065079.440218:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12101 00000100:00100000:3.0:1746065079.440227:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27891:x1830881261396736:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.440246:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.440263:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461f49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c788 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.440313:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.440324:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440332:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440340:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.440346:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440351:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440386:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440392:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440397:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440402:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440407:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b21f5600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.440410:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440415:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440423:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3b00) 00010000:00010000:3.0:1746065079.440425:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.440428:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440432:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b21f5600/0xad6b7ddc1461f50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440442:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440446:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440450:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440454:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.440457:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440462:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440467:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065079.440468:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.440470:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440474:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1461f57 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.440494:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461f49 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c788 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.440501:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174000/0xad6b7ddc1461f49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c788 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.440511:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174000, rc 0) 00000100:00100000:3.0:1746065079.440558:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27891:x1830881261396736:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 333us (1714us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.440573:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12101 00000100:00100000:0.0:1746065079.442350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.443069:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.443391:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396864 00000100:00100000:1.0:1746065079.443399:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396864 00000100:00100000:1.0:1746065079.444273:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261396992 00000100:00100000:1.0:1746065079.444277:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261396992 00000100:00100000:3.0:1746065079.444329:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12102 00000100:00100000:3.0:1746065079.444337:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27891:x1830881261396864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.444355:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.444372:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1461f5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c78f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.444423:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc1461f65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.444435:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc1461f65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444444:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc1461f65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.444484:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065079.444487:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065079.444510:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1461f5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c78f expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.444522:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc1461f65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c78f expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.444528:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3c00) 00010000:00010000:3.0:1746065079.444531:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065079.444534:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7a00, rc 0) 00000100:00100000:3.0:1746065079.444591:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27891:x1830881261396864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 255us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.444596:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12102 00000100:00100000:3.0:1746065079.444611:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12103 00000100:00100000:3.0:1746065079.444615:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27889:x1830881261396992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.444621:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.444626:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc1461f6c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c796 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.444649:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.444655:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444660:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444666:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.444671:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444676:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444699:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444704:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444709:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444713:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444718:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.444721:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444729:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444735:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3c00) 00010000:00010000:3.0:1746065079.444737:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.444739:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444743:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461f73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444749:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444753:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444758:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444761:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.444763:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444767:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444785:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065079.444787:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.444789:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444793:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461f7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.444806:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc1461f6c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c796 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.444812:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6000/0xad6b7ddc1461f6c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c796 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.444817:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6000, rc 0) 00000100:00100000:3.0:1746065079.444832:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27889:x1830881261396992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 216us (1764us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.444836:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12103 00000100:00100000:0.0:1746065079.452188:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.452806:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261397120 00000100:00100000:2.0:1746065079.452813:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261397120 00000100:00100000:2.0:1746065079.453040:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12104 00000100:00100000:2.0:1746065079.453047:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27891:x1830881261397120:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.453066:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.453081:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461f81 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c79d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.453136:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.453147:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453155:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453164:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.453169:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453173:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453203:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453208:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453212:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453217:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453222:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.453226:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453231:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453240:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3c00) 00010000:00010000:2.0:1746065079.453242:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.453245:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453250:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461f88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453547:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453553:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453558:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453570:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.453572:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453577:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453583:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065079.453585:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.453587:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453595:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.453619:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461f81 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c79d expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.453626:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461f81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c79d expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.453632:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:2.0:1746065079.453688:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27891:x1830881261397120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 641us (1510us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.453693:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12104 00000100:00100000:0.0:1746065079.459340:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.459460:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261397376 00000100:00100000:2.0:1746065079.459467:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261397376 00000100:00100000:2.0:1746065079.459511:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12105 00000100:00100000:2.0:1746065079.459517:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27891:x1830881261397376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.459534:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.459537:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065079.459570:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc1461f65 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c78f expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.460712:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3c00) 00010000:00010000:2.0:1746065079.460726:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.460743:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461f96 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7a4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.460849:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.460859:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.460868:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.460875:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.460880:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.460885:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461164:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.461170:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461175:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065079.461182:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 0 00010000:00010000:2.0:1746065079.461200:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461205:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461210:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461215:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461220:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.461224:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461229:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461236:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b7e52a00) 00010000:00010000:2.0:1746065079.461238:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.461240:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461245:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1461f9d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065079.461253:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc1180 reply state ffff88009a640000 transno 4294975472 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461260:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.461264:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065079.461266:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.461268:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065079.461285:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1461f96 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.461296:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.461302:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff8800b7e52500) 00010000:00010000:2.0:1746065079.461304:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.461306:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d600, rc 0) 00000100:00100000:2.0:1746065079.461742:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27891:x1830881261397376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2223us (2408us total) trans 4294975472 rc 0/0 00000100:00100000:2.0:1746065079.461750:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12105 00000100:00100000:0.0:1746065079.464457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.464500:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.464589:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261397632 00000100:00100000:2.0:1746065079.464597:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261397632 00000100:00100000:2.0:1746065079.465923:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261397888 00000100:00100000:2.0:1746065079.465928:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261397888 00000100:00100000:3.0:1746065079.465992:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12106 00000100:00100000:3.0:1746065079.466000:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27891:x1830881261397632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.466022:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.466038:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1461fb9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7ab expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.466127:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.466139:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.466147:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.466174:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.466188:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 285 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.466198:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262627712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.466263:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.466483:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12107 00000100:00100000:2.0:1746065079.466489:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27892:x1830881261397888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.466496:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.466502:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461fc7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7b2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.466556:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.466574:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466582:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065079.466591:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 0 00010000:00010000:2.0:1746065079.466644:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466650:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466656:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466662:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.466666:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466672:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466680:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff8800b7e52500) 00010000:00010000:2.0:1746065079.466682:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065079.466685:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 2/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466689:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fce lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.466718:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461fc7 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7b2 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.466725:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1461fc7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7b2 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.466732:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c600, rc 0) 00000100:00100000:2.0:1746065079.466752:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27892:x1830881261397888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 264us (2252us total) trans 4294975473 rc 301/301 00000100:00100000:2.0:1746065079.466758:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12107 00000100:00100000:2.0:1746065079.468942:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.468992:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261398016 00000100:00100000:0.0:1746065079.468998:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261398016 00010000:00010000:0.0:1746065079.469023:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 286 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.469429:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3590 00000100:00100000:0.0:1746065079.469437:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+286:2007:x1830881261398016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.469447:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.469452:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 286 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.469463:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 286 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.469481:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff8800b7e52500) 00010000:00010000:0.0:1746065079.469485:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.469492:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.469502:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.469516:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.469549:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+286:2007:x1830881261398016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.469554:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3590 00010000:00010000:3.0:1746065079.469741:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1461fab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7a4 expref: 285 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.469756:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262627712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.469771:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.469790:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.469794:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.469812:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 0 00000004:00080000:3.0:1746065079.469941:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x35d:0x0], index 1: 0 00000004:00080000:3.0:1746065079.469945:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x35c:0x0], index 0: 0 00000004:00080000:3.0:1746065079.469948:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x35d:0x0], index 0: 0 00000004:00080000:3.0:1746065079.469951:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x35e:0x0], index 1: 0 00010000:00010000:3.0:1746065079.470020:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470026:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470035:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470040:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.470043:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470048:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470055:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff8800b7e52500) 00010000:00010000:3.0:1746065079.470057:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.470060:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470064:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1461fc0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.470099:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1461fb9 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ab expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.470106:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1461fb9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ab expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.470117:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7200, rc 0) 00000100:00100000:3.0:1746065079.470151:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27891:x1830881261397632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4152us (5700us total) trans 4294975474 rc 301/301 00000100:00100000:3.0:1746065079.470157:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12106 00000100:00100000:0.0:1746065079.472400:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.472491:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261398272 00000100:00100000:3.0:1746065079.472497:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261398272 00000100:00100000:3.0:1746065079.472529:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4168 00000100:00100000:3.0:1746065079.472535:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27891:x1830881261398272:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.472748:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27891:x1830881261398272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 212us (355us total) trans 4294975475 rc 0/0 00000100:00100000:3.0:1746065079.472754:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4168 00000100:00100000:0.0:1746065079.475452:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.475624:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261398528 00000100:00100000:2.0:1746065079.475632:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261398528 00000100:00100000:2.0:1746065079.475673:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4169 00000100:00100000:2.0:1746065079.475679:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27891:x1830881261398528:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.475856:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27891:x1830881261398528:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 176us (408us total) trans 4294975476 rc 0/0 00000100:00100000:2.0:1746065079.475862:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4169 00000100:00100000:1.0:1746065079.476638:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.476846:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261398656 00000100:00100000:3.0:1746065079.476851:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261398656 00000100:00100000:3.0:1746065079.476878:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12108 00000100:00100000:3.0:1746065079.476883:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27892:x1830881261398656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.476894:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.476912:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461fe3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7b9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.476972:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461fea lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.476983:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461fea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.476993:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461fea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.477011:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 0 00000004:00200000:3.0:1746065079.477015:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.477024:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461fea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.477040:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1461fe3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7b9 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.477056:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461fea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7b9 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.477061:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065079.477064:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.477066:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6600, rc 0) 00000100:00100000:3.0:1746065079.477090:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27892:x1830881261398656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 207us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.477094:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12108 00000100:00100000:0.0:1746065079.480067:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.480137:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261398912 00000100:00100000:2.0:1746065079.480144:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261398912 00000100:00100000:0.0:1746065079.480416:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.480912:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12109 00000100:00100000:2.0:1746065079.481031:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261398912:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.481050:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.481069:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461ff1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7c0 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.481093:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261399040 00000100:00100000:1.0:1746065079.481097:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261399040 00000100:00100000:1.0:1746065079.481131:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8516 00000100:00100000:1.0:1746065079.481135:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881261399040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.481143:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.481152:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7c7 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065079.481169:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.481177:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065079.481180:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.481182:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.481187:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.481188:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.481196:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.481198:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.481204:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065079.481206:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01400, rc 0) 00010000:00010000:2.0:1746065079.481209:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481213:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065079.481243:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261399040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 108us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.481249:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8516 00010000:00010000:2.0:1746065079.481250:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146200d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.481258:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146200d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481263:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146200d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065079.481270:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 0 00010000:00010000:2.0:1746065079.481326:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481331:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481336:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481340:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481345:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.481349:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481354:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481362:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b7e52500) 00010000:00010000:2.0:1746065079.481364:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.481367:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481372:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1461fff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481384:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481389:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481393:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481397:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6ce00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.481399:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481403:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481407:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065079.481409:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.481411:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481415:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6ce00/0xad6b7ddc1462006 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.481440:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1461ff1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c0 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.481450:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146200d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c0 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.481456:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:2.0:1746065079.481458:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.481460:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:2.0:1746065079.481491:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261398912:12345-192.168.202.27@tcp:101:bash.0 Request processed in 465us (1432us total) trans 4294975477 rc 0/0 00000100:00100000:2.0:1746065079.481496:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12109 00000100:00100000:0.0:1746065079.483456:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.483527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.483725:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261399296 00000100:00100000:3.0:1746065079.483732:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261399296 00000100:00100000:3.0:1746065079.483767:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12110 00000100:00100000:3.0:1746065079.483793:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261399296:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.483811:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.483825:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc146201b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7d5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.483849:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462022 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.483859:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462022 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.483868:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462022 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.483943:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc146201b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7d5 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.483959:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462022 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7d5 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.483965:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065079.483967:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065079.483969:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7200, rc 0) 00000100:00100000:3.0:1746065079.484001:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261399296:12345-192.168.202.27@tcp:101:bash.0 Request processed in 229us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.484006:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12110 00000100:00100000:2.0:1746065079.484180:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261399168 00000100:00100000:2.0:1746065079.484184:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261399168 00000100:00100000:2.0:1746065079.484213:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8517 00000100:00100000:2.0:1746065079.484218:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261399168:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.484224:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.484234:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7ce expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.484250:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.484259:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.484261:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.484265:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.484274:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.484280:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d600, rc 0) 00000100:00100000:2.0:1746065079.484297:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261399168:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 79us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.484301:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8517 00000100:00100000:0.0:1746065079.485284:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.485617:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261399424 00000100:00100000:1.0:1746065079.485621:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261399424 00000100:00100000:1.0:1746065079.485794:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 551 00000100:00100000:1.0:1746065079.485800:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+290:2007:x1830881261399424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.485809:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.485823:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146200d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c0 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.486048:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.486052:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.486082:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+289:2007:x1830881261399424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 282us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.486088:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 551 00000100:00100000:3.0:1746065079.486179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.486457:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261399680 00000100:00100000:1.0:1746065079.486461:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261399680 00000100:00100000:1.0:1746065079.486482:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12111 00000100:00100000:1.0:1746065079.486487:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261399680:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065079.486516:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.486527:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6600/0xad6b7ddc1461fea lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7b9 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.486536:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.486538:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.486686:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.486696:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.486704:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:1.0:1746065079.486738:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975478 00000004:00010000:1.0:1746065079.486756:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955cc000 reply state ffff88012ec8a000 transno 4294975479 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065079.487295:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065079.487590:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.487595:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.487597:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065079.487599:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065079.487660:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261399680:12345-192.168.202.27@tcp:36:bash.0 Request processed in 1172us (1481us total) trans 4294975479 rc 0/0 00000100:00100000:1.0:1746065079.487666:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12111 00000020:00080000:1.0:1746065079.487669:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065079.488047:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261399808 00000100:00100000:1.0:1746065079.488051:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261399808 00000100:00100000:1.0:1746065079.488140:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12112 00000100:00100000:1.0:1746065079.488145:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27892:x1830881261399808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.488157:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.488166:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1462037 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7dc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.488192:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1462037 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7dc expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.488200:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1462037 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7dc expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.488212:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.488215:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.488217:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00000100:00100000:1.0:1746065079.488806:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27892:x1830881261399808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 659us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.488811:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12112 00000100:00100000:0.0:1746065079.491067:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.491161:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261400064 00000100:00100000:3.0:1746065079.491168:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261400064 00000100:00100000:0.0:1746065079.491172:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.491221:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261400192 00000100:00100000:1.0:1746065079.491227:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261400192 00000100:00100000:1.0:1746065079.491367:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12113 00000100:00100000:1.0:1746065079.491375:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261400192:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.491397:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.491413:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc146203e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7e3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.491457:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc146203e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7e3 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.491468:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc146203e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7e3 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.491480:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.491483:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.491485:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3da00, rc 0) 00000100:00100000:3.0:1746065079.491703:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4170 00000100:00100000:3.0:1746065079.491709:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27892:x1830881261400064:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065079.492160:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261400192:12345-192.168.202.27@tcp:101:bash.0 Request processed in 785us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.492166:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12113 00000100:00100000:3.0:1746065079.492244:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27892:x1830881261400064:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 534us (1182us total) trans 4294975480 rc 0/0 00000100:00100000:3.0:1746065079.492249:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4170 00000100:00100000:0.0:1746065079.493930:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.494012:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261400448 00000100:00100000:1.0:1746065079.494018:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261400448 00000100:00100000:1.0:1746065079.494077:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12114 00000100:00100000:1.0:1746065079.494084:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261400448:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.494100:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.494102:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746065079.494122:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3da00/0xad6b7ddc146203e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7e3 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.494137:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3de00/0xad6b7ddc1462037 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7dc expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.494145:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.494148:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.494155:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1462045 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7ea expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.494188:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146204c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.494198:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146204c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.494206:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146204c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:1.0:1746065079.494544:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2401, 88 off198912 00000004:00080000:1.0:1746065079.494550:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675512775690ns, next at 675481510748ns, rc = 0 00000100:00100000:0.0:1746065079.494921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000040:00080000:1.0:1746065079.495004:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2397, 88 off198480 00000004:00080000:1.0:1746065079.495009:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675513234906ns, next at 675481534386ns, rc = 0 00000040:00080000:1.0:1746065079.495020:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2398, 88 off198568 00000004:00080000:1.0:1746065079.495022:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675513248858ns, next at 675481534386ns, rc = 0 00000040:00080000:1.0:1746065079.495030:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2402, 88 off199000 00000004:00080000:1.0:1746065079.495033:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675513259220ns, next at 675481510748ns, rc = 0 00000100:00100000:3.0:1746065079.495118:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261400704 00000100:00100000:3.0:1746065079.495122:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261400704 00000100:00100000:3.0:1746065079.495713:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12115 00000100:00100000:3.0:1746065079.495721:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27892:x1830881261400704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.495731:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.495742:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1462053 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7f1 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.495824:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.495832:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.495839:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.495847:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.495853:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.495858:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.495915:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.495921:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.495927:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065079.495933:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 2 00010000:00010000:0.0:1746065079.502169:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502182:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502188:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502193:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.502198:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502203:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502217:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:0.0:1746065079.502219:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065079.502222:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502227:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538a00/0xad6b7ddc1462068 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502258:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502262:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502267:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502271:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502275:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.502277:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502281:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502286:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:0.0:1746065079.502288:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.502291:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502300:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146205a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502307:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502312:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502316:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502320:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.502322:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502326:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502331:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:0.0:1746065079.502333:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.502335:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502339:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1462061 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.502384:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1462053 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7f1 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.502391:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1462053 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7f1 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.502403:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:0.0:1746065079.502457:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27892:x1830881261400704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6736us (7535us total) trans 4294975482 rc 301/301 00000100:00100000:0.0:1746065079.502464:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12115 00000001:00080000:2.0:1746065079.506548:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975481 is committed 00000004:00080000:2.0:1746065079.506567:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1620 committed 00000004:00080000:2.0:1746065079.506575:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1610 committed 00010000:00010000:3.0:1746065079.506578:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000004:00080000:2.0:1746065079.506582:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1609 committed 00000004:00080000:2.0:1746065079.506584:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1619 committed 00010000:00010000:3.0:1746065079.506588:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506598:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506603:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a174a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.506607:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506615:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506630:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065079.506633:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.506637:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506645:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1461f11 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506663:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506667:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506672:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506675:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.506677:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506681:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506687:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065079.506689:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.506690:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506694:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1461fa4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.506706:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506711:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506715:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.506718:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.506720:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.506969:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146204c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ea expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.506978:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.506980:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1746065079.506987:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262627968:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.506991:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1462045 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ea expref: 277 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065079.507006:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146204c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ea expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.507027:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262628096:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.507043:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.507147:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262627840:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065079.507256:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.507264:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065079.507266:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.507269:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.507274:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462030 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.507540:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262627968 00000100:00100000:1.0:1746065079.507545:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262627968 00000100:00100000:1.0:1746065079.507584:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8518 00000100:00100000:1.0:1746065079.507590:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+56:3761:x1830881262627968:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065079.507613:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:860 count 1 00002000:00010000:1.0:1746065079.507639:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.507644:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.507655:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.507657:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.507660:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.507670:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.507683:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.507689:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.507700:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.508397:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.508404:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+57:3761:x1830881262627968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 813us (1361us total) trans 17179872516 rc 0/0 00000100:00100000:1.0:1746065079.508411:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8518 00000100:00100000:1.0:1746065079.508428:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262627840 00000100:00100000:1.0:1746065079.508430:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262627840 00000100:00100000:2.0:1746065079.508441:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262628352:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.508445:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8519 00000100:00100000:1.0:1746065079.508449:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+57:3760:x1830881262627840:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.508461:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1746065079.508461:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:859 count 1 00010000:00010000:1.0:1746065079.508471:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.508475:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065079.508479:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262628224:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065079.508483:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508489:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.508490:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.508492:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.508495:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065079.508512:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.508520:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262628352 00000100:00100000:2.0:1746065079.508522:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262628352 00010000:00010000:1.0:1746065079.508522:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 36 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.508530:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262628608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.508537:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262628224 00000100:00100000:2.0:1746065079.508538:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262628224 00000100:00100000:2.0:1746065079.508548:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8520 00000100:00100000:2.0:1746065079.508552:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3760:x1830881262628352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.508575:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:858 count 1 00010000:00010000:2.0:1746065079.508587:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.508587:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065079.508597:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508597:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065079.508601:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.508603:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.508603:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.508604:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508609:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.508613:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508619:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.508623:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508629:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.508630:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 21 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.508635:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc1462076 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.508639:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262628736:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.508646:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.508647:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.508648:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065079.508657:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.508659:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8521 00000100:00100000:1.0:1746065079.508664:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+58:3760:x1830881262628224:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065079.508745:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x35e:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:0.0:1746065079.508745:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ea00/2, rc 0, transno 17179872516 00002000:00010000:1.0:1746065079.508748:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x35e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.508750:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x35e:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065079.508751:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262627968:0@lo:6:osp-syn-1-1.0 00002000:00010000:1.0:1746065079.508752:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x35e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.508753:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x35e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065079.508760:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262628480:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.508794:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.508802:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+59:3760:x1830881262628224:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (305us total) trans 17179872517 rc 0/0 00000100:00100000:1.0:1746065079.508808:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8521 00000100:00100000:1.0:1746065079.508816:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262628480 00000100:00100000:1.0:1746065079.508818:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262628480 00000100:00100000:1.0:1746065079.508830:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8522 00000100:00100000:1.0:1746065079.508833:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3761:x1830881262628480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065079.508843:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:859 count 1 00002000:00010000:1.0:1746065079.508856:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.508859:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508865:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.508866:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.508868:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508875:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508881:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508889:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.508897:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065079.508913:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.508935:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261400832 00000100:00100000:0.0:1746065079.508938:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261400832 00000100:00100000:0.0:1746065079.508964:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12116 00000100:00100000:0.0:1746065079.508969:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27892:x1830881261400832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.508979:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.508989:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1462092 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7f8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.509052:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1462099 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.509061:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1462099 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.509067:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1462099 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065079.509088:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 2 00000004:00200000:0.0:1746065079.509092:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065079.509105:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1462099 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.509121:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45600/0xad6b7ddc1462092 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7f8 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.509135:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1462099 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7f8 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.509141:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:0.0:1746065079.509143:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.509145:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:0.0:1746065079.509172:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27892:x1830881261400832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 204us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.509177:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12116 00000100:00100000:2.0:1746065079.509682:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262628992:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.509703:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.509737:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262628992 00000100:00100000:2.0:1746065079.509740:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262628992 00000100:00100000:2.0:1746065079.509755:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8523 00000100:00100000:2.0:1746065079.509760:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3759:x1830881262628992:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065079.509829:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.509831:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.509833:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.509835:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.509837:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.509856:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+27:3759:x1830881262628992:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (152us total) trans 21474839793 rc 0/0 00000100:00100000:2.0:1746065079.509861:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8523 00000004:00080000:3.0:1746065079.509873:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955cca80/2, rc 0, transno 21474839793 00000100:00100000:3.0:1746065079.509878:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262628992:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065079.509879:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d500/2, rc 0, transno 17179872517 00000100:00100000:2.0:1746065079.509882:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262628224:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.510479:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3761:x1830881262628480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1641us (1680us total) trans 21474839792 rc 0/0 00000100:00100000:1.0:1746065079.510485:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8522 00010000:00010000:1.0:1746065079.510506:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065079.510513:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.510519:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2d200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.510522:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.510528:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.510541:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.510548:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc146208b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.510570:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.510571:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.510573:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065079.510585:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.510610:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262628864:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.510631:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065079.511301:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955ce680/2, rc 0, transno 21474839792 00000100:00100000:0.0:1746065079.511307:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262628480:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.511698:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262628096 00000100:00100000:2.0:1746065079.511704:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262628096 00010000:00010000:1.0:1746065079.511744:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.511747:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065079.511750:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:1.0:1746065079.511801:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261400448:12345-192.168.202.27@tcp:101:bash.0 Request processed in 17716us (17873us total) trans 4294975481 rc 0/0 00000100:00100000:1.0:1746065079.511807:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12114 00000100:00100000:3.0:1746065079.511867:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262628864 00000100:00100000:3.0:1746065079.511871:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262628864 00000100:00100000:2.0:1746065079.511885:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8524 00000100:00100000:3.0:1746065079.511889:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8525 00000100:00100000:2.0:1746065079.511891:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+59:3762:x1830881262628096:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.511893:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+26:3762:x1830881262628864:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.511988:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+27:3762:x1830881262628864:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (1354us total) trans 21474839794 rc 0/0 00000100:00100000:2.0:1746065079.511988:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+60:3762:x1830881262628096:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (1402us total) trans 17179872518 rc 0/0 00000100:00100000:2.0:1746065079.511993:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8524 00000100:00100000:3.0:1746065079.512026:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8525 00000004:00080000:1.0:1746065079.512138:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955ce300/2, rc 0, transno 21474839794 00000100:00100000:1.0:1746065079.512142:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262628864:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065079.512150:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3df80/2, rc 0, transno 17179872518 00000100:00100000:1.0:1746065079.512153:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262628096:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.512898:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.512918:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262628736:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.512926:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065079.512933:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.512941:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261401216 00000100:00100000:0.0:1746065079.512944:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261401216 00010000:00010000:0.0:1746065079.512968:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 37 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.512982:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261401088 00000100:00100000:0.0:1746065079.512986:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261401088 00010000:00010000:0.0:1746065079.512994:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 22 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.513006:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3591 00000100:00100000:0.0:1746065079.513011:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261401216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.513019:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.513023:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 37 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.513024:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3592 00000100:00100000:3.0:1746065079.513029:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261401088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.513033:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 37 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.513035:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.513038:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 22 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.513045:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 22 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.513052:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.513054:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.513056:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc1461ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c75e expref: 22 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.513059:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513064:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.513066:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.513066:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513069:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513074:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.513079:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.513083:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.513098:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261401216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.513154:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261401088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 123us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.513160:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3592 00010000:00010000:3.0:1746065079.513181:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513187:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513195:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513202:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513215:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065079.513261:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1461eee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c76c expref: 37 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.513270:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262628608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.513283:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.513289:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.513293:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.513303:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.513308:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.513316:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065079.513357:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+27:3760:x1830881262628352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4804us (4895us total) trans 21474839795 rc 0/0 00000100:00100000:3.0:1746065079.513363:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8520 00010000:00010000:3.0:1746065079.513375:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065079.513380:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513386:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6dc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.513389:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513395:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513404:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.513406:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+60:3760:x1830881262627840:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4956us (5011us total) trans 17179872519 rc 0/0 00010000:00010000:3.0:1746065079.513409:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1462084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.513411:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8519 00010000:00010000:3.0:1746065079.513423:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.513425:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513429:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.513431:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513437:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513445:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513454:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc146207d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.513461:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.513462:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.513463:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065079.513526:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800955cc380/2, rc 0, transno 21474839795 00000100:00100000:2.0:1746065079.513530:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262628352:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065079.513537:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3c000/2, rc 0, transno 17179872519 00000100:00100000:2.0:1746065079.513540:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262627840:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.513939:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3591 00000100:00100000:0.0:1746065079.513996:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.514170:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261400960 00000100:00100000:1.0:1746065079.514174:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261400960 00000100:00100000:1.0:1746065079.514191:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8526 00000100:00100000:1.0:1746065079.514196:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881261400960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.514207:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.514218:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c7ff expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065079.514232:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065079.514365:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.514556:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.514566:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.514572:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065079.514584:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065079.514597:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d600, rc 0) 00000100:00100000:1.0:1746065079.514937:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261400960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 739us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.514943:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8526 00000100:00100000:2.0:1746065079.515113:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.515199:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261401344 00000100:00100000:0.0:1746065079.515203:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261401344 00000100:00100000:0.0:1746065079.515229:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8527 00000100:00100000:0.0:1746065079.515234:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261401344:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065079.515241:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.515248:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c806 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.515262:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.515383:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.515384:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.515388:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.515415:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.515425:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746065079.515436:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262629120:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.515605:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.517733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.517850:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261401600 00000100:00100000:3.0:1746065079.517855:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261401600 00000100:00100000:0.0:1746065079.517890:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262629120:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.517900:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4171 00000100:00100000:3.0:1746065079.517906:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+276:27892:x1830881261401600:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:0.0:1746065079.517909:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.517925:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44200, rc 0) 00000100:00100000:0.0:1746065079.517955:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:26180:x1830881261401344:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2721us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.517961:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8527 00000100:00100000:3.0:1746065079.518035:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27892:x1830881261401600:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 129us (308us total) trans 4294975483 rc 0/0 00000100:00100000:3.0:1746065079.518042:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4171 00000100:00100000:0.0:1746065079.519278:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.519450:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261401728 00000100:00100000:2.0:1746065079.519455:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261401728 00010000:00010000:2.0:1746065079.519478:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.519511:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3593 00000100:00100000:2.0:1746065079.519517:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261401728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.519526:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.519531:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.519541:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.519571:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ff expref: 38 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.519594:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.519596:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.519602:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.519609:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.519635:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.519646:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881262629248:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065079.519694:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.520946:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.521023:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881262629248:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065079.521036:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.521061:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261401728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1544us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.521069:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3593 00000100:00100000:1.0:1746065079.521286:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261401984 00000100:00100000:1.0:1746065079.521290:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261401984 00000100:00100000:1.0:1746065079.521322:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12117 00000100:00100000:1.0:1746065079.521328:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27892:x1830881261401984:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.521344:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065079.521600:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065079.521657:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620ae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c80d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.521728:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.521739:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.521747:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.521757:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.521762:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.521767:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065079.521857:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261402112 00000100:00100000:2.0:1746065079.521861:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261402112 00000100:00100000:2.0:1746065079.521890:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8528 00000100:00100000:2.0:1746065079.521898:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:26180:x1830881261402112:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.521906:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.521915:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c814 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.521932:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.521942:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.521944:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.521948:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.522019:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.522027:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d000, rc 0) 00000100:00100000:2.0:1746065079.522049:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:26180:x1830881261402112:12345-192.168.202.27@tcp:101:bash.0 Request processed in 150us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.522054:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8528 00010000:00010000:1.0:1746065079.522623:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14620ca lrc: 3/1,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.522633:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14620ca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522640:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14620ca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065079.522648:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 2 00010000:00010000:1.0:1746065079.522705:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522710:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522715:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522720:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522725:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2d000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.522728:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522734:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522742:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c600) 00010000:00010000:1.0:1746065079.522744:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.522747:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522755:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc14620b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522764:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522768:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522791:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522795:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.522797:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522801:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522806:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c900) 00010000:00010000:1.0:1746065079.522808:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.522810:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522814:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc14620bc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.522843:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c80d expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.522853:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14620ca lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c80d expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.522862:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.522864:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065079.522866:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065079.522899:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27892:x1830881261401984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1572us (1957us total) trans 4294975484 rc 0/0 00000100:00100000:1.0:1746065079.522905:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12117 00000100:00100000:0.0:1746065079.524995:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.525047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.525065:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261402240 00000100:00100000:2.0:1746065079.525072:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261402240 00002000:00010000:2.0:1746065079.525104:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/861 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.525108:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef480 with x1830881261402240 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.525118:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef480. 00000100:00100000:2.0:1746065079.525354:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261402368 00000100:00100000:2.0:1746065079.525357:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261402368 00000100:00100000:1.0:1746065079.525359:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1259 00000100:00100000:1.0:1746065079.525366:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261402240:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.525368:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/860 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.525370:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced180 with x1830881261402368 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.525375:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aced180. 00000100:00100000:2.0:1746065079.525515:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1260 00000100:00100000:2.0:1746065079.525521:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261402368:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.525618:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.525618:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x35d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.525621:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35c:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.525621:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x35d:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.525623:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.525623:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x35d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.525624:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35c:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.525624:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x35d:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:2.0:1746065079.525626:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35c:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1746065079.525626:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x35d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.525965:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261402240:12345-192.168.202.27@tcp:10:bash.0 Request processed in 598us (977us total) trans 17179872520 rc 0/0 00000100:00100000:1.0:1746065079.525971:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1259 00002000:00010000:1.0:1746065079.525974:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/861 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.525976:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef480 with x1830881261402240 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.525981:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef480. 00000100:00100000:2.0:1746065079.527394:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261402368:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1868us (2343us total) trans 21474839796 rc 0/0 00000100:00100000:2.0:1746065079.527404:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1260 00002000:00010000:2.0:1746065079.527408:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/860 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.527410:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced180 with x1830881261402368 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.527415:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aced180. 00000100:00100000:0.0:1746065079.527450:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.527497:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.527757:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261402752 00000100:00100000:3.0:1746065079.527762:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261402752 00000100:00100000:3.0:1746065079.527819:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 552 00000100:00100000:3.0:1746065079.527825:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+279:2006:x1830881261402752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.527839:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.527866:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14620ca lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c80d expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.527876:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261402624 00000100:00100000:2.0:1746065079.527880:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261402624 00010000:00010000:3.0:1746065079.527886:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065079.527889:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.527901:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4172 00000100:00100000:2.0:1746065079.527905:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27892:x1830881261402624:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.527910:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+279:2006:x1830881261402752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.527914:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 552 00000100:00100000:2.0:1746065079.529495:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27892:x1830881261402624:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1582us (2038us total) trans 4294975485 rc 0/0 00000100:00100000:2.0:1746065079.529504:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4172 00000100:00100000:3.0:1746065079.533764:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065079.533806:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262629376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065079.533862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.538808:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262629376 00000100:00100000:0.0:1746065079.538817:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262629376 00000100:00100000:0.0:1746065079.538855:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1746065079.538861:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262629376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065079.538891:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445736448 avail 1316274176 00000100:00100000:0.0:1746065079.538982:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262629376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (5119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.538989:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1746065079.539077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.541029:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261402880 00000100:00100000:2.0:1746065079.541036:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261402880 00000100:00100000:2.0:1746065079.541069:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4173 00000100:00100000:2.0:1746065079.541075:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27892:x1830881261402880:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065079.541199:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27892:x1830881261402880:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 124us (2124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.541205:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4173 00000100:00100000:0.0:1746065079.541431:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262629376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065079.542392:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.542453:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261403136 00000100:00100000:1.0:1746065079.542457:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261403136 00000100:00100000:1.0:1746065079.542493:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12118 00000100:00100000:1.0:1746065079.542498:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27893:x1830881261403136:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065079.542546:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065079.542576:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146204c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ea expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.542592:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44e00/0xad6b7ddc1462099 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7f8 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.542602:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462022 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x338:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7d5 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.542610:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065079.542617:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.542632:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.542642:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542650:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542658:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.542663:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542667:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542720:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.542729:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542734:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:1.0:1746065079.542901:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x338:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1746065079.542947:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542953:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542958:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542963:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.542966:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542971:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542978:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88012d56c700) 00010000:00010000:1.0:1746065079.542980:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065079.542982:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542987:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc14620e6 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.542999:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543007:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543012:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543016:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543019:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.543021:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543026:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543030:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065079.543032:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.543033:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543037:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc14620d8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065079.543044:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009acefb80 reply state ffff88009fadd000 transno 4294975486 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543051:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.543055:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:1.0:1746065079.543056:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065079.543058:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065079.543096:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27893:x1830881261403136:12345-192.168.202.27@tcp:36:rm.0 Request processed in 597us (705us total) trans 4294975486 rc 0/0 00000100:00100000:1.0:1746065079.543102:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12118 00000100:00100000:0.0:1746065079.546963:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.549288:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261403392 00000100:00100000:2.0:1746065079.549300:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261403392 00000100:00100000:2.0:1746065079.549347:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12119 00000100:00100000:2.0:1746065079.549353:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27892:x1830881261403392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.549373:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.549392:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc14620ed lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c81b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.549474:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620f4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.549485:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.549494:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065079.549503:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x338:0x0]: returning size 2 00010000:00010000:2.0:1746065079.549585:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc14620ed lrc: 0/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c81b expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.549598:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620f4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c81b expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.549605:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff880097b72400) 00010000:00010000:2.0:1746065079.549607:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065079.549609:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2cc00, rc 0) 00000100:00100000:2.0:1746065079.549651:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27892:x1830881261403392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 298us (2696us total) trans 4294975487 rc 0/0 00000100:00100000:2.0:1746065079.549656:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12119 00000100:00100000:0.0:1746065079.553941:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.556349:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261403648 00000100:00100000:2.0:1746065079.556359:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261403648 00000100:00100000:2.0:1746065079.556409:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4174 00000100:00100000:2.0:1746065079.556416:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27892:x1830881261403648:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065079.556469:0:7207:0:(mdt_open.c:2285:mdt_close_handle_layouts()) ### [0x240000403:0x338:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620f4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c81b expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.556506:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:2.0:1746065079.556515:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556523:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000004:00020000:2.0:1746065079.556632:0:7207:0:(lod_lov.c:1538:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000403:0x338:0x0]: rc = -1 00010000:00010000:2.0:1746065079.556652:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556658:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556663:0:7207:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556668:0:7207:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.556671:0:7207:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556676:0:7207:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556684:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff880097b72400) 00010000:00010000:2.0:1746065079.556686:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1746065079.556689:0:7207:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556693:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c600/0xad6b7ddc1462102 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x338:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065079.556700:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff880097b72400) 00010000:00010000:2.0:1746065079.556702:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065079.556705:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc14620f4 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x338:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c81b expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.556830:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27892:x1830881261403648:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 413us (2895us total) trans 4294975488 rc -1/-1 00000100:00100000:2.0:1746065079.556837:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4174 00000100:00100000:0.0:1746065079.561317:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.561577:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261403776 00000100:00100000:1.0:1746065079.561584:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261403776 00000100:00100000:1.0:1746065079.561631:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12120 00000100:00100000:1.0:1746065079.561638:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27894:x1830881261403776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.561652:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.561667:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2000/0xad6b7ddc1462109 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c822 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.561717:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.561728:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561737:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561744:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.561749:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561754:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561808:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561814:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561820:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561826:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561830:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.561834:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561838:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561846:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:1.0:1746065079.561849:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.561851:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561856:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462110 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561866:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561870:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561874:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561879:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.561881:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561889:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561894:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:1.0:1746065079.561895:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.561897:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561901:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462117 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.561920:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2000/0xad6b7ddc1462109 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c822 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.561926:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2000/0xad6b7ddc1462109 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c822 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.561935:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2000, rc 0) 00000100:00100000:1.0:1746065079.561973:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27894:x1830881261403776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 336us (664us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065079.561978:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12120 00000100:00100000:0.0:1746065079.562330:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.562908:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261403904 00000100:00100000:3.0:1746065079.562913:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261403904 00000100:00100000:3.0:1746065079.562937:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12121 00000100:00100000:3.0:1746065079.562942:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27892:x1830881261403904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.562954:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.562964:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538200/0xad6b7ddc146211e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c829 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.562993:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538200/0xad6b7ddc146211e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c829 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.563001:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538200/0xad6b7ddc146211e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x338:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c829 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.563013:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:3.0:1746065079.563015:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.563016:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538200, rc 0) 00000100:00100000:3.0:1746065079.563036:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27892:x1830881261403904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 94us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.563041:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12121 00000100:00100000:0.0:1746065079.564966:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881262629504:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565014:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565050:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3761:1830881262630016:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565067:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565080:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262630528:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565098:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565114:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746065079.565119:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262629632:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565136:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565147:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3761:1830881262630144:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565159:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565167:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881262630656:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565179:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565194:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881262629760:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565208:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565217:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881262630272:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565237:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065079.565241:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881262629888:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565259:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262630400:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.565287:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630016 00000100:00100000:0.0:1746065079.565292:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630016 00000100:00100000:0.0:1746065079.565318:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630144 00000100:00100000:0.0:1746065079.565320:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630144 00000100:00100000:0.0:1746065079.565330:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630656 00000100:00100000:0.0:1746065079.565331:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630656 00000100:00100000:0.0:1746065079.565340:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262629760 00000100:00100000:0.0:1746065079.565341:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262629760 00000100:00100000:0.0:1746065079.565348:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630272 00000100:00100000:0.0:1746065079.565349:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630272 00000100:00100000:0.0:1746065079.565357:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262629888 00000100:00100000:0.0:1746065079.565358:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262629888 00000100:00100000:0.0:1746065079.565366:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1746065079.565372:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3761:x1830881262630016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565400:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3761:x1830881262630016:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.565404:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1746065079.565414:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1746065079.565418:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3761:x1830881262630144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565433:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3761:x1830881262630144:12345-0@lo:400:kworker.0 Request processed in 14us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.565437:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1746065079.565443:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1746065079.565447:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3761:x1830881262630656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565460:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3761:x1830881262630656:12345-0@lo:400:kworker.0 Request processed in 13us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.565464:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1746065079.565470:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1746065079.565473:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881262629760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565487:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881262629760:12345-0@lo:400:kworker.0 Request processed in 14us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.565495:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1746065079.565501:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1746065079.565504:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881262630272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565519:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881262630272:12345-0@lo:400:kworker.0 Request processed in 14us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.565523:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1746065079.565528:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1746065079.565532:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881262629888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565545:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881262629888:12345-0@lo:400:kworker.0 Request processed in 12us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.565549:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00080000:0.0:1746065079.565569:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746065079.565572:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065079.565589:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881262629888:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565597:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881262629760:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565603:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881262630272:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565621:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3761:1830881262630144:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565628:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881262630656:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.565635:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3761:1830881262630016:0@lo:400:kworker.0 00000100:00100000:3.0:1746065079.565740:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630528 00000100:00100000:3.0:1746065079.565744:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630528 00000100:00100000:3.0:1746065079.565765:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630400 00000100:00100000:3.0:1746065079.565766:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630400 00000100:00100000:3.0:1746065079.565795:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1746065079.565799:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262630528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065079.565825:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262630528:12345-0@lo:400:kworker.0 Request processed in 26us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.565829:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1746065079.565837:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1746065079.565840:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262630400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065079.565856:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262630400:12345-0@lo:400:kworker.0 Request processed in 15us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.565860:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1746065079.565926:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262629504 00000100:00100000:2.0:1746065079.565929:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262629504 00000100:00100000:2.0:1746065079.565947:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1746065079.565950:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881262629504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065079.565972:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881262629504:12345-0@lo:400:kworker.0 Request processed in 22us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.565976:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1746065079.565994:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262629632 00000100:00100000:2.0:1746065079.565996:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262629632 00000100:00100000:2.0:1746065079.566009:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1746065079.566013:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262629632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065079.566029:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881262629632:12345-0@lo:400:kworker.0 Request processed in 17us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.566034:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1746065079.566085:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262629632:0@lo:400:kworker.0 00000100:00100000:1.0:1746065079.566092:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881262629504:0@lo:400:kworker.0 00000100:00100000:1.0:1746065079.566100:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262630528:0@lo:400:kworker.0 00000100:00080000:0.0:1746065079.567098:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065079.567103:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065079.567126:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262630400:0@lo:400:kworker.0 00000100:00100000:0.0:1746065079.568934:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.569387:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.569587:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261404032 00000100:00100000:3.0:1746065079.569593:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261404032 00000100:00100000:1.0:1746065079.570549:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261404288 00000100:00100000:1.0:1746065079.570553:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261404288 00000100:00100000:3.0:1746065079.571188:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12122 00000100:00100000:3.0:1746065079.571196:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27894:x1830881261404032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.571212:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.571229:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462125 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c830 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.571279:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.571289:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571298:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571305:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.571311:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571316:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571348:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571354:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571359:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571364:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571368:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.571372:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571377:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571385:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.571388:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.571391:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.571396:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146212c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065079.572175:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4175 00000100:00100000:1.0:1746065079.572185:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27892:x1830881261404288:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065079.572353:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x338:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065079.572403:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2403, 64 off199064 00000004:00080000:1.0:1746065079.572408:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675590633925ns, next at 676590632635ns, rc = 0 00000040:00080000:1.0:1746065079.572424:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2399, 64 off198632 00000004:00080000:1.0:1746065079.572427:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675590653203ns, next at 676590652783ns, rc = 0 00000040:00080000:1.0:1746065079.572434:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2400, 64 off198696 00000040:00080000:1.0:1746065079.572440:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2404, 64 off199128 00010000:00010000:1.0:1746065079.572472:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x338:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065079.572480:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.572486:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.572492:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.572496:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.572501:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.572518:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065079.572672:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27892:x1830881261404288:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 488us (3285us total) trans 4294975489 rc 0/0 00000100:00100000:1.0:1746065079.572678:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4175 00010000:00010000:0.0:1746065079.572734:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065079.572739:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.572744:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065079.572747:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.572751:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.572759:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x338:0x0].0x0 (ffff88008ec47c00) 00010000:00010000:0.0:1746065079.572761:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065079.572763:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 1/0,0 mode: --/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.572767:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2e00/0xad6b7ddc146213a lrc: 0/0,0 mode: --/PW res: [0x240000403:0x338:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.572793:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.572794:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.572796:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.573256:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573263:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573268:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573272:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.573274:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573278:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573285:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065079.573287:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.573289:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573294:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462133 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.573321:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462125 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c830 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.573327:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462125 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c830 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.573336:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539600, rc 0) 00000100:00100000:3.0:1746065079.573357:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27894:x1830881261404032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2162us (4429us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.573362:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12122 00000100:00100000:0.0:1746065079.582852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.586712:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261404416 00000100:00100000:3.0:1746065079.586722:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261404416 00000100:00100000:3.0:1746065079.586789:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12123 00000100:00100000:3.0:1746065079.586796:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27894:x1830881261404416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.586815:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.586831:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462141 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c837 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.586876:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462148 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.586885:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462148 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.586894:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462148 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065079.586925:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065079.586929:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065079.586951:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462141 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c837 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.586977:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462148 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c837 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.586989:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.586992:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065079.586994:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539600, rc 0) 00000100:00100000:3.0:1746065079.587037:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27894:x1830881261404416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 242us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.587042:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12123 00000100:00100000:0.0:1746065079.597902:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.598078:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261404672 00000100:00100000:2.0:1746065079.598087:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261404672 00000100:00100000:2.0:1746065079.598138:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12124 00000100:00100000:2.0:1746065079.598145:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27895:x1830881261404672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.598163:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.598178:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc146214f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c83e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.598239:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.598249:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598258:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598266:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.598270:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598275:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598300:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598304:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598308:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598313:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598317:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.598321:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598326:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598334:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.598336:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.598339:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598343:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462156 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598365:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598369:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598373:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598376:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.598378:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598381:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598385:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065079.598387:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.598389:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598396:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146215d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.598414:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc146214f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c83e expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.598420:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc146214f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c83e expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.598426:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00400, rc 0) 00000100:00100000:2.0:1746065079.599703:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27895:x1830881261404672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1554us (1804us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.599711:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12124 00000100:00100000:0.0:1746065079.602767:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.603568:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261404928 00000100:00100000:2.0:1746065079.603577:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261404928 00000100:00100000:2.0:1746065079.603628:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12125 00000100:00100000:2.0:1746065079.603635:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27894:x1830881261404928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.603651:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.603654:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065079.603675:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc1462148 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c837 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.603699:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.603706:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.603716:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462164 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c845 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.603806:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.603816:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.603822:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.603830:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.603836:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.603840:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604126:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.604133:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604138:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065079.604146:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 0 00010000:00010000:2.0:1746065079.604164:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604169:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604174:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604179:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604184:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.604187:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604192:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604197:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065079.604199:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.604202:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604206:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146216b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065079.604212:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099ceb100 reply state ffff8800925ac000 transno 4294975490 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604219:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.604223:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:2.0:1746065079.604225:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.604226:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065079.604242:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462164 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.604252:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.604257:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065079.604259:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.604261:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2ca00, rc 0) 00000100:00100000:2.0:1746065079.605320:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27894:x1830881261404928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1683us (2557us total) trans 4294975490 rc 0/0 00000100:00100000:2.0:1746065079.605328:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12125 00000100:00100000:0.0:1746065079.608329:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.608550:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261405184 00000100:00100000:2.0:1746065079.608568:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261405184 00000100:00100000:2.0:1746065079.608940:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12126 00000100:00100000:2.0:1746065079.608948:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27894:x1830881261405184:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.608968:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.608985:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462187 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c84c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.609066:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.609076:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.609082:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.609105:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.609115:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 286 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.609125:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262630784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.609906:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.611951:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262630784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.611970:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065079.612296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.612604:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261405312 00000100:00100000:1.0:1746065079.612610:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261405312 00010000:00010000:1.0:1746065079.612635:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 287 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.612665:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3594 00000100:00100000:1.0:1746065079.612671:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+287:2004:x1830881261405312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.612680:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.612685:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 287 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.612694:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 287 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.612713:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1462179 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c845 expref: 287 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.612736:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:1.0:1746065079.612740:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.612747:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.612753:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.612765:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.612823:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+286:2004:x1830881261405312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 152us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.612829:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3594 00010000:00010000:2.0:1746065079.613008:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613015:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065079.613035:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 0 00000004:00080000:2.0:1746065079.613173:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x35e:0x0], index 0: 0 00000004:00080000:2.0:1746065079.613178:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x35f:0x0], index 1: 0 00000004:00080000:2.0:1746065079.613181:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x360:0x0], index 1: 0 00000004:00080000:2.0:1746065079.613184:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x35f:0x0], index 0: 0 00010000:00010000:2.0:1746065079.613269:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613276:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613280:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613284:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.613287:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613292:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613310:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065079.613312:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.613315:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613319:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc146218e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.613352:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462187 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c84c expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.613358:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462187 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c84c expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.613366:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00400, rc 0) 00000100:00100000:2.0:1746065079.613388:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27894:x1830881261405184:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4441us (5067us total) trans 4294975491 rc 301/301 00000100:00100000:2.0:1746065079.613394:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12126 00000100:00100000:0.0:1746065079.615188:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.615256:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261405568 00000100:00100000:2.0:1746065079.615261:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261405568 00000100:00100000:2.0:1746065079.615300:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4176 00000100:00100000:2.0:1746065079.615305:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27894:x1830881261405568:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.616186:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27894:x1830881261405568:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 878us (1000us total) trans 4294975492 rc 0/0 00000100:00100000:2.0:1746065079.616193:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4176 00000100:00100000:0.0:1746065079.617744:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.617884:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261405824 00000100:00100000:2.0:1746065079.617890:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261405824 00000100:00100000:2.0:1746065079.617928:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4177 00000100:00100000:2.0:1746065079.617934:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27894:x1830881261405824:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.618077:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27894:x1830881261405824:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 142us (337us total) trans 4294975493 rc 0/0 00000100:00100000:2.0:1746065079.618083:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4177 00000100:00100000:0.0:1746065079.618297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.618393:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261406080 00000100:00100000:3.0:1746065079.618397:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261406080 00000100:00100000:3.0:1746065079.618427:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12127 00000100:00100000:3.0:1746065079.618432:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27895:x1830881261406080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.618441:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.618455:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc146219c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c853 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.618501:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065079.618511:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618519:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618526:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065079.618532:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618537:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618607:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14621b1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065079.618613:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14621b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618618:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14621b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065079.618625:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 0 00010000:00010000:3.0:1746065079.618654:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618660:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618665:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618670:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618674:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.618677:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618682:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618690:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47600) 00010000:00010000:3.0:1746065079.618693:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.618696:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618704:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14621a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618715:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618719:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618723:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618727:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.618729:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618733:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618737:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065079.618739:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.618741:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618745:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539600/0xad6b7ddc14621aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.618763:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc146219c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c853 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.618799:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14621b1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c853 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.618809:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.618811:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.618813:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538600, rc 0) 00000100:00100000:3.0:1746065079.618841:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27895:x1830881261406080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 409us (545us total) trans 4294975494 rc 0/0 00000100:00100000:3.0:1746065079.618846:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12127 00000100:00100000:0.0:1746065079.622173:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.622456:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.622591:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261406336 00000100:00100000:1.0:1746065079.622598:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261406336 00000100:00100000:1.0:1746065079.622640:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12128 00000100:00100000:1.0:1746065079.622646:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261406336:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.622665:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.622680:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14621bf lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c861 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.622706:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14621c6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.622717:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14621c6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.622725:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14621c6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.622814:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14621bf lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c861 expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.622829:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14621c6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c861 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.622835:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.622837:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065079.622840:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:1.0:1746065079.622885:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261406336:12345-192.168.202.27@tcp:101:bash.0 Request processed in 239us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.622890:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12128 00000100:00100000:2.0:1746065079.623696:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261406208 00000100:00100000:2.0:1746065079.623702:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261406208 00000100:00100000:2.0:1746065079.623738:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8529 00000100:00100000:2.0:1746065079.623743:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261406208:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.623752:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.623764:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c85a expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.623794:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.623805:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.623807:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.623813:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.623823:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.623830:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6000, rc 0) 00000100:00100000:2.0:1746065079.623851:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261406208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 108us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.623856:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8529 00000100:00100000:0.0:1746065079.625194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.625695:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261406592 00000100:00100000:1.0:1746065079.625700:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261406592 00000100:00100000:1.0:1746065079.625734:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12129 00000100:00100000:1.0:1746065079.625740:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261406592:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065079.625787:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.625804:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14621b1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c853 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.625816:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.625819:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.625934:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.625943:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.625949:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:1.0:1746065079.625972:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975495 00000004:00010000:1.0:1746065079.625983:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091a93800 reply state ffff88009fade000 transno 4294975496 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.625990:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.625995:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.625997:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065079.625998:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065079.626046:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261406592:12345-192.168.202.27@tcp:36:bash.0 Request processed in 306us (856us total) trans 4294975496 rc 0/0 00000100:00100000:1.0:1746065079.626051:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12129 00000020:00080000:1.0:1746065079.626054:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065079.626982:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.627283:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261406720 00000100:00100000:3.0:1746065079.627288:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261406720 00000100:00100000:3.0:1746065079.627323:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12130 00000100:00100000:3.0:1746065079.627353:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27895:x1830881261406720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.627365:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.627375:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc14621db lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c868 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.627405:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc14621db lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c868 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.627414:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc14621db lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c868 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.627426:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.627428:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.627431:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30200, rc 0) 00000100:00100000:3.0:1746065079.627466:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27895:x1830881261406720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 138us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.627472:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12130 00000100:00100000:0.0:1746065079.629591:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.630857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.631328:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261406848 00000100:00100000:3.0:1746065079.631335:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261406848 00000100:00100000:3.0:1746065079.631363:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261407104 00000100:00100000:3.0:1746065079.631365:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261407104 00000100:00100000:3.0:1746065079.631386:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12131 00000100:00100000:3.0:1746065079.631391:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261406848:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.631410:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.631465:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14621e2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c86f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.631510:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14621e2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c86f expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.631520:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14621e2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c86f expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.631533:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.631536:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.631538:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30a00, rc 0) 00000100:00100000:0.0:1746065079.631539:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12132 00000100:00100000:0.0:1746065079.631546:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27895:x1830881261407104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.631553:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.631572:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14621e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c876 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.631587:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261406848:12345-192.168.202.27@tcp:101:bash.0 Request processed in 195us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.631591:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12131 00010000:00010000:0.0:1746065079.631622:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.631630:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631637:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631644:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.631649:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631653:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631722:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065079.631729:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631735:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065079.631743:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 0 00010000:00010000:0.0:1746065079.631829:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631835:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631840:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631845:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631849:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.631852:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631857:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631865:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800aa04cd00) 00010000:00010000:0.0:1746065079.631867:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.631869:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631874:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14621f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631899:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631903:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631907:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631911:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.631913:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631918:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631923:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:0.0:1746065079.631925:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.631927:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631932:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc14621f7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.631958:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96400/0xad6b7ddc14621e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.631970:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.631976:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:0.0:1746065079.631978:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.631980:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:0.0:1746065079.632000:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27895:x1830881261407104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 455us (1146us total) trans 4294975497 rc 0/0 00000100:00100000:0.0:1746065079.632006:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12132 00000100:00100000:0.0:1746065079.634366:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.634476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.634623:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261407360 00000100:00100000:1.0:1746065079.634628:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261407360 00000100:00100000:1.0:1746065079.634673:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4178 00000100:00100000:1.0:1746065079.634679:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27895:x1830881261407360:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065079.635636:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27895:x1830881261407360:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 954us (1278us total) trans 4294975498 rc 0/0 00000100:00100000:1.0:1746065079.635643:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4178 00000100:00100000:2.0:1746065079.635849:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261407616 00000100:00100000:2.0:1746065079.635853:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261407616 00000100:00100000:2.0:1746065079.635880:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12133 00000100:00100000:2.0:1746065079.635885:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261407616:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.635895:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.635898:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746065079.635918:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14621e2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c86f expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.635935:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc14621db lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c868 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.635941:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.635945:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.635952:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc146220c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c87d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.635984:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.635993:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.635999:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.636022:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.636032:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 296 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.636048:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262630912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.636106:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.639259:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.639312:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.639456:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262630912:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.639458:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261407744 00000100:00100000:0.0:1746065079.639464:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261407744 00010000:00010000:2.0:1746065079.639477:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065079.639498:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4179 00000100:00100000:0.0:1746065079.639505:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27895:x1830881261407744:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:0.0:1746065079.639628:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27895:x1830881261407744:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 123us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.639633:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4179 00000100:00100000:3.0:1746065079.639688:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261407872 00000100:00100000:3.0:1746065079.639691:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261407872 00010000:00010000:3.0:1746065079.639706:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 297 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.639721:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3595 00000100:00100000:3.0:1746065079.639725:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+297:2004:x1830881261407872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.639733:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.639737:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 297 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.639745:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 297 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.639762:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00000/0xad6b7ddc14621fe lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c876 expref: 297 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.639801:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.639805:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.639812:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.639817:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.639838:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.639856:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261407872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.639861:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3595 00010000:00010000:2.0:1746065079.639861:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.639866:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:2.0:1746065079.640038:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2401, 88 off198784 00000004:00080000:2.0:1746065079.640044:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675658270088ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065079.640082:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2405, 88 off199216 00000004:00080000:2.0:1746065079.640086:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675658312896ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.640099:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2406, 88 off199304 00000004:00080000:2.0:1746065079.640102:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675658328718ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.640110:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2402, 88 off198872 00000004:00080000:2.0:1746065079.640113:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675658339111ns, next at 676590652783ns, rc = 0 00000100:00100000:3.0:1746065079.644901:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065079.644918:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065079.644970:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.645023:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631040 00000100:00100000:1.0:1746065079.645030:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631040 00000100:00100000:1.0:1746065079.645075:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1746065079.645081:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881262631040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746065079.645109:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445793792 avail 1316331520 00000100:00100000:1.0:1746065079.645147:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881262631040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.645153:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1746065079.645174:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065079.653537:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:2.0:1746065079.653668:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975499 is committed 00000004:00080000:2.0:1746065079.653676:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1613 committed 00000004:00080000:2.0:1746065079.653683:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1623 committed 00000004:00080000:2.0:1746065079.653687:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1622 committed 00000004:00080000:2.0:1746065079.653690:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1612 committed 00000004:00080000:2.0:1746065079.653704:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1611 committed 00000004:00080000:2.0:1746065079.653706:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1621 committed 00010000:00010000:2.0:1746065079.653762:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c87d expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.653788:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.653791:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.653806:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc146220c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c87d expref: 279 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065079.653821:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c87d expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.653847:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.653849:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.653851:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:2.0:1746065079.653908:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261407616:12345-192.168.202.27@tcp:101:bash.0 Request processed in 18021us (19430us total) trans 4294975499 rc 0/0 00000100:00100000:2.0:1746065079.653917:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12133 00000100:00100000:2.0:1746065079.653939:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261408128 00000100:00100000:2.0:1746065079.653944:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261408128 00000100:00100000:2.0:1746065079.653971:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12134 00000100:00100000:2.0:1746065079.653976:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27896:x1830881261408128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.653989:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.654027:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654034:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654040:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654044:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.654048:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654054:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654062:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065079.654064:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.654066:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654070:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d600/0xad6b7ddc14620df lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.654081:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654085:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654089:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654093:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.654095:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654099:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654104:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c800) 00010000:00010000:3.0:1746065079.654106:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.654108:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654112:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00200/0xad6b7ddc1462172 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.654123:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.654127:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.654131:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.654134:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.654136:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.654140:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.654146:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.654148:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.654150:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.654158:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14621d4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065079.654235:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262631296:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.654244:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631168:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.654267:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.654283:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.654297:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065079.654301:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631552:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.654307:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065079.654310:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262631424:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.654315:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.654324:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.654333:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631296 00000100:00100000:3.0:1746065079.654336:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631296 00000100:00100000:3.0:1746065079.654353:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631168 00000100:00100000:3.0:1746065079.654355:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631168 00000100:00100000:0.0:1746065079.654383:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631552 00000100:00100000:0.0:1746065079.654386:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631552 00000100:00100000:0.0:1746065079.654401:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631424 00000100:00100000:0.0:1746065079.654403:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631424 00000100:00100000:0.0:1746065079.654412:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8530 00000100:00100000:0.0:1746065079.654416:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3761:x1830881262631296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065079.654432:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:861 count 1 00010000:00010000:0.0:1746065079.654447:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.654459:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.654466:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.654468:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.654470:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.654489:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.654498:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 23 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746065079.654506:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262631680:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.654537:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.654591:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631808:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.654609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.654622:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065079.654626:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262632192:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.654638:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.654645:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262632064:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.654653:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631808 00000100:00100000:0.0:1746065079.654655:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631808 00000100:00100000:1.0:1746065079.654662:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.654674:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065079.654678:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262631936:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.654691:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065079.654713:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6400/0xad6b7ddc146221a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c884 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.654793:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.654801:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654807:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654815:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.654819:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654823:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654895:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.654901:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654909:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065079.654916:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 2 00010000:00010000:2.0:1746065079.654970:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654975:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654979:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654983:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654986:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.654989:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654993:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.654999:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:2.0:1746065079.655001:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.655003:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655007:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7200/0xad6b7ddc1462228 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655014:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655018:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655022:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655025:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.655026:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655030:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655034:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:2.0:1746065079.655035:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.655037:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655043:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc146222f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.655067:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6400/0xad6b7ddc146221a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.655075:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.655080:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.655082:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.655083:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6c00, rc 0) 00000100:00100000:2.0:1746065079.655105:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27896:x1830881261408128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1129us (1579us total) trans 4294975500 rc 0/0 00000100:00100000:2.0:1746065079.655110:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12134 00000100:00100000:0.0:1746065079.659397:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262632192 00000100:00100000:0.0:1746065079.659405:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262632192 00000100:00100000:0.0:1746065079.659422:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262632064 00000100:00100000:0.0:1746065079.659424:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262632064 00000100:00100000:0.0:1746065079.659429:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631936 00000100:00100000:0.0:1746065079.659431:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631936 00000100:00100000:0.0:1746065079.659443:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8531 00000100:00100000:0.0:1746065079.659450:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3760:x1830881262631552:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.659622:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3760:x1830881262631552:12345-0@lo:2:osp-syn-0-1.0 Request processed in 172us (5304us total) trans 21474839797 rc 0/0 00000100:00100000:0.0:1746065079.659630:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8531 00000100:00100000:0.0:1746065079.659645:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8532 00000100:00100000:0.0:1746065079.659649:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3761:x1830881262631424:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065079.659695:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065079.659698:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.659700:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.659702:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065079.659703:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065079.659724:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3761:x1830881262631424:12345-0@lo:2:osp-syn-0-1.0 Request processed in 75us (5399us total) trans 21474839798 rc 0/0 00000100:00100000:0.0:1746065079.659729:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8532 00000100:00100000:0.0:1746065079.659738:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8533 00000100:00100000:0.0:1746065079.659743:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+63:3760:x1830881262631808:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065079.659756:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:861 count 1 00010000:00010000:0.0:1746065079.659771:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659800:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659806:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065079.659807:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065079.659809:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659836:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659850:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 37 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.659861:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262632320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.659912:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.659928:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8534 00000100:00100000:0.0:1746065079.659933:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+30:3760:x1830881262631168:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065079.659943:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:860 count 1 00010000:00010000:0.0:1746065079.659953:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659962:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659967:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065079.659968:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065079.659969:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659983:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.659990:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 23 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.659999:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262632448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.660017:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.660186:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8535 00000100:00100000:3.0:1746065079.660192:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+63:3760:x1830881262632192:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.660271:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+64:3760:x1830881262632192:12345-0@lo:2:osp-syn-1-1.0 Request processed in 79us (5631us total) trans 17179872521 rc 0/0 00000100:00100000:3.0:1746065079.660276:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8535 00000004:00080000:1.0:1746065079.660276:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a64ad80/2, rc 0, transno 21474839798 00000100:00100000:1.0:1746065079.660281:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262631424:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.660285:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8536 00000100:00100000:3.0:1746065079.660288:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+63:3762:x1830881262632064:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065079.660298:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90700/2, rc 0, transno 17179872521 00000100:00100000:1.0:1746065079.660301:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262632192:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065079.660309:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a648a80/2, rc 0, transno 21474839797 00000100:00100000:1.0:1746065079.660312:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631552:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065079.660341:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+64:3762:x1830881262632064:12345-0@lo:2:osp-syn-1-1.0 Request processed in 52us (5678us total) trans 17179872522 rc 0/0 00000100:00100000:3.0:1746065079.660346:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8536 00000100:00100000:3.0:1746065079.660355:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8537 00000100:00100000:3.0:1746065079.660359:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+63:3762:x1830881262631936:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065079.660368:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:862 count 1 00010000:00010000:3.0:1746065079.660381:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.660390:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.660396:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.660397:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.660399:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.660414:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.660422:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746065079.660430:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262632576:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.660457:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000004:00080000:0.0:1746065079.660577:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a92300/2, rc 0, transno 17179872522 00000100:00100000:0.0:1746065079.660580:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262632064:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.660804:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.660819:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261408256 00000100:00100000:2.0:1746065079.660823:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261408256 00000100:00100000:2.0:1746065079.660843:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8538 00000100:00100000:2.0:1746065079.660847:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:26180:x1830881261408256:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.660856:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.660863:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c88b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.660884:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.660893:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.660894:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.660897:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.660910:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.660916:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 25 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.660923:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262632704:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.660958:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.661075:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881262632832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065079.661100:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.661183:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262632832 00000100:00100000:3.0:1746065079.661186:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262632832 00000100:00100000:3.0:1746065079.661205:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1746065079.661209:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3760:x1830881262632832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065079.661220:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490134720 pending 0 free 3919233024 avail 3687395328 00000100:00100000:3.0:1746065079.661247:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3760:x1830881262632832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.661251:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1746065079.661306:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881262632832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065079.664290:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262631680:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.664312:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.664382:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.664449:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261408384 00000100:00100000:2.0:1746065079.664454:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261408384 00010000:00010000:2.0:1746065079.664480:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 26 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:2.0:1746065079.664846:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3596 00000100:00100000:2.0:1746065079.664854:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261408384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.664864:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.664870:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 26 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.664879:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 26 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.664898:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01400/0xad6b7ddc1461ff8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7c7 expref: 26 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.664910:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.664912:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.664915:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.664922:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.664940:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.664977:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261408384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 124us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.664983:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3596 00010000:00010000:2.0:1746065079.665000:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.665006:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.665014:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.665020:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.666001:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065079.666618:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.666805:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+31:3761:x1830881262631296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12387us (12536us total) trans 21474839799 rc 0/0 00000100:00100000:2.0:1746065079.666813:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8530 00000004:00080000:1.0:1746065079.666905:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a648e00/2, rc 0, transno 21474839799 00000100:00100000:1.0:1746065079.666911:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262631296:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.666982:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.667175:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262632448:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.667191:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262632704:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065079.667191:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.667206:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.667210:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262632320:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.667218:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6600, rc 0) 00010000:00010000:0.0:1746065079.667218:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.667234:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261408640 00000100:00100000:0.0:1746065079.667238:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261408640 00000100:00100000:2.0:1746065079.667241:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:26180:x1830881261408256:12345-192.168.202.27@tcp:101:bash.0 Request processed in 6394us (6439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.667246:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8538 00000100:00100000:0.0:1746065079.667265:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4180 00000100:00100000:2.0:1746065079.667267:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262632576:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.667270:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27896:x1830881261408640:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:2.0:1746065079.667276:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.667382:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27896:x1830881261408640:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 111us (1383us total) trans 4294975501 rc 0/0 00000100:00100000:0.0:1746065079.667388:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4180 00010000:00010000:3.0:1746065079.667539:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.667545:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667553:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.667564:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667572:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667585:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667591:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc1462221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667606:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.667607:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.667609:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065079.667618:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261408896 00000100:00100000:3.0:1746065079.667621:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261408896 00010000:00010000:3.0:1746065079.667635:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 24 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.667651:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3597 00000100:00100000:3.0:1746065079.667656:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261408896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.667663:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.667668:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 24 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.667681:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 24 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.667693:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14620c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c814 expref: 24 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.667701:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.667703:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.667706:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667712:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.667727:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.667744:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261408896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.667749:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3597 00000100:00100000:2.0:1746065079.667806:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065079.667832:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.667839:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.667846:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.667852:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.667862:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.667872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.667924:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261408768 00000100:00100000:3.0:1746065079.667927:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261408768 00010000:00010000:3.0:1746065079.667940:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 38 pid: 12258 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.667954:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261409152 00000100:00100000:3.0:1746065079.667956:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261409152 00010000:00010000:3.0:1746065079.667963:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 23 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746065079.667982:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3598 00000100:00100000:3.0:1746065079.667986:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261408768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.667993:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.667996:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 38 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.668004:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 38 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.668016:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14620a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c806 expref: 38 pid: 12258 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.668023:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.668025:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.668027:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.668033:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.668045:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.668062:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261408768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.668068:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3599 00000100:00100000:2.0:1746065079.668074:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261409152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065079.668077:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3598 00010000:00010000:2.0:1746065079.668080:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.668085:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 23 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.668092:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 23 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.668102:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6000/0xad6b7ddc14621cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c85a expref: 23 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:2.0:1746065079.668110:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.668111:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.668115:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.668121:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.668140:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.668149:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881262632960:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065079.668184:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.668209:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+31:3760:x1830881262631168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8276us (13924us total) trans 21474839800 rc 0/0 00000100:00100000:1.0:1746065079.668215:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8534 00010000:00010000:0.0:1746065079.668334:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065079.668339:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668345:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065079.668347:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668354:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668363:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668368:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc146224b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668379:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.668380:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.668382:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065079.668403:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a648700/2, rc 0, transno 21474839800 00000100:00100000:0.0:1746065079.668407:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631168:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065079.668464:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668471:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668477:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668486:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668495:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065079.668613:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+64:3760:x1830881262631808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8869us (14002us total) trans 17179872523 rc 0/0 00000100:00100000:0.0:1746065079.668618:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8533 00010000:00010000:0.0:1746065079.668632:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065079.668636:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668641:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065079.668644:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668709:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668718:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668723:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c400/0xad6b7ddc1462244 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.668733:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.668734:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065079.668736:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065079.668752:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a93b80/2, rc 0, transno 17179872523 00000100:00100000:0.0:1746065079.668756:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262631808:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.668918:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.671295:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261409024 00000100:00100000:0.0:1746065079.671304:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261409024 00010000:00010000:0.0:1746065079.671338:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746065079.671373:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3600 00000100:00100000:0.0:1746065079.671380:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261409024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.671390:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.671394:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746065079.671403:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746065079.671420:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d600/0xad6b7ddc1462029 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c7ce expref: 37 pid: 1880 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746065079.671432:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.671434:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.671437:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.671444:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.671476:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.671502:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.671508:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.671518:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261409024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 138us (2600us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065079.671519:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.671523:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3600 00010000:00010000:2.0:1746065079.671526:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.671537:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065079.671591:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.671596:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.671602:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.671604:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.671610:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.671619:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.671624:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96000/0xad6b7ddc1462252 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.671636:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.671637:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.671638:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065079.671697:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+64:3762:x1830881262631936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11337us (17004us total) trans 17179872524 rc 0/0 00000100:00100000:2.0:1746065079.671704:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8537 00000100:00100000:2.0:1746065079.671734:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881262632960:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065079.671744:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.671761:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261409152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3688us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.671767:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3599 00000004:00080000:0.0:1746065079.672349:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a92680/2, rc 0, transno 17179872524 00000100:00100000:0.0:1746065079.672355:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262631936:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.672419:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.672451:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261409280 00000100:00100000:2.0:1746065079.672454:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261409280 00000100:00100000:2.0:1746065079.672478:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8539 00000100:00100000:2.0:1746065079.672484:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+36:26180:x1830881261409280:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.672495:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.672506:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c892 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.672522:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.672533:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.672535:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.672540:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 37 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.672549:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 37 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.672583:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01a00, rc 0) 00000100:00100000:2.0:1746065079.672611:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261409280:12345-192.168.202.27@tcp:101:bash.0 Request processed in 127us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.672616:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8539 00000100:00100000:0.0:1746065079.682914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.682967:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261409536 00000100:00100000:0.0:1746065079.682972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.682978:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261409536 00000100:00100000:0.0:1746065079.683171:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.683247:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261409664 00000100:00100000:2.0:1746065079.683248:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261409792 00000100:00100000:1.0:1746065079.683250:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261409664 00000100:00100000:2.0:1746065079.683253:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261409792 00002000:00010000:2.0:1746065079.683269:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/863 (0->18446744073709551615) 00002000:00010000:1.0:1746065079.683269:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/862 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.683273:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881261409792 ext(0->18446744073709551615) 00002000:00100000:1.0:1746065079.683273:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc380 with x1830881261409664 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.683281:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bdf80. 00002000:00010000:1.0:1746065079.683281:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bc380. 00000100:00100000:1.0:1746065079.683293:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1261 00000100:00100000:1.0:1746065079.683299:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261409664:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065079.683428:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.683431:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.683433:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.683435:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.683436:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.683488:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261409664:12345-192.168.202.27@tcp:10:bash.0 Request processed in 188us (515us total) trans 21474839801 rc 0/0 00000100:00100000:1.0:1746065079.683493:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1261 00002000:00010000:1.0:1746065079.683496:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/862 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.683498:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc380 with x1830881261409664 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.683501:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bc380. 00000100:00100000:1.0:1746065079.683514:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1262 00000100:00100000:1.0:1746065079.683519:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881261409792:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065079.683592:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.683595:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb mtime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.683597:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.683598:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb ctime from disk: 0 -> 1746065079 00002000:00010000:1.0:1746065079.683600:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.683614:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881261409792:12345-192.168.202.27@tcp:10:bash.0 Request processed in 95us (444us total) trans 17179872525 rc 0/0 00000100:00100000:1.0:1746065079.683619:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1262 00002000:00010000:1.0:1746065079.683621:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/863 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.683623:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881261409792 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.683626:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bdf80. 00000100:00100000:2.0:1746065079.683792:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12135 00000100:00100000:2.0:1746065079.683799:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27897:x1830881261409536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.683812:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.683826:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462267 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c899 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.683902:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 3/1,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065079.683914:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.683922:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065079.683932:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 2 00010000:00010000:2.0:1746065079.684002:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f00400/0xad6b7ddc1462267 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.684025:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.684032:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.684034:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065079.684037:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01400, rc 0) 00000100:00100000:2.0:1746065079.684059:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27897:x1830881261409536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 261us (1153us total) trans 4294975502 rc 0/0 00000100:00100000:2.0:1746065079.684065:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12135 00000100:00100000:0.0:1746065079.687979:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.688352:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.688438:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261410048 00000100:00100000:2.0:1746065079.688446:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261410048 00000100:00100000:2.0:1746065079.688499:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4181 00000100:00100000:2.0:1746065079.688507:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261410048:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065079.688762:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261410304 00000100:00100000:3.0:1746065079.688766:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261410304 00000100:00100000:3.0:1746065079.688821:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12136 00000100:00100000:3.0:1746065079.688827:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27897:x1830881261410304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.688836:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.688851:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146227c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8a0 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.688943:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.688954:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.688960:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.688986:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.688995:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 282 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.689006:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262633088:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.689090:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.689285:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261410048:12345-192.168.202.27@tcp:35:bash.0 Request processed in 778us (1314us total) trans 4294975503 rc 0/0 00000100:00100000:2.0:1746065079.689291:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4181 00000100:00100000:0.0:1746065079.692923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.693034:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262633088:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.693053:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065079.693216:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261410432 00000100:00100000:2.0:1746065079.693221:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261410432 00010000:00010000:2.0:1746065079.693249:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 283 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.693270:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3601 00000100:00100000:2.0:1746065079.693276:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+283:2004:x1830881261410432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.693287:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.693292:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 283 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.693300:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 283 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.693317:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc1462236 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c884 expref: 283 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.693328:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.693331:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.693339:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.693344:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065079.693358:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.693390:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+282:2004:x1830881261410432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.693395:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3601 00010000:00010000:3.0:1746065079.693455:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.693460:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065079.693482:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 2 00010000:00010000:3.0:1746065079.693599:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146227c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 283 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.693615:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.693625:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.693627:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065079.693629:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00000100:00100000:3.0:1746065079.693652:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27897:x1830881261410304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4826us (5302us total) trans 4294975504 rc 0/0 00000100:00100000:3.0:1746065079.693657:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12136 00000100:00100000:0.0:1746065079.694096:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262633216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065079.694131:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.694687:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262633216 00000100:00100000:3.0:1746065079.694692:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262633216 00000100:00100000:3.0:1746065079.694716:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1746065079.694721:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262633216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746065079.694737:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490164288 pending 28672 free 3920257024 avail 3688734720 00000100:00100000:3.0:1746065079.694977:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262633216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.694983:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1746065079.695026:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262633216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065079.698310:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.698356:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.698412:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261410560 00000100:00100000:1.0:1746065079.698419:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261410560 00000100:00100000:3.0:1746065079.698430:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261410688 00000100:00100000:3.0:1746065079.698435:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261410688 00000100:00100000:1.0:1746065079.698458:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12137 00000100:00100000:1.0:1746065079.698464:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27897:x1830881261410560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.698483:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.698498:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462291 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8a7 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.698587:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.698600:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.698606:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065079.698616:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12138 00000100:00100000:3.0:1746065079.698622:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27898:x1830881261410688:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1746065079.698630:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.698635:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.698640:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc146229f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8ae expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.698644:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 284 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.698654:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262633344:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.698669:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.698676:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.698685:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.698694:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.698699:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.698704:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065079.698716:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065079.698753:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.698760:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.698765:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065079.700824:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262633344:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.700933:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065079.701187:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.701258:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261410816 00000100:00100000:1.0:1746065079.701263:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261410816 00010000:00010000:1.0:1746065079.701286:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 286 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.701837:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3602 00000100:00100000:1.0:1746065079.701845:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+286:2004:x1830881261410816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.701856:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.701861:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 286 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.701870:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 286 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.701888:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462283 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x33a:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a0 expref: 286 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.701903:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.701908:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.701916:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.701922:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.701928:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.701932:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.701936:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.701950:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065079.701964:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065079.701969:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.701986:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+285:2004:x1830881261410816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.701991:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3602 00000004:00200000:0.0:1746065079.702008:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 5 00000004:00200000:0.0:1746065079.702012:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1746065079.702053:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702062:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065079.702069:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.702078:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 5 00000004:00200000:3.0:1746065079.702081:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.702086:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702093:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.702145:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3400/0xad6b7ddc1462291 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a7 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.702146:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702151:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702156:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702162:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702166:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.702166:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a7 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.702170:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.702171:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:0.0:1746065079.702173:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.702175:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065079.702175:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3c00, rc 0) 00010000:00010000:3.0:1746065079.702181:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:3.0:1746065079.702183:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.702185:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702189:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14622a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065079.702197:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27897:x1830881261410560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3734us (3896us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065079.702200:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065079.702203:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12137 00010000:00010000:3.0:1746065079.702204:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702208:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702212:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.702214:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702219:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702224:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47600) 00010000:00010000:3.0:1746065079.702226:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.702228:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702232:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14622ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.702253:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc146229f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ae expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.702263:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ae expref: 283 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.702268:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.702269:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.702271:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:3.0:1746065079.702290:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27898:x1830881261410688:12345-192.168.202.27@tcp:101:rm.0 Request processed in 3669us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.702294:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12138 00000100:00100000:0.0:1746065079.704666:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.705010:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261411072 00000100:00100000:2.0:1746065079.705016:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261411072 00000100:00100000:2.0:1746065079.705054:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4182 00000100:00100000:2.0:1746065079.705059:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27897:x1830881261411072:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.705989:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27897:x1830881261411072:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 927us (1327us total) trans 4294975505 rc 0/0 00000100:00100000:2.0:1746065079.705996:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4182 00000100:00100000:0.0:1746065079.707136:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.707412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.707522:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261411456 00000100:00100000:3.0:1746065079.707528:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261411456 00000100:00100000:3.0:1746065079.707567:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12139 00000100:00100000:3.0:1746065079.707573:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27898:x1830881261411456:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065079.707606:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065079.707625:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1462213 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c87d expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.707639:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc1462298 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8a7 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.707648:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14621c6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c861 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.707654:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.707657:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.707674:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.707682:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.707688:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.707696:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.707700:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.707704:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.707758:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00000100:00100000:1.0:1746065079.707874:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261411200 00000100:00100000:1.0:1746065079.707878:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261411200 00000100:00100000:1.0:1746065079.707906:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 553 00000100:00100000:1.0:1746065079.707911:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+282:2006:x1830881261411200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.707918:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.707927:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622b4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ae expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.707942:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.707944:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.707970:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+281:2006:x1830881261411200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 59us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.707975:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 553 00000100:00100000:0.0:1746065079.708565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065079.708646:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.708651:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.708676:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.708685:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.708695:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262633472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.708749:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.709069:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261411712 00000100:00100000:1.0:1746065079.709073:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261411712 00000100:00100000:1.0:1746065079.709103:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12140 00000100:00100000:1.0:1746065079.709108:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27897:x1830881261411712:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.709119:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.709121:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065079.709127:0:7205:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 281 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.709138:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.709141:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.709147:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.709150:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.709159:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.709166:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14622d0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8b5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.709223:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc14622d7 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.709230:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc14622d7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.709235:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc14622d7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065079.709243:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 5 00010000:00010000:1.0:1746065079.709309:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14622d0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8b5 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.709318:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc14622d7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8b5 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.709323:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.709325:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065079.709327:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3600, rc 0) 00000100:00100000:1.0:1746065079.709346:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27897:x1830881261411712:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 237us (790us total) trans 4294975506 rc 0/0 00000100:00100000:1.0:1746065079.709350:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12140 00000100:00100000:0.0:1746065079.712417:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.712567:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261411840 00000100:00100000:2.0:1746065079.712574:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261411840 00000100:00100000:2.0:1746065079.712616:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12141 00000100:00100000:2.0:1746065079.712625:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27897:x1830881261411840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.712642:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.712658:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14622e5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8bc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.712706:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14622e5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8bc expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.712717:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14622e5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8bc expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.712734:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065079.712737:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.712740:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96000, rc 0) 00000100:00100000:2.0:1746065079.712819:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27897:x1830881261411840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 194us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.712825:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12141 00010000:00010000:3.0:1746065079.712979:0:7204:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff88012e37d880 x1830881262633472) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 1/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 283 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.712991:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146226e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c899 expref: 283 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.713003:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262633472:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.713018:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.713023:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.713034:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.713038:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00080000:3.0:1746065079.713255:0:7204:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x33a:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1746065079.714504:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714514:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714519:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714523:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.714527:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714533:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714544:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.714547:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065079.714550:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714554:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c200/0xad6b7ddc14622c9 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714581:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714591:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714595:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714599:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714603:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.714605:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714609:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714615:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:3.0:1746065079.714617:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.714619:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714623:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc14622bb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:3.0:1746065079.714636:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800907be680 reply state ffff88009c17f000 transno 4294975507 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714644:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.714650:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:3.0:1746065079.714651:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.714654:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.714733:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27898:x1830881261411456:12345-192.168.202.27@tcp:36:rm.0 Request processed in 7157us (7596us total) trans 4294975507 rc 0/0 00000100:00100000:3.0:1746065079.714739:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12139 00000100:00100000:0.0:1746065079.716734:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.716792:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261411968 00000100:00100000:2.0:1746065079.716798:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261411968 00000100:00100000:2.0:1746065079.717220:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8540 00000100:00100000:2.0:1746065079.717227:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261411968:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065079.717258:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.717271:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.717278:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.717279:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.717282:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.717304:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.717313:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 23 pid: 9550 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.717324:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262633600:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.718696:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.721214:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.721581:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262633600:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.721601:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.722019:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412096 00000100:00100000:3.0:1746065079.722025:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412096 00002000:00100000:3.0:1746065079.722064:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x35e:0x0] (0->4) req@ffff880099ceb480 x1830881261412096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:750/0 lens 496/0 e 0 to 0 dl 1746065090 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065079.722074:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ceb480 with x1830881261412096 ext(0->4) 00010000:00010000:3.0:1746065079.722080:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 24 pid: 9550 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.722093:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 24 pid: 9550 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746065079.722099:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ceb480 00000100:00100000:3.0:1746065079.722409:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 215 00000100:00100000:3.0:1746065079.722419:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881261412096:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:3.0:1746065079.723906:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261412096:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1484us (2694us total) trans 21474839802 rc 0/0 00000100:00100000:3.0:1746065079.723914:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 215 00002000:00100000:3.0:1746065079.723922:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x35e:0x0] (0->4) req@ffff880099ceb480 x1830881261412096/t21474839802(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:750/0 lens 496/448 e 0 to 0 dl 1746065090 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065079.723930:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ceb480 with x1830881261412096 ext(0->4) 00010000:00010000:3.0:1746065079.723937:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 26 pid: 9550 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.723952:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 26 pid: 9550 timeout: 775 lvb_type: 0 00002000:00010000:3.0:1746065079.723958:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ceb480 00000100:00100000:0.0:1746065079.724196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.725092:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412224 00000100:00100000:3.0:1746065079.725099:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412224 00000100:00100000:3.0:1746065079.725174:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12142 00000100:00100000:3.0:1746065079.725181:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27899:x1830881261412224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.725198:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.725216:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14622f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8c3 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.725265:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.725275:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725283:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725290:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.725294:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725298:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725332:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725437:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725441:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725445:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725449:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.725452:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725457:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725466:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47600) 00010000:00010000:3.0:1746065079.725468:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.725471:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725475:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc14622fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725484:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725488:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725492:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725496:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.725498:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725502:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725506:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:3.0:1746065079.725507:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.725509:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725512:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462301 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.725533:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14622f3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8c3 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.725539:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14622f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8c3 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.725548:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:3.0:1746065079.725601:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27899:x1830881261412224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 420us (1405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.725606:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12142 00000100:00100000:0.0:1746065079.728321:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.728401:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.728449:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412352 00000100:00100000:2.0:1746065079.728456:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412352 00010000:00010000:2.0:1746065079.728486:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 26 pid: 9550 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.728548:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412480 00000100:00100000:3.0:1746065079.728552:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412480 00000100:00100000:3.0:1746065079.728583:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12143 00000100:00100000:3.0:1746065079.728590:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27899:x1830881261412480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.728605:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.728620:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462308 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8ca expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.728667:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.728677:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728685:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728693:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065079.728698:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728703:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728730:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728735:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728740:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728744:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728748:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.728752:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728757:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728765:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:3.0:1746065079.728767:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.728770:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728792:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146230f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728801:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728804:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728808:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728811:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.728813:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728816:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728821:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:3.0:1746065079.728822:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.728824:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728831:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462316 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.728849:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462308 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ca expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.728855:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462308 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ca expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.728863:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00000100:00100000:3.0:1746065079.728897:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27899:x1830881261412480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 308us (497us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.728902:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12143 00000100:00100000:2.0:1746065079.728957:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3603 00000100:00100000:2.0:1746065079.728963:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261412352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.728971:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065079.728983:0:9565:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1746065079.728985:0:9565:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065079.728989:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 26 pid: 9550 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.728997:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 26 pid: 9550 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.729008:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1462259 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c88b expref: 26 pid: 9550 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.729019:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.729021:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.729024:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.729031:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.729046:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.729060:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261412352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.729064:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3603 00010000:00010000:3.0:1746065079.730430:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730441:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730458:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730464:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730471:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730480:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.730482:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730489:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730500:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.730505:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d600/0xad6b7ddc14622ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.730553:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261411968:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 13325us (13820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.730571:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8540 00000100:00100000:0.0:1746065079.734571:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065079.734757:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.735348:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.735392:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412608 00000100:00100000:1.0:1746065079.735399:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412608 00000100:00100000:1.0:1746065079.735431:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412864 00000100:00100000:1.0:1746065079.735433:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412864 00000100:00100000:1.0:1746065079.735446:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12144 00000100:00100000:1.0:1746065079.735452:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27899:x1830881261412608:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.735467:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.735482:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc146231d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8d1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.735533:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462324 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.735543:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462324 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.735551:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462324 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065079.735596:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065079.735600:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065079.735624:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc146231d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8d1 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.735639:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462324 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8d1 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.735646:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999900) 00010000:00010000:1.0:1746065079.735648:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065079.735650:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:1.0:1746065079.735692:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27899:x1830881261412608:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 240us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.735698:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12144 00000100:00100000:1.0:1746065079.735711:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12145 00000100:00100000:1.0:1746065079.735716:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27897:x1830881261412864:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065079.735731:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.735742:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc14622e5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8bc expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.735753:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.735755:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.735767:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.735789:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.735794:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:1.0:1746065079.735941:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2403, 88 off198960 00000004:00080000:1.0:1746065079.735946:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675754171824ns, next at 676590652783ns, rc = 0 00000040:00080000:1.0:1746065079.736628:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2407, 88 off199392 00000004:00080000:1.0:1746065079.736633:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675754859430ns, next at 676590632635ns, rc = 0 00000040:00080000:1.0:1746065079.737079:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2408, 88 off199480 00000004:00080000:1.0:1746065079.737084:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675755309979ns, next at 676590632635ns, rc = 0 00000040:00080000:1.0:1746065079.737095:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2404, 88 off199048 00000004:00080000:1.0:1746065079.737097:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675755323823ns, next at 676590652783ns, rc = 0 00000001:00080000:2.0:1746065079.739738:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975508 is committed 00000004:00080000:2.0:1746065079.739747:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1615 committed 00000004:00080000:2.0:1746065079.739760:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1625 committed 00000004:00080000:2.0:1746065079.739786:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1624 committed 00000004:00080000:2.0:1746065079.739788:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1614 committed 00000100:00100000:1.0:1746065079.739919:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262633856:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.739969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.740012:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262633856 00000100:00100000:2.0:1746065079.740019:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262633856 00000100:00100000:1.0:1746065079.740028:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065079.740034:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262633728:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.740050:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8541 00000100:00100000:1.0:1746065079.740052:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.740056:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+64:3759:x1830881262633856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.740068:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262633728 00000100:00100000:1.0:1746065079.740070:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262633728 00000100:00100000:1.0:1746065079.740085:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8542 00000100:00100000:1.0:1746065079.740089:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+65:3761:x1830881262633728:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.740096:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065079.740104:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262634112:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.740127:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.740140:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262634112 00000100:00100000:2.0:1746065079.740142:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262634112 00000100:00100000:0.0:1746065079.740144:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262633984:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.740157:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8543 00002000:00010000:1.0:1746065079.740159:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1746065079.740159:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.740161:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3762:x1830881262634112:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065079.740162:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.740164:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.740166:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.740167:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.740191:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+67:3761:x1830881262633728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (138us total) trans 17179872526 rc 0/0 00000100:00100000:1.0:1746065079.740197:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8542 00000100:00100000:1.0:1746065079.740210:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262633984 00000100:00100000:1.0:1746065079.740212:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262633984 00000100:00100000:1.0:1746065079.740223:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8544 00000100:00100000:1.0:1746065079.740227:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3760:x1830881262633984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.740292:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3762:x1830881262634112:12345-0@lo:2:osp-syn-0-1.0 Request processed in 130us (165us total) trans 21474839804 rc 0/0 00000100:00100000:1.0:1746065079.740292:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+34:3760:x1830881262633984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 64us (132us total) trans 21474839803 rc 0/0 00000100:00100000:2.0:1746065079.740297:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8543 00000100:00100000:1.0:1746065079.740310:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8544 00000100:00100000:2.0:1746065079.740335:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+66:3759:x1830881262633856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 279us (366us total) trans 17179872527 rc 0/0 00000004:00080000:1.0:1746065079.740338:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d0a80/2, rc 0, transno 17179872526 00000100:00100000:2.0:1746065079.740339:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8541 00000100:00100000:1.0:1746065079.740342:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262633728:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065079.740352:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d1500/2, rc 0, transno 17179872527 00000100:00100000:1.0:1746065079.740354:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262633856:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065079.740659:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.740667:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.740673:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.740678:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.740681:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.740690:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.740703:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:3.0:1746065079.740705:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.740708:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.740713:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc14622c2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065079.740847:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc3100 reply state ffff88009a527800 transno 4294975508 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.740858:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.740863:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.740864:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065079.740867:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065079.740942:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:0.0:1746065079.741152:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6680/2, rc 0, transno 21474839804 00000100:00100000:0.0:1746065079.741157:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262634112:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065079.741169:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6300/2, rc 0, transno 21474839803 00000100:00100000:0.0:1746065079.741172:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262633984:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.741209:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.741928:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27897:x1830881261412864:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 6209us (6579us total) trans 4294975508 rc 0/0 00000100:00100000:1.0:1746065079.741935:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12145 00000100:00100000:1.0:1746065079.741951:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261412992 00000100:00100000:1.0:1746065079.741954:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261412992 00000100:00100000:1.0:1746065079.741972:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12146 00000100:00100000:1.0:1746065079.741976:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27899:x1830881261412992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.741986:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.741996:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e200/0xad6b7ddc1462332 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8d8 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.742035:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.742043:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742050:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742060:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.742064:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742068:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742098:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742106:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742110:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742114:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742118:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.742120:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742125:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742131:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999900) 00010000:00010000:1.0:1746065079.742133:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.742135:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742140:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1462339 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742148:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742152:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742157:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742160:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a6cd000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.742163:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742167:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742172:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:1.0:1746065079.742174:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.742175:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742180:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc1462340 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.742200:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e200/0xad6b7ddc1462332 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8d8 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.742206:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e200/0xad6b7ddc1462332 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8d8 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.742212:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e200, rc 0) 00000100:00100000:1.0:1746065079.742231:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27899:x1830881261412992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 254us (1024us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065079.742236:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12146 00010000:00010000:3.0:1746065079.742959:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.742967:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.742971:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.742975:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.742978:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.742982:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.742990:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.742992:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.742994:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.742998:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146232b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.754967:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.755089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.755151:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261413120 00000100:00100000:0.0:1746065079.755159:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261413120 00000100:00100000:0.0:1746065079.755196:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261413376 00000100:00100000:0.0:1746065079.755198:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261413376 00000100:00100000:0.0:1746065079.755220:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12147 00000100:00100000:0.0:1746065079.755226:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27897:x1830881261413120:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.755244:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.755260:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8df expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.755526:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12148 00000100:00100000:1.0:1746065079.755532:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27899:x1830881261413376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.755539:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.755541:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065079.755572:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462324 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8d1 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.755587:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999900) 00010000:00010000:1.0:1746065079.755595:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.755608:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146234e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8e6 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.755687:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065079.755697:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.755704:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.755716:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065079.755721:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.755725:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756036:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065079.756042:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756047:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065079.756057:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33b:0x0]: returning size 0 00010000:00010000:1.0:1746065079.756075:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756079:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756083:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756088:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756092:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a6cd600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.756094:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756099:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756104:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009a4b5600) 00010000:00010000:1.0:1746065079.756106:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.756108:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756112:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd600/0xad6b7ddc1462355 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065079.756119:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009577e300 reply state ffff88012b05a000 transno 4294975509 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756125:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065079.756132:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5d00) 00010000:00010000:1.0:1746065079.756134:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065079.756136:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065079.756152:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146234e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.756161:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 278 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.756166:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:1.0:1746065079.756168:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065079.756170:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046200, rc 0) 00000100:00100000:1.0:1746065079.756212:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27899:x1830881261413376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 681us (1124us total) trans 4294975509 rc 0/0 00000100:00100000:1.0:1746065079.756217:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12148 00010000:00010000:0.0:1746065079.759543:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.759569:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.759592:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:0.0:1746065079.759594:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065079.759597:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84bc00, rc 0) 00000100:00100000:3.0:1746065079.759726:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.759795:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261413632 00000100:00100000:2.0:1746065079.759801:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261413632 00000100:00100000:2.0:1746065079.759837:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12149 00000100:00100000:2.0:1746065079.759843:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27899:x1830881261413632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.759857:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.759870:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462371 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8ed expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.759942:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.759951:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.759958:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.759980:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.759990:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.759999:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262634240:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.760044:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.760094:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27897:x1830881261413120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4866us (5134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.760100:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12147 00000100:00100000:0.0:1746065079.766703:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.766748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.766979:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262634240:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.767000:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.767443:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261413760 00000100:00100000:1.0:1746065079.767449:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261413760 00010000:00010000:1.0:1746065079.767478:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.767510:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3604 00000100:00100000:1.0:1746065079.767516:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+280:2005:x1830881261413760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.767526:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.767531:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.767540:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.767567:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131046200/0xad6b7ddc1462363 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8e6 expref: 280 pid: 7204 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.767578:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:1.0:1746065079.767581:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.767588:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.767593:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.767606:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.767709:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.767715:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065079.767734:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33b:0x0]: returning size 0 00000004:00080000:2.0:1746065079.767885:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x361:0x0], index 1: 0 00000004:00080000:2.0:1746065079.767890:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x360:0x0], index 0: 0 00000004:00080000:2.0:1746065079.767893:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x361:0x0], index 0: 0 00000004:00080000:2.0:1746065079.767896:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x362:0x0], index 1: 0 00010000:00010000:2.0:1746065079.767988:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.767997:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.768002:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.768006:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.768010:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.768015:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.768021:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff8800b4999f00) 00010000:00010000:2.0:1746065079.768023:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.768026:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.768029:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc1462378 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.768064:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462371 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ed expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.768071:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462371 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8ed expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.768082:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7c00, rc 0) 00000100:00100000:3.0:1746065079.768211:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261413888 00000100:00100000:3.0:1746065079.768216:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261413888 00000100:00100000:3.0:1746065079.768237:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12150 00000100:00100000:3.0:1746065079.768243:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27897:x1830881261413888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.768253:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.768261:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462386 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8f4 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.768313:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146238d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065079.768322:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146238d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.768328:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146238d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065079.768346:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33a:0x0]: returning size 5 00000004:00200000:3.0:1746065079.768350:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.768357:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146238d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.768371:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462386 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8f4 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.768384:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146238d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8f4 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.768389:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.768392:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065079.768394:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:1.0:1746065079.768574:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+281:2005:x1830881261413760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1056us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.768580:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3604 00000100:00100000:2.0:1746065079.769340:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27899:x1830881261413632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9495us (9614us total) trans 4294975510 rc 301/301 00000100:00100000:2.0:1746065079.769346:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12149 00000100:00100000:3.0:1746065079.770177:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27897:x1830881261413888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1931us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.770184:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12150 00000100:00100000:3.0:1746065079.774843:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.774894:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261414272 00000100:00100000:2.0:1746065079.774902:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261414272 00000100:00100000:2.0:1746065079.774951:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4183 00000100:00100000:2.0:1746065079.774958:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27899:x1830881261414272:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.775433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.775455:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27899:x1830881261414272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 496us (618us total) trans 4294975511 rc 0/0 00000100:00100000:2.0:1746065079.775461:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4183 00000100:00100000:0.0:1746065079.776412:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261414016 00000100:00100000:0.0:1746065079.776419:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261414016 00000100:00100000:0.0:1746065079.776460:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8545 00000100:00100000:0.0:1746065079.776924:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261414016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065079.776939:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.776955:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c8fb expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065079.776979:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35e:0x0] initial LVB size: 5, mtime: 0x6812d6b7, atime: 0x0, ctime: 0x6812d6b7, blocks: 0x8 00010000:00010000:0.0:1746065079.776995:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.776997:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065079.777004:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065079.777004:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.777017:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065079.777026:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84be00, rc 0) 00000100:00100000:2.0:1746065079.777076:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261414528 00000100:00100000:2.0:1746065079.777080:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261414528 00000100:00100000:0.0:1746065079.777080:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261414016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 613us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.777086:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8545 00000100:00100000:2.0:1746065079.777097:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4184 00000100:00100000:2.0:1746065079.777102:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27899:x1830881261414528:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.777220:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27899:x1830881261414528:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 117us (216us total) trans 4294975512 rc 0/0 00000100:00100000:2.0:1746065079.777226:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4184 00000100:00100000:0.0:1746065079.782292:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.782391:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.782443:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261414912 00000100:00100000:2.0:1746065079.782451:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261414912 00000100:00100000:1.0:1746065079.782482:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261414656 00000100:00100000:1.0:1746065079.782486:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261414656 00000100:00100000:2.0:1746065079.782491:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12151 00000100:00100000:2.0:1746065079.782499:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261414912:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065079.782510:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8546 00000100:00100000:1.0:1746065079.782515:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261414656:12345-192.168.202.27@tcp:23:lfs.0 00010000:00010000:2.0:1746065079.782518:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.782534:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146239b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c902 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.782603:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261414656:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.782609:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8546 00010000:00010000:2.0:1746065079.782656:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.782667:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782679:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782687:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.782693:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782698:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782741:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc14623b0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.782747:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc14623b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782753:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc14623b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065079.782760:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33b:0x0]: returning size 0 00010000:00010000:2.0:1746065079.782851:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782857:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782861:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782866:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782871:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.782875:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782880:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782889:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561600) 00010000:00010000:2.0:1746065079.782892:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.782895:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782900:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623a2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782908:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782913:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782917:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782920:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.782922:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782926:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782931:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5d00) 00010000:00010000:2.0:1746065079.782933:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.782934:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782941:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.782970:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146239b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c902 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.782983:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc14623b0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c902 expref: 283 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.782989:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:2.0:1746065079.782990:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.782992:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:2.0:1746065079.783033:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261414912:12345-192.168.202.27@tcp:101:bash.0 Request processed in 534us (641us total) trans 4294975513 rc 0/0 00000100:00100000:2.0:1746065079.783038:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12151 00000100:00100000:0.0:1746065079.784718:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.784804:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261415040 00000100:00100000:3.0:1746065079.784809:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261415040 00000100:00100000:3.0:1746065079.784922:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8547 00000100:00100000:3.0:1746065079.784929:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261415040:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065079.785296:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261415040:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 366us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.785303:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8547 00000100:00100000:0.0:1746065079.786242:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.786302:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261415168 00000100:00100000:2.0:1746065079.786307:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261415168 00000100:00100000:2.0:1746065079.786344:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12152 00000100:00100000:2.0:1746065079.786349:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261415168:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.786363:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.786378:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc14623be lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c909 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.786411:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14623c5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065079.786422:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14623c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.786432:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14623c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.786509:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc14623be lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c909 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.786520:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14623c5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c909 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.786526:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:2.0:1746065079.786528:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065079.786530:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:2.0:1746065079.786575:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261415168:12345-192.168.202.27@tcp:101:bash.0 Request processed in 225us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.786580:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12152 00000100:00100000:0.0:1746065079.789134:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.789622:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.789867:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261415424 00000100:00100000:3.0:1746065079.789875:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261415424 00000100:00100000:3.0:1746065079.789913:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261415680 00000100:00100000:3.0:1746065079.789915:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261415680 00000100:00100000:3.0:1746065079.789941:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12153 00000100:00100000:3.0:1746065079.789948:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27897:x1830881261415424:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065079.789991:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.790013:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc146238d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8f4 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.790026:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.790030:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.790064:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.790075:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.790082:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065079.790169:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011dad4a80 reply state ffff880099706000 transno 4294975514 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.790176:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.790181:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.790183:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.790185:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.790263:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27897:x1830881261415424:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 314us (1136us total) trans 4294975514 rc 0/0 00000100:00100000:3.0:1746065079.790269:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12153 00000100:00100000:3.0:1746065079.790282:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12154 00000100:00100000:3.0:1746065079.790287:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261415680:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065079.790302:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.790311:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc14623b0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c902 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.790320:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:3.0:1746065079.790322:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.790396:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.790406:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.790411:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065079.790432:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975515 00000004:00010000:3.0:1746065079.790445:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011dad7b80 reply state ffff880099700000 transno 4294975516 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.790452:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.790456:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:3.0:1746065079.790458:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.790460:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065079.792750:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261415680:12345-192.168.202.27@tcp:36:bash.0 Request processed in 2455us (3123us total) trans 4294975516 rc 0/0 00000100:00100000:3.0:1746065079.792758:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12154 00000020:00080000:3.0:1746065079.792763:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065079.792880:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.793082:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261415808 00000100:00100000:3.0:1746065079.793088:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261415808 00000100:00100000:3.0:1746065079.793152:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8548 00000100:00100000:3.0:1746065079.793159:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:27897:x1830881261415808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.793171:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.793184:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c910 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.793208:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 26 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.793220:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.793221:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.793224:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 4/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.793247:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 26 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.793256:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 26 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746065079.793267:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262634368:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.793825:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.797113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.797177:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.797287:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261415936 00000100:00100000:3.0:1746065079.797295:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261415936 00000100:00100000:3.0:1746065079.797333:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12155 00000100:00100000:3.0:1746065079.797340:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261415936:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.797359:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065079.797370:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261416064 00000100:00100000:1.0:1746065079.797374:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261416064 00010000:00010000:3.0:1746065079.797375:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623e1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c917 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.797387:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262634368:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065079.797394:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 27 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746065079.797406:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.797412:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3605 00010000:00010000:3.0:1746065079.797417:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623e1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c917 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.797418:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261416064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.797418:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00010000:00010000:1.0:1746065079.797427:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.797428:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623e1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c917 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.797442:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 27 pid: 12258 timeout: 775 lvb_type: 1 00010000:00010000:3.0:1746065079.797444:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:3.0:1746065079.797447:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.797449:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00010000:00010000:1.0:1746065079.797451:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 27 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746065079.797457:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:27897:x1830881261415808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4298us (4576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.797463:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8548 00010000:00010000:1.0:1746065079.797465:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84be00/0xad6b7ddc1462394 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8fb expref: 27 pid: 12258 timeout: 775 lvb_type: 1 00000100:00100000:3.0:1746065079.797470:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261415936:12345-192.168.202.27@tcp:101:bash.0 Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.797475:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12155 00010000:00010000:1.0:1746065079.797478:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.797480:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.797486:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.797493:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.797514:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.797524:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881262634496:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065079.797593:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.801831:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.801942:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261416320 00000100:00100000:2.0:1746065079.801949:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261416320 00000100:00100000:2.0:1746065079.801999:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12156 00000100:00100000:2.0:1746065079.802006:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261416320:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.802023:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.802026:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065079.802048:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623e1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c917 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.802067:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:2.0:1746065079.802071:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.802081:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623e8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c91e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.802121:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623ef lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.802131:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623ef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.802138:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623ef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065079.802247:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881262634496:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065079.802262:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.802301:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261416064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4883us (5123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.802309:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3605 00000040:00080000:2.0:1746065079.802315:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2409, 88 off199568 00000004:00080000:2.0:1746065079.802321:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675820546695ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.802347:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2405, 88 off199136 00000004:00080000:2.0:1746065079.802351:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675820577370ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065079.802363:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2406, 88 off199224 00000004:00080000:2.0:1746065079.802365:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675820591815ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065079.802373:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2410, 88 off199656 00000004:00080000:2.0:1746065079.802376:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675820602239ns, next at 676590632635ns, rc = 0 00000100:00100000:1.0:1746065079.803249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.803290:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261416448 00000100:00100000:0.0:1746065079.803303:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261416448 00000100:00100000:0.0:1746065079.803330:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8549 00000100:00100000:0.0:1746065079.803336:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261416448:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065079.803423:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065079.803427:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:0.0:1746065079.803429:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb atime from disk: 0 -> 1746065079 00002000:00010000:0.0:1746065079.803431:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb ctime from disk: 1746065079 -> 1746065080 00002000:00010000:0.0:1746065079.803433:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065079.803458:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881261416448:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 122us (211us total) trans 21474839805 rc 0/0 00000100:00100000:0.0:1746065079.803464:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8549 00000100:00100000:1.0:1746065079.813321:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.813745:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261416704 00000100:00100000:0.0:1746065079.813752:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261416704 00000100:00100000:0.0:1746065079.813825:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4185 00000100:00100000:0.0:1746065079.813833:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27897:x1830881261416704:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:0.0:1746065079.813881:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x33a:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc14622d7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8b5 expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.813920:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:0.0:1746065079.813929:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.813935:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065079.813960:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.813968:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 290 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.813979:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262634624:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.814055:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00000001:00080000:2.0:1746065079.814128:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975517 is committed 00000004:00080000:2.0:1746065079.814134:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1627 committed 00000004:00080000:2.0:1746065079.814141:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1617 committed 00000004:00080000:2.0:1746065079.814146:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1616 committed 00000004:00080000:2.0:1746065079.814147:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1626 committed 00010000:00010000:2.0:1746065079.814195:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623ef lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c91e expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.814202:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:2.0:1746065079.814205:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.814215:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf6800/0xad6b7ddc14623e8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c91e expref: 282 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065079.814228:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623ef lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c91e expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.814260:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:2.0:1746065079.814262:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.814263:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7c00, rc 0) 00000100:00100000:2.0:1746065079.814286:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261416320:12345-192.168.202.27@tcp:101:bash.0 Request processed in 12282us (12464us total) trans 4294975517 rc 0/0 00000100:00100000:2.0:1746065079.814293:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12156 00010000:00010000:3.0:1746065079.814680:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814688:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814693:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814698:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.814701:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814707:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814716:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5d00) 00010000:00010000:3.0:1746065079.814718:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.814720:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814724:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc146235c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065079.814743:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814749:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814752:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814756:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.814757:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814761:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814766:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.814768:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.814770:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814795:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14623cc lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814803:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814807:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814811:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814815:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.814816:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814824:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814829:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:3.0:1746065079.814830:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.814832:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.814835:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14623d3 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065079.815270:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262634752:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.815300:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.815368:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262634752 00000100:00100000:3.0:1746065079.815371:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262634752 00000100:00100000:0.0:1746065079.815482:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065079.815490:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262634880:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.815509:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065079.815695:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262635008:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.815709:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065079.815751:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262634880 00000100:00100000:3.0:1746065079.815754:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262634880 00000100:00100000:3.0:1746065079.815770:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8550 00000100:00100000:3.0:1746065079.815788:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3762:x1830881262634752:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.815891:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+68:3762:x1830881262634752:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (590us total) trans 17179872528 rc 0/0 00000100:00100000:3.0:1746065079.815896:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8550 00000100:00100000:3.0:1746065079.815905:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8551 00000100:00100000:3.0:1746065079.815908:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3760:x1830881262634880:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065079.815948:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+68:3760:x1830881262634880:12345-0@lo:2:osp-syn-1-1.0 Request processed in 39us (439us total) trans 17179872529 rc 0/0 00000100:00100000:3.0:1746065079.815953:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8551 00000100:00100000:1.0:1746065079.816030:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262635136:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.816302:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635008 00000100:00100000:2.0:1746065079.816306:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635008 00000100:00100000:2.0:1746065079.816329:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8552 00000100:00100000:2.0:1746065079.816332:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+33:3760:x1830881262635008:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065079.816526:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9880/2, rc 0, transno 17179872529 00000100:00100000:0.0:1746065079.816530:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262634880:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.816585:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+34:3760:x1830881262635008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 252us (874us total) trans 21474839806 rc 0/0 00000100:00100000:2.0:1746065079.816590:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8552 00000004:00080000:2.0:1746065079.816607:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957dad80/2, rc 0, transno 17179872528 00000100:00100000:2.0:1746065079.816610:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262634752:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.816640:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.816662:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635136 00000100:00100000:1.0:1746065079.816665:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635136 00000100:00100000:1.0:1746065079.816680:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8553 00000100:00100000:1.0:1746065079.816684:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3761:x1830881262635136:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.816742:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3761:x1830881262635136:12345-0@lo:2:osp-syn-0-1.0 Request processed in 57us (101us total) trans 21474839807 rc 0/0 00000100:00100000:1.0:1746065079.816747:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8553 00000004:00080000:1.0:1746065079.816767:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8a80/2, rc 0, transno 21474839807 00000100:00100000:1.0:1746065079.816770:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262635136:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065079.816853:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957daa00/2, rc 0, transno 21474839806 00000100:00100000:0.0:1746065079.816856:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262635008:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.818207:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262634624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.818228:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065079.819535:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.819585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.819649:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261416832 00000100:00100000:1.0:1746065079.819655:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261416832 00010000:00010000:1.0:1746065079.819682:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 278 pid: 7203 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.819715:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3606 00000100:00100000:1.0:1746065079.819722:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+278:2007:x1830881261416832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065079.819732:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065079.819737:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 278 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.819746:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 278 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.819764:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84bc00/0xad6b7ddc1462347 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8df expref: 278 pid: 7203 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746065079.819802:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065079.819806:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.819814:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.819819:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.819833:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065079.819869:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+277:2007:x1830881261416832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 147us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.819875:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3606 00010000:00010000:2.0:1746065079.819986:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065079.819993:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:2.0:1746065079.820164:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2407, 88 off199312 00000004:00080000:2.0:1746065079.820169:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675838395149ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065079.820189:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2411, 88 off199744 00000004:00080000:2.0:1746065079.820192:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675838418434ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.820203:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2412, 88 off199832 00000004:00080000:2.0:1746065079.820205:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675838431745ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.820213:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2408, 88 off199400 00000004:00080000:2.0:1746065079.820215:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675838441908ns, next at 676590652783ns, rc = 0 00000100:00100000:3.0:1746065079.820301:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261416960 00000100:00100000:3.0:1746065079.820305:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261416960 00000100:00100000:3.0:1746065079.820326:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8554 00000100:00100000:3.0:1746065079.820330:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+38:26180:x1830881261416960:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.820342:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.820354:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c925 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065079.820373:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.820386:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.820388:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.820394:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.820405:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.820412:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:3.0:1746065079.820434:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:26180:x1830881261416960:12345-192.168.202.27@tcp:101:bash.0 Request processed in 103us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.820439:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8554 00000100:00100000:0.0:1746065079.823477:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.823554:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261417088 00000100:00100000:2.0:1746065079.823572:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261417088 00000100:00100000:2.0:1746065079.823616:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8555 00000100:00100000:2.0:1746065079.823622:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+26:26180:x1830881261417088:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.823637:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.823653:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c92c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.823672:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065079.823687:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.823688:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.823694:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.823710:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.823719:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3200, rc 0) 00000100:00100000:2.0:1746065079.823768:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:26180:x1830881261417088:12345-192.168.202.27@tcp:101:bash.0 Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.823795:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8555 00000001:00080000:2.0:1746065079.831386:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975518 is committed 00000004:00080000:2.0:1746065079.831396:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1619 committed 00000004:00080000:2.0:1746065079.831404:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1629 committed 00000004:00080000:2.0:1746065079.831408:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1628 committed 00000004:00080000:2.0:1746065079.831410:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1618 committed 00000100:00100000:0.0:1746065079.831513:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065079.831531:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262635392:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.831597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.831679:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065079.831687:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262635264:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.831709:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.831742:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065079.831747:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262635520:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.831767:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.831808:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262635648:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.831820:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.831838:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635392 00000100:00100000:1.0:1746065079.831843:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635392 00000100:00100000:1.0:1746065079.831866:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635264 00000100:00100000:1.0:1746065079.831868:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635264 00000100:00100000:1.0:1746065079.831875:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635520 00000100:00100000:1.0:1746065079.831876:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635520 00000100:00100000:1.0:1746065079.831884:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635648 00000100:00100000:1.0:1746065079.831886:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635648 00000100:00100000:1.0:1746065079.831895:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8556 00000100:00100000:1.0:1746065079.831900:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+69:3760:x1830881262635392:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.832011:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+70:3760:x1830881262635392:12345-0@lo:2:osp-syn-1-1.0 Request processed in 110us (417us total) trans 17179872530 rc 0/0 00000100:00100000:1.0:1746065079.832016:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8556 00000100:00100000:1.0:1746065079.832028:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8557 00000100:00100000:1.0:1746065079.832032:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+69:3761:x1830881262635264:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065079.832199:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.832202:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.832204:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.832205:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb ctime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.832207:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x35f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.832228:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+70:3761:x1830881262635264:12345-0@lo:2:osp-syn-1-1.0 Request processed in 195us (518us total) trans 17179872531 rc 0/0 00000100:00100000:1.0:1746065079.832233:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8557 00000100:00100000:1.0:1746065079.832242:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8558 00000100:00100000:1.0:1746065079.832246:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3759:x1830881262635520:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065079.832289:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065079.832291:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb mtime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.832293:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb atime from disk: 1746065079 -> 1746065079 00002000:00010000:1.0:1746065079.832294:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065079.832296:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x35e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065079.832312:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3759:x1830881262635520:12345-0@lo:2:osp-syn-0-1.0 Request processed in 66us (544us total) trans 21474839808 rc 0/0 00000100:00100000:1.0:1746065079.832316:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8558 00000100:00100000:1.0:1746065079.832413:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8559 00000100:00100000:1.0:1746065079.832417:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3761:x1830881262635648:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.832466:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3761:x1830881262635648:12345-0@lo:2:osp-syn-0-1.0 Request processed in 49us (645us total) trans 21474839809 rc 0/0 00000100:00100000:1.0:1746065079.832470:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8559 00000004:00080000:1.0:1746065079.832504:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cce00/2, rc 0, transno 21474839808 00000100:00100000:1.0:1746065079.832508:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262635520:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065079.832518:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cf800/2, rc 0, transno 21474839809 00000100:00100000:1.0:1746065079.832521:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262635648:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065079.832528:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9180/2, rc 0, transno 17179872531 00000100:00100000:1.0:1746065079.832530:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262635264:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065079.832638:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9500/2, rc 0, transno 17179872530 00000100:00100000:0.0:1746065079.832641:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262635392:0@lo:2:osp-syn-1-1.0 00000004:00010000:3.0:1746065079.832750:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b20b450 reply state ffff88009836e400 transno 4294975518 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.832766:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.832926:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.832929:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065079.832932:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065079.832938:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.832940:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065079.832945:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc14622d7 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c8b5 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065079.833341:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.833372:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.833435:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261417216 00000100:00100000:1.0:1746065079.833439:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261417216 00002000:00010000:1.0:1746065079.833456:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/865 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.833460:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db800 with x1830881261417216 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.833466:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957db800. 00000100:00100000:1.0:1746065079.833477:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261417344 00000100:00100000:1.0:1746065079.833479:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261417344 00002000:00010000:1.0:1746065079.833485:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/864 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.833487:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881261417344 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.833490:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380. 00010000:00080000:3.0:1746065079.835230:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065079.835246:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27897:x1830881261416704:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 21411us (21931us total) trans 4294975518 rc 0/0 00000100:00100000:3.0:1746065079.835255:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4185 00010000:00010000:3.0:1746065079.835293:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.835300:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.835305:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.835310:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.835314:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.835319:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.835329:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.835331:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.835334:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.835339:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc14623f6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:1.0:1746065079.837170:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1263 00000100:00100000:1.0:1746065079.837185:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261417216:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065079.837340:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x361:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.837343:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x361:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:1.0:1746065079.837345:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x361:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.837347:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x361:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:1.0:1746065079.837348:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x361:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.837390:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261417216:12345-192.168.202.27@tcp:10:bash.0 Request processed in 210us (4050us total) trans 17179872532 rc 0/0 00000100:00100000:1.0:1746065079.837397:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1263 00002000:00010000:1.0:1746065079.837401:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/865 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.837404:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db800 with x1830881261417216 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.837409:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957db800. 00000100:00100000:1.0:1746065079.837426:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1264 00000100:00100000:1.0:1746065079.837432:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261417344:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065079.837492:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x360:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065079.837494:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x360:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:1.0:1746065079.837496:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x360:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065079.837497:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x360:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:1.0:1746065079.837499:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x360:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065079.837512:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261417344:12345-192.168.202.27@tcp:10:bash.0 Request processed in 81us (4140us total) trans 21474839810 rc 0/0 00000100:00100000:1.0:1746065079.837517:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1264 00002000:00010000:1.0:1746065079.837519:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/864 (0->18446744073709551615) 00002000:00100000:1.0:1746065079.837521:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881261417344 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065079.837524:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380. 00000100:00100000:0.0:1746065079.840411:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.840494:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261417472 00000100:00100000:2.0:1746065079.840502:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261417472 00000100:00100000:2.0:1746065079.840548:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12157 00000100:00100000:2.0:1746065079.840566:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+275:27897:x1830881261417472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.840586:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.840604:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc146240b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c933 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.840651:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc146240b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c933 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.840663:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3c00/0xad6b7ddc146240b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c933 expref: 276 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.840681:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff880092a25200) 00010000:00010000:2.0:1746065079.840684:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.840686:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3c00, rc 0) 00000100:00100000:2.0:1746065079.840730:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+276:27897:x1830881261417472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 176us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.840736:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12157 00000100:00100000:0.0:1746065079.841129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.841193:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261417728 00000100:00100000:3.0:1746065079.841198:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261417728 00000100:00100000:3.0:1746065079.841222:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4186 00000100:00100000:3.0:1746065079.841228:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+276:26180:x1830881261417728:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065079.841409:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261417728:12345-192.168.202.27@tcp:35:bash.0 Request processed in 181us (280us total) trans 4294975519 rc 0/0 00000100:00100000:3.0:1746065079.841414:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4186 00000100:00100000:0.0:1746065079.843465:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.843661:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261417984 00000100:00100000:3.0:1746065079.843667:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261417984 00000100:00100000:3.0:1746065079.843708:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4187 00000100:00100000:3.0:1746065079.843715:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27897:x1830881261417984:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065079.843910:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x33a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065079.843972:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2409, 64 off199464 00000040:00080000:3.0:1746065079.843993:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2413, 64 off199896 00000040:00080000:3.0:1746065079.844002:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2414, 64 off199960 00000040:00080000:3.0:1746065079.844010:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2410, 64 off199528 00010000:00010000:3.0:1746065079.844053:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065079.844065:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.844074:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.844080:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.844084:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.844089:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065079.844117:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065079.844256:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27897:x1830881261417984:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 541us (797us total) trans 4294975520 rc 0/0 00000100:00100000:3.0:1746065079.844262:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4187 00010000:00010000:1.0:1746065079.844421:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065079.844426:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.844431:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04a000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065079.844434:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.844439:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.844449:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33a:0x0].0x0 (ffff880092a25200) 00010000:00010000:1.0:1746065079.844451:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065079.844454:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.844458:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1462412 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065079.844482:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.844483:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065079.844485:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065079.851757:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.852259:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261418112 00000100:00100000:0.0:1746065079.852267:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261418112 00000100:00100000:0.0:1746065079.852321:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12158 00000100:00100000:0.0:1746065079.852328:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27900:x1830881261418112:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1746065079.852348:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065079.852365:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462419 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c93a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.852418:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065079.852428:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852437:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852447:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065079.852452:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852457:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852516:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065079.852528:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852533:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065079.852581:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33b:0x0]: returning size 5 00000004:00200000:0.0:1746065079.852584:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065079.852598:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852607:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852613:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852617:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852625:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852630:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852635:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.852638:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852643:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852652:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009867e400) 00010000:00010000:0.0:1746065079.852655:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.852658:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852662:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462420 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852688:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852693:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852698:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852702:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065079.852704:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852712:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852718:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009867e000) 00010000:00010000:0.0:1746065079.852720:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065079.852722:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852726:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539e00/0xad6b7ddc1462427 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065079.852749:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc1462419 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c93a expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.852760:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c93a expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.852766:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:0.0:1746065079.852768:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.852770:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:0.0:1746065079.852846:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27900:x1830881261418112:12345-192.168.202.27@tcp:101:rm.0 Request processed in 518us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.852852:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12158 00000100:00100000:0.0:1746065079.855763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.856220:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261418368 00000100:00100000:2.0:1746065079.856228:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261418368 00000100:00100000:2.0:1746065079.856273:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12159 00000100:00100000:2.0:1746065079.856280:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27900:x1830881261418368:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065079.856322:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065079.856344:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14623ef lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c91e expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.856364:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538c00/0xad6b7ddc146242e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c93a expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.856373:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc14623c5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c909 expref: 277 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.856381:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880095561500) 00010000:00010000:2.0:1746065079.856388:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.856406:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.856415:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856423:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856430:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.856435:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856440:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856501:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.856507:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856512:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:2.0:1746065079.856699:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2415, 64 off200024 00000040:00080000:2.0:1746065079.856715:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2411, 64 off199592 00000040:00080000:2.0:1746065079.856723:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2412, 64 off199656 00000040:00080000:2.0:1746065079.856731:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2416, 64 off200088 00010000:00010000:2.0:1746065079.856766:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.856795:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856802:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856810:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856815:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856820:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856831:0:7203:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065079.856844:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856848:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856853:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856858:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.856861:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856866:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856872:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880097e34300) 00010000:00010000:2.0:1746065079.856875:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065079.856877:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856881:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462443 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856961:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856966:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856970:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856974:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856977:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.856979:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856983:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856989:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25a00) 00010000:00010000:2.0:1746065079.856991:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.856993:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.856996:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc1462435 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065079.857004:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800957db100 reply state ffff88012ed04000 transno 4294975521 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.857011:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.857015:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:2.0:1746065079.857018:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.857020:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065079.857071:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27900:x1830881261418368:12345-192.168.202.27@tcp:36:rm.0 Request processed in 790us (1314us total) trans 4294975521 rc 0/0 00000100:00100000:2.0:1746065079.857077:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12159 00010000:00010000:3.0:1746065079.857719:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.857725:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.857730:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800906d0a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.857733:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.857738:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.857745:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33b:0x0].0x0 (ffff880097e34300) 00010000:00010000:3.0:1746065079.857750:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746065079.857752:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 1/0,0 mode: --/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.857756:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146244a lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.857801:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.857803:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.857804:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.860190:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.860660:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261418624 00000100:00100000:3.0:1746065079.860668:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261418624 00000100:00100000:3.0:1746065079.860715:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12160 00000100:00100000:3.0:1746065079.860722:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27901:x1830881261418624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.860747:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.860763:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1462451 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c941 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.862077:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.862090:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862099:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862107:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.862112:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862116:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862147:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862152:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862157:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862162:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862167:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.862171:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862176:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862184:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4939900) 00010000:00010000:3.0:1746065079.862186:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.862189:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862194:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462458 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862206:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862210:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862213:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862217:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.862218:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862222:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862227:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.862229:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.862231:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862238:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146245f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.862261:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1462451 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c941 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.862267:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1462451 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c941 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.862277:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:3.0:1746065079.862338:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27901:x1830881261418624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1616us (2154us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.862346:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12160 00000100:00100000:0.0:1746065079.866978:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.867056:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261418752 00000100:00100000:3.0:1746065079.867064:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261418752 00000100:00100000:3.0:1746065079.867109:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12161 00000100:00100000:3.0:1746065079.867116:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27901:x1830881261418752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.867133:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.867148:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462466 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c948 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.867208:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.867217:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867226:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867238:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.867243:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867247:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867275:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867280:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867284:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867289:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867429:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.867434:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867440:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867449:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:3.0:1746065079.867452:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.867455:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.867460:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc146246d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.872983:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.872996:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.873002:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.873006:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.873010:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.873016:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.873036:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.873039:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.873042:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.873046:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc1462474 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.873112:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462466 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c948 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.873119:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462466 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c948 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.873133:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46200, rc 0) 00000100:00100000:3.0:1746065079.873209:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27901:x1830881261418752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6092us (6238us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.873217:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12161 00000100:00100000:0.0:1746065079.878966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.880994:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261418880 00000100:00100000:3.0:1746065079.881004:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261418880 00000100:00100000:3.0:1746065079.881087:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12162 00000100:00100000:3.0:1746065079.881096:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27902:x1830881261418880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.881114:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.881131:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146247b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c94f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.881181:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.881191:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.881199:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.881206:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.881211:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.881216:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882130:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882137:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882145:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882150:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882155:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.882158:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882163:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882174:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065079.882177:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.882180:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882184:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462482 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882196:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882200:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882204:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882208:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.882210:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882217:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882223:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.882225:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.882227:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882231:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462489 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.882259:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146247b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c94f expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.882267:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146247b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c94f expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.883661:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:3.0:1746065079.883736:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27902:x1830881261418880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2638us (4774us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065079.883744:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12162 00000100:00100000:0.0:1746065079.888019:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.888074:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261419008 00000100:00100000:2.0:1746065079.888083:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261419008 00000100:00100000:2.0:1746065079.888133:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12163 00000100:00100000:2.0:1746065079.888140:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27902:x1830881261419008:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.888156:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.888182:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1462490 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c956 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.888235:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.888244:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888253:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888261:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.888266:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888271:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888950:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888961:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888966:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888971:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888975:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.888978:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888983:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.888991:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065079.888994:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.888996:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889001:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1462497 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889331:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889338:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889342:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889347:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.889349:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889354:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889360:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:2.0:1746065079.889362:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.889364:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889369:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc146249e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.889393:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1462490 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c956 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.889399:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1462490 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c956 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.889408:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:2.0:1746065079.889450:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27902:x1830881261419008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1311us (1438us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.889457:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12163 00000100:00100000:0.0:1746065079.893868:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.893958:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261419264 00000100:00100000:2.0:1746065079.893967:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261419264 00000100:00100000:2.0:1746065079.894013:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12164 00000100:00100000:2.0:1746065079.894021:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27903:x1830881261419264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.894037:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.894064:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc14624a5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c95d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.894107:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.894123:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261419392 00000100:00100000:3.0:1746065079.894126:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261419392 00010000:00010000:2.0:1746065079.894129:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065079.894146:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12165 00000100:00100000:3.0:1746065079.894151:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27902:x1830881261419392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.894157:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.894163:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c964 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.894190:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46600/0xad6b7ddc14624ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.894201:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46600/0xad6b7ddc14624ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.894209:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46600/0xad6b7ddc14624ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.894543:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.894553:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.894573:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065079.894579:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.894583:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895135:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895142:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895147:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895152:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895155:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.895158:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895167:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895176:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:2.0:1746065079.895178:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.895181:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895185:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc14624ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895195:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895199:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895203:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895206:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.895208:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895212:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895216:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:2.0:1746065079.895218:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.895220:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895224:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc14624c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065079.895456:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc14624a5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c95d expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.895463:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc14624a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c95d expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.895472:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2a00, rc 0) 00000100:00100000:2.0:1746065079.895626:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27903:x1830881261419264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1604us (1764us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065079.895634:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12164 00000004:00200000:3.0:1746065079.896126:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065079.896131:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065079.896164:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c964 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.896621:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46600/0xad6b7ddc14624ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c964 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.896629:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:3.0:1746065079.896631:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065079.896633:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46600, rc 0) 00000100:00100000:3.0:1746065079.896876:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27902:x1830881261419392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2720us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.896883:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12165 00000100:00100000:0.0:1746065079.905676:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.905764:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261419648 00000100:00100000:3.0:1746065079.905801:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261419648 00000100:00100000:3.0:1746065079.905957:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12166 00000100:00100000:3.0:1746065079.905967:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27902:x1830881261419648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.906055:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.906059:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065079.906081:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46600/0xad6b7ddc14624ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c964 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.906109:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34d00) 00010000:00010000:3.0:1746065079.906117:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065079.906126:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc14624c8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c96b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.906198:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.906208:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906214:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906222:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.906227:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906231:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906576:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.906583:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906589:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.906597:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 0 00010000:00010000:3.0:1746065079.906617:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906622:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906627:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906631:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906635:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.906638:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906642:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906649:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4e2800) 00010000:00010000:3.0:1746065079.906651:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.906653:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906657:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc14624cf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:3.0:1746065079.906665:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077dc00 reply state ffff88013520e000 transno 4294975522 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906671:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.906679:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.906681:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065079.906684:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065079.906701:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc14624c8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.906714:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.906720:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff8800ac4e2900) 00010000:00010000:3.0:1746065079.906722:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.906724:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46400, rc 0) 00000100:00100000:3.0:1746065079.906766:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27902:x1830881261419648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 800us (1098us total) trans 4294975522 rc 0/0 00000100:00100000:3.0:1746065079.906791:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12166 00000100:00100000:0.0:1746065079.909532:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.909804:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261419904 00000100:00100000:3.0:1746065079.909815:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261419904 00000100:00100000:3.0:1746065079.909861:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12167 00000100:00100000:3.0:1746065079.909879:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27902:x1830881261419904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.909897:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.909911:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc14624eb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c972 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.909999:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.910009:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.910019:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.910043:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.910051:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 282 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.910061:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262635776:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.910142:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.914976:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262635776:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.914995:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065079.915128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.915269:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261420160 00000100:00100000:3.0:1746065079.915274:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261420160 00000100:00100000:3.0:1746065079.915313:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12168 00000100:00100000:3.0:1746065079.915319:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27904:x1830881261420160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.915335:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.915348:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc14624f9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c979 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.915425:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065079.915435:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915444:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065079.915452:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 0 00010000:00010000:3.0:1746065079.915507:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915512:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915517:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915521:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.915524:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915529:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915538:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff8800ac4e2900) 00010000:00010000:3.0:1746065079.915540:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065079.915543:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915547:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462500 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.915585:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc14624f9 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c979 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.915592:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc14624f9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c979 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.915600:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47e00, rc 0) 00000100:00100000:3.0:1746065079.915648:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27904:x1830881261420160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 328us (519us total) trans 4294975523 rc 301/301 00000100:00100000:3.0:1746065079.915653:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12168 00000100:00100000:0.0:1746065079.915918:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.916725:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261420288 00000100:00100000:3.0:1746065079.916729:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261420288 00010000:00010000:3.0:1746065079.916747:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 284 pid: 7205 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.916831:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3607 00000100:00100000:3.0:1746065079.916838:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+284:2005:x1830881261420288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.916847:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.916851:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 284 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.916860:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 284 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.916873:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc14624dd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c96b expref: 284 pid: 7205 timeout: 775 lvb_type: 0 00010000:00010000:3.0:1746065079.916882:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff8800ac4e2900) 00010000:00010000:3.0:1746065079.916885:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.916892:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.916901:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.917591:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.917630:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+283:2005:x1830881261420288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 791us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.917636:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3607 00010000:00010000:2.0:1746065079.918783:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.918791:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065079.918811:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 0 00000004:00080000:2.0:1746065079.918965:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x362:0x0], index 0: 0 00000004:00080000:2.0:1746065079.918972:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x363:0x0], index 1: 0 00000004:00080000:2.0:1746065079.918975:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x364:0x0], index 1: 0 00000004:00080000:2.0:1746065079.918978:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x363:0x0], index 0: 0 00010000:00010000:2.0:1746065079.919062:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919068:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919072:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919080:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.919083:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919087:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919096:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff8800ac4e2900) 00010000:00010000:2.0:1746065079.919099:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065079.919101:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919105:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47800/0xad6b7ddc14624f2 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.919141:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc14624eb lrc: 1/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c972 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.919147:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc14624eb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c972 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.919157:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46200, rc 0) 00000100:00100000:2.0:1746065079.919203:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27902:x1830881261419904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9334us (9676us total) trans 4294975524 rc 301/301 00000100:00100000:2.0:1746065079.919209:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12167 00000100:00100000:0.0:1746065079.921114:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.921189:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261420544 00000100:00100000:2.0:1746065079.921196:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261420544 00000100:00100000:2.0:1746065079.921429:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4188 00000100:00100000:2.0:1746065079.921437:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27902:x1830881261420544:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.921728:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27902:x1830881261420544:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 284us (610us total) trans 4294975525 rc 0/0 00000100:00100000:2.0:1746065079.921733:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4188 00000100:00100000:0.0:1746065079.925240:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.925430:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.925509:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261420800 00000100:00100000:2.0:1746065079.925516:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261420800 00000100:00100000:2.0:1746065079.925547:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4189 00000100:00100000:2.0:1746065079.925552:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27902:x1830881261420800:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.925683:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261420928 00000100:00100000:3.0:1746065079.925687:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261420928 00000100:00100000:3.0:1746065079.925721:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12169 00000100:00100000:3.0:1746065079.925727:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27904:x1830881261420928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.925736:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.925751:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462515 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c980 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.925832:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146251c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.925844:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146251c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.925853:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146251c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065079.925871:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 0 00000004:00200000:3.0:1746065079.925874:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.925886:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146251c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.925904:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46400/0xad6b7ddc1462515 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c980 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.925932:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146251c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c980 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.925932:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27902:x1830881261420800:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 379us (699us total) trans 4294975526 rc 0/0 00010000:00010000:3.0:1746065079.925938:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00000100:00100000:2.0:1746065079.925939:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4189 00010000:00010000:3.0:1746065079.925941:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.925943:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47e00, rc 0) 00000100:00100000:3.0:1746065079.925966:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27904:x1830881261420928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 239us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.925970:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12169 00000100:00100000:0.0:1746065079.929395:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.929444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.929447:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261421184 00000100:00100000:1.0:1746065079.929454:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261421184 00000100:00100000:3.0:1746065079.929690:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12170 00000100:00100000:3.0:1746065079.929698:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261421184:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.929717:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.929731:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462523 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c987 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.929802:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261421312 00000100:00100000:2.0:1746065079.929806:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261421312 00000100:00100000:2.0:1746065079.929831:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8560 00000100:00100000:2.0:1746065079.929835:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261421312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.929841:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.929853:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c98e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.929857:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.929867:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00002000:00010000:2.0:1746065079.929869:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.929874:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.929879:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.929880:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.929881:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.929886:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.929886:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 41 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.929892:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.929896:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 41 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065079.929908:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c000, rc 0) 00010000:00010000:3.0:1746065079.929925:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc146253f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.929930:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc146253f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.929934:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc146253f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065079.929940:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261421312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 105us (584us total) trans 0 rc 0/0 00000004:00200000:3.0:1746065079.929941:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 0 00000100:00100000:2.0:1746065079.929945:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8560 00010000:00010000:3.0:1746065079.929996:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930002:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930007:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930011:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930016:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.930019:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930024:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930032:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbdd00) 00010000:00010000:3.0:1746065079.930035:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.930038:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930042:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46800/0xad6b7ddc1462531 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930052:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930056:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930060:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930063:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.930065:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930069:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930074:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.930076:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.930078:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930082:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462538 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.930107:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47200/0xad6b7ddc1462523 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c987 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.930119:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc146253f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c987 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.930124:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.930126:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.930128:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:3.0:1746065079.930154:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261421184:12345-192.168.202.27@tcp:101:bash.0 Request processed in 458us (760us total) trans 4294975527 rc 0/0 00000100:00100000:3.0:1746065079.930159:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12170 00000100:00100000:0.0:1746065079.930732:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.931145:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261421440 00000100:00100000:3.0:1746065079.931149:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261421440 00000100:00100000:3.0:1746065079.931183:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8561 00000100:00100000:3.0:1746065079.931189:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881261421440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.931197:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.931206:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c995 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065079.931219:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.931227:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.931229:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.931233:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 29 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.931242:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 29 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065079.931248:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47800, rc 0) 00000100:00100000:3.0:1746065079.931712:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881261421440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 522us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.931720:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8561 00000100:00100000:0.0:1746065079.933527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.933934:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.934081:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261421568 00000100:00100000:3.0:1746065079.934087:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261421568 00000100:00100000:3.0:1746065079.934128:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 554 00000100:00100000:3.0:1746065079.934133:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+287:2004:x1830881261421568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.934143:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.934159:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46c00/0xad6b7ddc146253f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c987 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.934173:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.934176:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065079.934210:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+286:2004:x1830881261421568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.934216:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 554 00000100:00100000:2.0:1746065079.934353:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261421824 00000100:00100000:2.0:1746065079.934356:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261421824 00000100:00100000:2.0:1746065079.934381:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4190 00000100:00100000:2.0:1746065079.934386:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27904:x1830881261421824:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.934502:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27904:x1830881261421824:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 116us (569us total) trans 4294975528 rc 0/0 00000100:00100000:2.0:1746065079.934507:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4190 00000100:00100000:0.0:1746065079.934672:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.934808:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261421952 00000100:00100000:1.0:1746065079.934812:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261421952 00000100:00100000:1.0:1746065079.934840:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12171 00000100:00100000:1.0:1746065079.934844:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261421952:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.934852:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.934860:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1462554 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c99c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.934878:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146255b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.934888:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146255b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.934895:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146255b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.934949:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1462554 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c99c expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.934963:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146255b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c99c expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.934968:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065079.934970:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065079.934972:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a6cd000, rc 0) 00000100:00100000:1.0:1746065079.934993:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261421952:12345-192.168.202.27@tcp:101:bash.0 Request processed in 148us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.934997:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12171 00000100:00100000:0.0:1746065079.936259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.936595:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261422208 00000100:00100000:2.0:1746065079.936600:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261422208 00000100:00100000:2.0:1746065079.936636:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12172 00000100:00100000:2.0:1746065079.936642:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261422208:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065079.936674:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.936686:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc146251c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c980 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.936697:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.936700:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.936829:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.936837:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.936845:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:2.0:1746065079.936873:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975529 00000004:00010000:2.0:1746065079.936888:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077c000 reply state ffff88009a901000 transno 4294975530 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.936895:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.936899:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.936902:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065079.936904:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065079.936947:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261422208:12345-192.168.202.27@tcp:36:bash.0 Request processed in 305us (691us total) trans 4294975530 rc 0/0 00000100:00100000:2.0:1746065079.936952:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12172 00000020:00080000:2.0:1746065079.936955:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065079.937107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.937279:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261422464 00000100:00100000:1.0:1746065079.937283:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261422464 00000100:00100000:1.0:1746065079.937320:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12173 00000100:00100000:1.0:1746065079.937326:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27904:x1830881261422464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.937334:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.937344:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131046400/0xad6b7ddc1462569 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9a3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.937382:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.937388:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.937393:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.937401:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.937405:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.937410:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.937717:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc146257e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.937723:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc146257e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.937728:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc146257e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065079.937734:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 0 00010000:00010000:1.0:1746065079.937766:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938159:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938166:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938171:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938175:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f877000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.938178:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938184:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938192:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009af4d900) 00010000:00010000:1.0:1746065079.938194:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.938196:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938200:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc1462570 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938207:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938211:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938215:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938218:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091bae800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.938220:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938224:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938228:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:1.0:1746065079.938230:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.938232:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938236:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae800/0xad6b7ddc1462577 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.938258:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131046400/0xad6b7ddc1462569 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9a3 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.938270:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc146257e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9a3 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.938275:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065079.938276:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065079.938278:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bae600, rc 0) 00000100:00100000:1.0:1746065079.938826:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27904:x1830881261422464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1497us (1717us total) trans 4294975531 rc 0/0 00000100:00100000:1.0:1746065079.938833:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12173 00000100:00100000:0.0:1746065079.939647:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.939806:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261422592 00000100:00100000:1.0:1746065079.939812:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261422592 00000100:00100000:1.0:1746065079.939846:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12174 00000100:00100000:1.0:1746065079.939852:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261422592:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.939869:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.939878:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc146258c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9aa expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.939907:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc146258c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9aa expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.939916:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc146258c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9aa expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.939927:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065079.939929:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065079.939931:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf200, rc 0) 00000100:00100000:1.0:1746065079.939953:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261422592:12345-192.168.202.27@tcp:101:bash.0 Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.939958:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12174 00000100:00100000:0.0:1746065079.941400:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.941475:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261422848 00000100:00100000:2.0:1746065079.941480:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261422848 00000100:00100000:2.0:1746065079.941509:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4191 00000100:00100000:2.0:1746065079.941514:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27904:x1830881261422848:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065079.941658:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27904:x1830881261422848:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 143us (261us total) trans 4294975532 rc 0/0 00000100:00100000:2.0:1746065079.941663:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4191 00000100:00100000:0.0:1746065079.942236:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.942354:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261423104 00000100:00100000:2.0:1746065079.942357:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261423104 00000100:00100000:2.0:1746065079.942384:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12175 00000100:00100000:2.0:1746065079.942389:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261423104:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065079.942401:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.942403:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746065079.942418:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc146258c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9aa expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.942432:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc146257e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9a3 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.942439:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.942443:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065079.942448:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462593 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9b1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.942473:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc146259a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.942481:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc146259a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.942488:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc146259a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065079.942622:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2413, 88 off199744 00000004:00080000:2.0:1746065079.942626:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675960852295ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065079.943059:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2417, 88 off200176 00000004:00080000:2.0:1746065079.943065:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675961291062ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.943203:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2418, 88 off200264 00000004:00080000:2.0:1746065079.943206:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 675961432805ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065079.943215:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2414, 88 off199832 00000004:00080000:2.0:1746065079.943218:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675961444207ns, next at 676590652783ns, rc = 0 00000100:00100000:0.0:1746065079.946056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.946139:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261423360 00000100:00100000:1.0:1746065079.946145:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261423360 00000100:00100000:1.0:1746065079.946179:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12176 00000100:00100000:1.0:1746065079.946187:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27904:x1830881261423360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.946205:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.946219:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14625a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9b8 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.946287:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.946304:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946323:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946333:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.946338:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946342:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946838:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.946846:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946851:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065079.946858:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 2 00010000:00010000:1.0:1746065079.946908:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946913:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946918:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946922:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091bae200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.946924:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946933:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946940:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065079.946942:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746065079.946946:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946950:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae200/0xad6b7ddc14625b6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946960:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946964:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946968:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946971:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946975:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baee00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.946977:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946981:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946986:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009af4dc00) 00010000:00010000:1.0:1746065079.946987:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.946989:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946993:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baee00/0xad6b7ddc14625a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.946998:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947001:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947004:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947008:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.947010:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947014:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947018:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:1.0:1746065079.947020:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.947021:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947025:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baea00/0xad6b7ddc14625af lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.947048:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14625a1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9b8 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.947054:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14625a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9b8 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.947067:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baec00, rc 0) 00000001:00080000:3.0:1746065079.947756:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975533 is committed 00000004:00080000:3.0:1746065079.947762:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1621 committed 00000100:00100000:1.0:1746065079.947800:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27904:x1830881261423360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1610us (1746us total) trans 4294975534 rc 301/301 00000100:00100000:1.0:1746065079.947806:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12176 00000004:00080000:3.0:1746065079.948086:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1631 committed 00000004:00080000:3.0:1746065079.948343:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1630 committed 00000004:00080000:3.0:1746065079.948346:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1620 committed 00010000:00010000:3.0:1746065079.948375:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.948382:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.948387:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.948392:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.948395:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.948400:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.948407:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.948410:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.948412:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.948416:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3600/0xad6b7ddc146243c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065079.948454:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262635904:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.948491:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065079.948568:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc146259a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9b1 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.948574:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.948576:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.948584:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462593 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9b1 expref: 281 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065079.948594:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc146259a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9b1 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.948609:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.948611:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065079.948612:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0e00, rc 0) 00000100:00100000:2.0:1746065079.948624:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262636416:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.948641:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.948650:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636032:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.948654:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065079.948658:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262636288:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.948667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.948680:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636544:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.948681:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262635904 00000100:00100000:2.0:1746065079.948685:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262635904 00000100:00100000:1.0:1746065079.948692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.948703:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636416 00000100:00100000:1.0:1746065079.948704:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065079.948705:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636416 00000100:00100000:1.0:1746065079.948707:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636160:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.948713:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636032 00000100:00100000:2.0:1746065079.948715:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636032 00000100:00100000:1.0:1746065079.948719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065079.948882:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948888:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948892:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948896:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.948898:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948902:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948909:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34100) 00010000:00010000:3.0:1746065079.948911:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.948912:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948919:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14624d6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948929:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948934:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948938:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948941:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.948943:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948946:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948951:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.948952:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.948954:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.948958:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1462562 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065079.949071:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262637184:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.949145:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636672:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.949160:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.949230:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636544 00000100:00100000:2.0:1746065079.949233:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636544 00000100:00100000:2.0:1746065079.949248:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636160 00000100:00100000:2.0:1746065079.949250:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636160 00000100:00100000:2.0:1746065079.949258:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8562 00000100:00100000:2.0:1746065079.949262:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+38:3762:x1830881262635904:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.949278:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:862 count 1 00010000:00010000:2.0:1746065079.949291:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.949302:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.949309:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.949318:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.949321:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.949340:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.949350:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 28 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.949374:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8563 00000100:00100000:3.0:1746065079.949380:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3762:x1830881262636416:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065079.949391:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:863 count 1 00002000:00010000:3.0:1746065079.949404:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.949408:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949415:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.949416:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.949419:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949427:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949433:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949439:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949451:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065079.949592:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+39:3762:x1830881262636416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 212us (949us total) trans 21474839811 rc 0/0 00000100:00100000:3.0:1746065079.949598:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8563 00000100:00100000:3.0:1746065079.949609:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8564 00000100:00100000:3.0:1746065079.949613:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+72:3759:x1830881262636032:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065079.949624:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:863 count 1 00010000:00010000:3.0:1746065079.949636:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949644:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 40 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949654:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065079.949655:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065079.949657:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949671:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 40 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949679:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 40 pid: 3067 timeout: 775 lvb_type: 0 00000100:00100000:3.0:1746065079.949687:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262637568:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.949722:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065079.949735:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8565 00000100:00100000:3.0:1746065079.949740:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+72:3759:x1830881262636544:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065079.949749:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:866 count 1 00002000:00010000:3.0:1746065079.949759:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.949763:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949769:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.949770:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.949789:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949797:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949804:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949809:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949819:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065079.949950:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+73:3759:x1830881262636544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 209us (1255us total) trans 17179872533 rc 0/0 00000100:00100000:3.0:1746065079.949955:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8565 00000100:00100000:3.0:1746065079.949964:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8566 00000100:00100000:3.0:1746065079.949968:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+72:3759:x1830881262636160:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065079.949977:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:864 count 1 00002000:00010000:3.0:1746065079.949988:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.949992:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.949997:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.949998:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.950001:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950007:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950012:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950018:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950027:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1746065079.950110:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+73:3759:x1830881262636160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 140us (1389us total) trans 17179872534 rc 0/0 00000100:00100000:3.0:1746065079.950114:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8566 00010000:00010000:3.0:1746065079.950127:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1746065079.950132:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950137:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.950140:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950146:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950155:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950161:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc14625cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.950163:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262637440:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.950170:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065079.950173:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950178:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.950180:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950185:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.950187:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065079.950192:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950197:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc14625d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950205:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.950208:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950212:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46200 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:2.0:1746065079.950212:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261423104:12345-192.168.202.27@tcp:101:bash.0 Request processed in 7822us (7977us total) trans 4294975533 rc 0/0 00010000:00010000:3.0:1746065079.950214:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.950218:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12175 00010000:00010000:3.0:1746065079.950220:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950226:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950234:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc14625e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.950242:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.950243:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.950244:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.950248:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.950251:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065079.950646:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636672 00000100:00100000:2.0:1746065079.950650:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636672 00000004:00080000:1.0:1746065079.950651:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cca80/2, rc 0, transno 17179872533 00000100:00100000:1.0:1746065079.950655:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636544:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.950664:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262637056:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.950668:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8567 00000100:00100000:2.0:1746065079.950671:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+73:3759:x1830881262636672:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.950681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065079.950696:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cd500/2, rc 0, transno 17179872534 00000100:00100000:1.0:1746065079.950700:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636160:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065079.950713:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262637312:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065079.950729:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.950740:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065079.950742:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+74:3759:x1830881262636672:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (1580us total) trans 17179872535 rc 0/0 00000100:00100000:1.0:1746065079.950744:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262636928:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.950747:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8567 00000100:00100000:2.0:1746065079.950755:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262637056 00000100:00100000:2.0:1746065079.950757:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262637056 00000100:00100000:1.0:1746065079.950757:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.950764:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262637312 00000100:00100000:2.0:1746065079.950765:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262637312 00000100:00100000:2.0:1746065079.950771:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636928 00000100:00100000:2.0:1746065079.950787:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636928 00000100:00100000:1.0:1746065079.950787:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8568 00000100:00100000:1.0:1746065079.950792:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+41:3759:x1830881262637056:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.950795:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8569 00000100:00100000:2.0:1746065079.950798:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+41:3761:x1830881262637312:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:1.0:1746065079.950804:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:865 count 1 00002000:00010000:1.0:1746065079.950816:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.950820:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.950827:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.950828:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.950831:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.950838:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.950843:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.950844:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.950847:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.950848:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1746065079.950849:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.950850:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.950852:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065079.950858:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.950872:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+42:3761:x1830881262637312:12345-0@lo:2:osp-syn-0-1.0 Request processed in 72us (142us total) trans 21474839812 rc 0/0 00000100:00100000:2.0:1746065079.950892:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8569 00000100:00100000:2.0:1746065079.950902:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8570 00000100:00100000:2.0:1746065079.950906:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+42:3761:x1830881262636928:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065079.950914:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:864 count 1 00010000:00010000:2.0:1746065079.950923:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.950930:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+42:3759:x1830881262637056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 139us (249us total) trans 21474839813 rc 0/0 00010000:00010000:2.0:1746065079.950931:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.950935:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8568 00010000:00010000:2.0:1746065079.950937:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.950938:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065079.950940:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.950955:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746065079.950957:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c459c00/2, rc 0, transno 21474839812 00000100:00100000:1.0:1746065079.950960:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262637312:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1746065079.950964:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 28 pid: 10219 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.950969:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.950971:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262637696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065079.950982:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262636800:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.950994:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065079.950994:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065079.951002:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636288 00000100:00100000:2.0:1746065079.951005:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636288 00000004:00080000:1.0:1746065079.951008:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c458000/2, rc 0, transno 21474839811 00000100:00100000:1.0:1746065079.951010:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262636416:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.951014:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262636800 00000100:00100000:2.0:1746065079.951015:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262636800 00000100:00100000:1.0:1746065079.951021:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8571 00000100:00100000:2.0:1746065079.951024:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8572 00000100:00100000:1.0:1746065079.951025:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+75:3762:x1830881262636288:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065079.951027:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+75:3762:x1830881262636800:12345-0@lo:2:osp-syn-1-1.0 00002000:00080000:1.0:1746065079.951034:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:865 count 1 00010000:00010000:1.0:1746065079.951042:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.951051:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.951056:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.951057:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065079.951059:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065079.951062:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.951064:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.951066:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.951067:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.951069:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065079.951072:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.951079:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746065079.951087:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262637824:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.951088:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+76:3762:x1830881262636800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 60us (93us total) trans 17179872536 rc 0/0 00000100:00100000:2.0:1746065079.951095:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8572 00000100:00100000:1.0:1746065079.951103:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1746065079.951116:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45a680/2, rc 0, transno 21474839813 00000100:00100000:2.0:1746065079.951118:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262637056:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065079.951120:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cf480/2, rc 0, transno 17179872536 00000100:00100000:1.0:1746065079.951123:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262636800:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065079.951125:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982ce680/2, rc 0, transno 17179872535 00000100:00100000:2.0:1746065079.951127:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636672:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065079.951811:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065079.952111:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262637184 00000100:00100000:1.0:1746065079.952115:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262637184 00000100:00100000:1.0:1746065079.952701:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8573 00000100:00100000:1.0:1746065079.952709:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+42:3760:x1830881262637184:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.953088:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.953104:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261423616 00000100:00100000:0.0:1746065079.953107:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261423616 00000100:00100000:0.0:1746065079.953131:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4192 00000100:00100000:0.0:1746065079.953135:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+277:27904:x1830881261423616:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065079.953244:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27904:x1830881261423616:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 107us (157us total) trans 4294975535 rc 0/0 00000100:00100000:0.0:1746065079.953252:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4192 00000100:00100000:1.0:1746065079.953511:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+43:3760:x1830881262637184:12345-0@lo:2:osp-syn-0-1.0 Request processed in 804us (1701us total) trans 21474839814 rc 0/0 00000100:00100000:1.0:1746065079.953518:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8573 00010000:00010000:3.0:1746065079.954760:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.954767:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.954788:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.954792:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.954799:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.954813:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.954818:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14625e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.954832:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.954834:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.954836:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065079.955085:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45bb80/2, rc 0, transno 21474839814 00000100:00100000:0.0:1746065079.955092:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262637184:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.956134:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262637440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.956152:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065079.956186:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262637696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065079.956194:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.956347:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262637568:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.956361:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065079.956401:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262637824:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065079.956624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.956653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.956667:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.956686:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.956700:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261423744 00000100:00100000:0.0:1746065079.956704:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261423744 00010000:00010000:0.0:1746065079.956727:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 41 pid: 3067 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.956744:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424000 00000100:00100000:0.0:1746065079.956747:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424000 00010000:00010000:0.0:1746065079.956755:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 29 pid: 10219 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.956764:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261423872 00000100:00100000:0.0:1746065079.956766:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261423872 00010000:00010000:0.0:1746065079.956786:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 30 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746065079.956801:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3608 00000100:00100000:0.0:1746065079.956806:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261423744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.956816:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.956820:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 41 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.956829:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 41 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.956846:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1462260 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c892 expref: 41 pid: 3067 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.956855:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.956858:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.956861:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.956867:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.956884:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.956913:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261423744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.956918:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3608 00000100:00100000:0.0:1746065079.956930:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3609 00000100:00100000:0.0:1746065079.956935:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261424000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.956942:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.956945:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 30 pid: 10219 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.956953:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 30 pid: 10219 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.956969:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc1462404 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c92c expref: 30 pid: 10219 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.956976:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.956977:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.956979:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.956985:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.956995:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.957008:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261424000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.957013:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3609 00000100:00100000:0.0:1746065079.957044:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3610 00010000:00010000:1.0:1746065079.957121:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065079.957188:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424256 00000100:00100000:3.0:1746065079.957191:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424256 00000100:00100000:3.0:1746065079.957209:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8574 00000100:00100000:3.0:1746065079.957213:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:26180:x1830881261424256:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065079.957224:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.957233:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9bf expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065079.957248:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065079.957258:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.957259:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065079.957263:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957273:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957280:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47200, rc 0) 00000100:00100000:3.0:1746065079.957296:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:26180:x1830881261424256:12345-192.168.202.27@tcp:101:bash.0 Request processed in 83us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.957300:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8574 00010000:00010000:3.0:1746065079.957315:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957322:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957330:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957336:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957347:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065079.957526:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262636032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7911us (8857us total) trans 17179872537 rc 0/0 00000100:00100000:3.0:1746065079.957531:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8564 00010000:00010000:3.0:1746065079.957542:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.957547:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957552:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.957567:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957575:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957584:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957594:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc14625d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.957606:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.957607:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.957608:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065079.957627:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cd880/2, rc 0, transno 17179872537 00000100:00100000:3.0:1746065079.957631:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262636032:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065079.957801:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.957808:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.957815:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.957820:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.957841:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065079.958078:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+43:3761:x1830881262636928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7170us (7319us total) trans 21474839815 rc 0/0 00000100:00100000:2.0:1746065079.958084:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8570 00000004:00080000:1.0:1746065079.958122:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c459f80/2, rc 0, transno 21474839815 00000100:00100000:1.0:1746065079.958125:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262636928:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065079.958342:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.958358:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424128 00000100:00100000:2.0:1746065079.958361:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424128 00010000:00010000:2.0:1746065079.958374:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.958388:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3611 00000100:00100000:2.0:1746065079.958392:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261424128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.958397:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.958400:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.958406:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.958417:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14623fd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c925 expref: 40 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:2.0:1746065079.958425:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.958426:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065079.958428:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.958438:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.958459:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065079.958476:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261424128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.958481:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3611 00010000:00010000:1.0:1746065079.958681:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.958688:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.958694:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.958699:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.958883:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065079.959067:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261423872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065079.959074:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065079.959079:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 29 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.959086:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 29 pid: 1880 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746065079.959095:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97a00/0xad6b7ddc14623da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c910 expref: 29 pid: 1880 timeout: 775 lvb_type: 0 00000100:00100000:2.0:1746065079.959335:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.959351:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424384 00000100:00100000:2.0:1746065079.959354:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424384 00000100:00100000:2.0:1746065079.959373:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4193 00000100:00100000:2.0:1746065079.959377:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27904:x1830881261424384:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065079.959452:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27904:x1830881261424384:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 74us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065079.959457:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4193 00010000:00010000:0.0:1746065079.959654:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.959655:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065079.959658:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.959664:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.959685:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065079.959700:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261423872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2652us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.959705:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3610 00010000:00010000:3.0:1746065079.959802:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065079.959806:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959812:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.959815:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959821:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959829:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959834:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c400/0xad6b7ddc14625ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959845:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.959848:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959852:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131018200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.959854:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959859:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959865:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959869:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131018200/0xad6b7ddc14625f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.959881:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.959882:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.959883:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065079.960051:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+76:3762:x1830881262636288:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9024us (9080us total) trans 17179872538 rc 0/0 00000100:00100000:1.0:1746065079.960058:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8571 00010000:00010000:1.0:1746065079.960072:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065079.960285:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cc000/2, rc 0, transno 17179872538 00000100:00100000:0.0:1746065079.960290:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262636288:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065079.960397:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.960404:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.960410:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.960415:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.960433:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065079.960982:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065079.960987:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.960993:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065079.960995:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.961001:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.961012:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.961017:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc14625c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.961027:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.961028:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065079.961029:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065079.961413:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.961484:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424512 00000100:00100000:1.0:1746065079.961495:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424512 00000100:00100000:1.0:1746065079.961521:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8575 00000100:00100000:1.0:1746065079.961526:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+39:26180:x1830881261424512:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065079.961535:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.961548:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9c6 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065079.961569:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065079.961580:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.961581:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065079.961587:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.961596:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.961604:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131019c00, rc 0) 00000100:00100000:1.0:1746065079.962715:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+40:26180:x1830881261424512:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1185us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065079.962723:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8575 00000100:00100000:2.0:1746065079.968380:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+43:3762:x1830881262635904:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19110us (19882us total) trans 21474839816 rc 0/0 00000100:00100000:2.0:1746065079.968391:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8562 00000004:00080000:2.0:1746065079.968454:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c458700/2, rc 0, transno 21474839816 00000100:00100000:2.0:1746065079.968459:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262635904:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065079.974766:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.974832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.974903:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424640 00000100:00100000:2.0:1746065079.974911:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424640 00002000:00010000:2.0:1746065079.974946:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/866 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.974950:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad880 with x1830881261424640 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.974959:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edad880. 00000100:00100000:2.0:1746065079.974982:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261424768 00000100:00100000:2.0:1746065079.974984:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261424768 00002000:00010000:2.0:1746065079.974993:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/867 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.974995:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf800 with x1830881261424768 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.975001:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf800. 00000100:00100000:2.0:1746065079.975012:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1265 00000100:00100000:2.0:1746065079.975018:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261424640:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.975148:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.975151:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065079.975153:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.975154:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065079.975155:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.975189:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261424640:12345-192.168.202.27@tcp:10:bash.0 Request processed in 171us (429us total) trans 21474839817 rc 0/0 00000100:00100000:2.0:1746065079.975197:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1265 00002000:00010000:2.0:1746065079.975201:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/866 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.975202:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad880 with x1830881261424640 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.975205:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edad880. 00000100:00100000:2.0:1746065079.975217:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1266 00000100:00100000:2.0:1746065079.975222:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261424768:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065079.975285:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065079.975287:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065079.975288:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065079.975289:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065079.975291:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065079.975306:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261424768:12345-192.168.202.27@tcp:10:bash.0 Request processed in 83us (473us total) trans 17179872539 rc 0/0 00000100:00100000:2.0:1746065079.975310:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1266 00002000:00010000:2.0:1746065079.975312:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/867 (0->18446744073709551615) 00002000:00100000:2.0:1746065079.975314:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf800 with x1830881261424768 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065079.975317:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf800. 00000100:00100000:0.0:1746065079.975770:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065079.975867:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261425024 00000100:00100000:2.0:1746065079.975871:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261425024 00000100:00100000:2.0:1746065079.975893:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12177 00000100:00100000:2.0:1746065079.975898:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27905:x1830881261425024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065079.975908:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065079.975920:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc146260a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9cd expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.975980:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.975991:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.975999:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976008:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.976013:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976018:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976086:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065079.976093:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976099:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065079.976107:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 2 00010000:00010000:2.0:1746065079.976145:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976150:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976158:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976163:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976168:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.976171:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976177:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976185:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065079.976188:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.976191:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976196:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718e00/0xad6b7ddc1462611 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976206:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976210:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976214:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976218:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065079.976220:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976228:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976233:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34300) 00010000:00010000:2.0:1746065079.976235:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065079.976237:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976240:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718200/0xad6b7ddc1462618 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.976266:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc146260a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.976276:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065079.976280:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.976282:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065079.976284:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:2.0:1746065079.976307:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27905:x1830881261425024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 408us (537us total) trans 4294975536 rc 0/0 00000100:00100000:2.0:1746065079.976312:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12177 00000100:00100000:0.0:1746065079.978767:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.978886:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.978931:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261425280 00000100:00100000:3.0:1746065079.978937:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261425280 00000100:00100000:3.0:1746065079.978968:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261425536 00000100:00100000:3.0:1746065079.978970:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261425536 00000100:00100000:2.0:1746065079.978972:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4194 00000100:00100000:3.0:1746065079.978978:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4195 00000100:00100000:2.0:1746065079.978979:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261425280:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065079.978982:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27905:x1830881261425536:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065079.979226:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27905:x1830881261425536:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 242us (339us total) trans 4294975537 rc 0/0 00000100:00100000:3.0:1746065079.979232:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4195 00000100:00100000:2.0:1746065079.979236:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261425280:12345-192.168.202.27@tcp:35:bash.0 Request processed in 258us (474us total) trans 4294975538 rc 0/0 00000100:00100000:2.0:1746065079.979241:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4194 00000100:00100000:0.0:1746065079.981595:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.981752:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261425792 00000100:00100000:1.0:1746065079.981759:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261425792 00000100:00100000:1.0:1746065079.981832:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12178 00000100:00100000:1.0:1746065079.981837:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27905:x1830881261425792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.981856:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.981871:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146262d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9d4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.981955:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065079.981966:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.981972:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065079.981997:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.982006:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 283 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065079.982928:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262637952:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065079.983138:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065079.987553:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.987597:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262637952:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065079.987611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065079.987617:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065079.987680:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261425920 00000100:00100000:3.0:1746065079.987686:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261425920 00010000:00010000:3.0:1746065079.987712:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 284 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065079.988335:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3612 00000100:00100000:3.0:1746065079.988343:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+284:2005:x1830881261425920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065079.988355:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065079.988361:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 284 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065079.988371:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 284 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065079.988394:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718400/0xad6b7ddc146261f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9cd expref: 284 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065079.988406:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.988411:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.988418:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.988424:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065079.988442:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.988474:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065079.988477:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+283:2005:x1830881261425920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 135us (931us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065079.988480:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065079.988483:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3612 00000004:00200000:1.0:1746065079.988499:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 5 00000100:00100000:3.0:1746065079.988502:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261426048 00000100:00100000:3.0:1746065079.988505:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261426048 00000100:00100000:3.0:1746065079.988522:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12179 00000100:00100000:3.0:1746065079.988525:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27906:x1830881261426048:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1746065079.988536:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.988546:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc1462642 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9db expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.988604:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146262d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.988612:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.988618:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.988624:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.988630:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.988632:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.988636:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.988637:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.988638:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065079.988640:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00010000:00010000:3.0:1746065079.988641:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065079.988663:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27905:x1830881261425792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6826us (7075us total) trans 4294975539 rc 0/0 00000100:00100000:1.0:1746065079.988668:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12178 00010000:00010000:3.0:1746065079.988688:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065079.988694:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.988699:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.988718:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.988727:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 284 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065079.988741:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262638080:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065079.988799:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065079.991420:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.991458:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.991530:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261426176 00000100:00100000:1.0:1746065079.991536:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261426176 00000100:00100000:1.0:1746065079.991582:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12180 00000100:00100000:1.0:1746065079.991588:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27905:x1830881261426176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065079.991605:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065079.991620:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131018200/0xad6b7ddc146265e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9e2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.991686:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.991696:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.991704:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065079.991744:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262638080:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065079.991759:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065079.991760:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261426304 00000100:00100000:2.0:1746065079.991764:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261426304 00010000:00010000:2.0:1746065079.991806:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 287 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065079.991821:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3613 00000100:00100000:2.0:1746065079.991827:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+287:2004:x1830881261426304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065079.991834:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065079.991838:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 287 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065079.991846:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 287 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065079.992132:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1462634 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x33d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9d4 expref: 287 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065079.992144:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065079.992147:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.992153:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.992158:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065079.992163:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.992167:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.992171:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065079.992294:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065079.992484:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065079.992489:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.992496:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992501:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065079.992514:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 5 00000004:00200000:3.0:1746065079.992515:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 5 00000004:00200000:3.0:1746065079.992518:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:0.0:1746065079.992518:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065079.992528:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065079.992528:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.992535:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992543:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992548:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992552:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992566:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992573:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.992577:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992583:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992590:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:3.0:1746065079.992593:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.992595:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992600:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46000/0xad6b7ddc1462649 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992608:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065079.992608:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+286:2004:x1830881261426304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 779us (1148us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065079.992612:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065079.992614:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3613 00010000:00010000:3.0:1746065079.992616:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992619:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065079.992621:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992625:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992630:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:3.0:1746065079.992631:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065079.992634:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992638:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46200/0xad6b7ddc1462650 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.992669:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47e00/0xad6b7ddc1462642 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9db expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.992669:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131018200/0xad6b7ddc146265e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e2 expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.992681:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9db expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.992687:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.992689:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065079.992691:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00010000:00010000:0.0:1746065079.992696:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e2 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065079.992701:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:0.0:1746065079.992702:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065079.992704:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:3.0:1746065079.992723:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27906:x1830881261426048:12345-192.168.202.27@tcp:101:rm.0 Request processed in 4196us (5112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.992728:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12179 00000100:00100000:0.0:1746065079.992814:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27905:x1830881261426176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1225us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065079.992819:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12180 00000100:00100000:2.0:1746065079.996615:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065079.996615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065079.997041:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261426560 00000100:00100000:1.0:1746065079.997049:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261426560 00000100:00100000:1.0:1746065079.997094:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261426816 00000100:00100000:1.0:1746065079.997096:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261426816 00000100:00100000:3.0:1746065079.997099:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12181 00000100:00100000:3.0:1746065079.997107:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091325c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27905:x1830881261426560:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065079.997111:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12182 00000100:00100000:1.0:1746065079.997115:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27906:x1830881261426816:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065079.997133:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.997148:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3200/0xad6b7ddc146266c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9e9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.997156:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1746065079.997172:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc146259a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9b1 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.997199:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1462657 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9db expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.997209:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462673 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065079.997210:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc1462665 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e2 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.997219:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462673 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065079.997226:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462673 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065079.997226:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a6cd000/0xad6b7ddc146255b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c99c expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.997234:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00000004:00200000:3.0:1746065079.997235:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 5 00010000:00010000:1.0:1746065079.997238:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065079.997249:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.997254:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997262:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997269:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.997273:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997278:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.997304:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3200/0xad6b7ddc146266c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e9 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065079.997328:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065079.997333:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997338:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065079.997407:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462673 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e9 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.997413:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.997415:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065079.997417:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2a00, rc 0) 00000100:00100000:3.0:1746065079.997453:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091325c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27905:x1830881261426560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 348us (846us total) trans 4294975540 rc 0/0 00000100:00100000:3.0:1746065079.997459:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12181 00000004:00080000:1.0:1746065079.997469:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x33d:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1746065079.997507:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997514:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997519:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997523:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.997526:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997532:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997538:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065079.997539:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065079.997542:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997545:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857000/0xad6b7ddc146268f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997564:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997568:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997572:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997575:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997579:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065079.997581:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997585:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997590:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065079.997591:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065079.997593:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997597:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462681 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065079.997607:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012edae300 reply state ffff88009fadc000 transno 4294975541 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997612:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065079.997616:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bcc000) 00010000:00010000:1.0:1746065079.997618:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065079.997620:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065079.997646:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27906:x1830881261426816:12345-192.168.202.27@tcp:36:rm.0 Request processed in 529us (1038us total) trans 4294975541 rc 0/0 00000100:00100000:1.0:1746065079.997651:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12182 00000100:00100000:0.0:1746065079.999324:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065079.999473:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261426944 00000100:00100000:3.0:1746065079.999478:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261426944 00000100:00100000:3.0:1746065079.999513:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12183 00000100:00100000:3.0:1746065079.999519:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27905:x1830881261426944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065079.999536:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065079.999546:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3e00/0xad6b7ddc1462696 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9f0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.999593:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3e00/0xad6b7ddc1462696 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9f0 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.999602:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3e00/0xad6b7ddc1462696 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9f0 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065079.999618:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065079.999620:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065079.999622:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3e00, rc 0) 00000100:00100000:3.0:1746065079.999657:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27905:x1830881261426944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 138us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065079.999661:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12183 00000100:00100000:0.0:1746065080.000765:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.001179:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427072 00000100:00100000:2.0:1746065080.001184:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427072 00000100:00100000:2.0:1746065080.001216:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8576 00000100:00100000:2.0:1746065080.001222:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881261427072:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065080.001247:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.001259:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.001266:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065080.001267:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065080.001270:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.001292:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.001307:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 29 pid: 9549 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.001318:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262638208:192.168.202.27@tcp:104: 00000100:00080000:0.0:1746065080.001403:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065080.001877:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.002762:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262638208:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.002794:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.003254:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.003403:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427200 00000100:00100000:2.0:1746065080.003408:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427200 00002000:00100000:2.0:1746065080.003437:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x362:0x0] (0->4) req@ffff88012edaca80 x1830881261427200/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/0 e 0 to 0 dl 1746065091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065080.003445:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaca80 with x1830881261427200 ext(0->4) 00010000:00010000:2.0:1746065080.003451:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 30 pid: 9549 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.003463:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 30 pid: 9549 timeout: 776 lvb_type: 0 00002000:00010000:2.0:1746065080.003469:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edaca80 00000100:00100000:2.0:1746065080.003497:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 216 00000100:00100000:2.0:1746065080.003504:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261427200:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:2.0:1746065080.004693:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261427200:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1185us (1436us total) trans 21474839818 rc 0/0 00000100:00100000:2.0:1746065080.004702:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 216 00002000:00100000:2.0:1746065080.004708:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x362:0x0] (0->4) req@ffff88012edaca80 x1830881261427200/t21474839818(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/448 e 0 to 0 dl 1746065091 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065080.004715:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaca80 with x1830881261427200 ext(0->4) 00010000:00010000:2.0:1746065080.004721:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 32 pid: 9549 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.004732:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 32 pid: 9549 timeout: 776 lvb_type: 0 00002000:00010000:2.0:1746065080.004737:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edaca80 00000100:00100000:0.0:1746065080.006713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.006759:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427328 00000100:00100000:2.0:1746065080.006765:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427328 00010000:00010000:0.0:1746065080.006900:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 32 pid: 9549 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.007449:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3614 00000100:00100000:0.0:1746065080.007458:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261427328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.007471:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065080.007482:0:8352:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1746065080.007484:0:8352:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1746065080.007489:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 32 pid: 9549 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.007499:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 32 pid: 9549 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.007517:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc14625fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9bf expref: 32 pid: 9549 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.007539:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.007541:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.007544:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.007550:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.007708:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065080.007744:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261427328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 288us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.007750:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3614 00010000:00010000:3.0:1746065080.007910:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007918:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007931:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007938:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007944:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007950:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.007954:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007960:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007970:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.007974:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718800/0xad6b7ddc146269d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.008014:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261427072:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 6792us (7251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.008022:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8576 00000100:00100000:0.0:1746065080.008278:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.008602:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427456 00000100:00100000:1.0:1746065080.008607:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427456 00000100:00100000:1.0:1746065080.008649:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12184 00000100:00100000:1.0:1746065080.008656:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27907:x1830881261427456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.008669:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.008682:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc14626a4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9f7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.008727:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.008735:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008741:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008749:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.008754:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008759:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008807:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008812:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008816:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008820:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008824:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.008826:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008830:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008837:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccc00) 00010000:00010000:1.0:1746065080.008839:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.008841:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008845:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14626ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008863:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008868:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008872:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008876:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.008878:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008882:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008888:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bcc000) 00010000:00010000:1.0:1746065080.008890:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.008892:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008896:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc14626b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.008915:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc14626a4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9f7 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.008921:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc14626a4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9f7 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.008930:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:1.0:1746065080.008952:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27907:x1830881261427456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 297us (674us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.008957:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12184 00000100:00080000:0.0:1746065080.009300:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065080.009871:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.009928:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427712 00000100:00100000:3.0:1746065080.009932:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427712 00000100:00100000:3.0:1746065080.009963:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12185 00000100:00100000:3.0:1746065080.009969:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27905:x1830881261427712:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065080.009994:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.010005:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3e00/0xad6b7ddc1462696 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9f0 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.010014:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065080.010016:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.010029:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.010036:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.010042:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065080.010679:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000040:00080000:3.0:1746065080.010750:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2415, 88 off199920 00000004:00080000:3.0:1746065080.010759:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676028984645ns, next at 676590652783ns, rc = 0 00000040:00080000:3.0:1746065080.010808:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2419, 88 off200352 00000004:00080000:3.0:1746065080.010813:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676029039758ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.010828:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2420, 88 off200440 00000004:00080000:3.0:1746065080.010830:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676029056875ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.010839:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2416, 88 off200008 00000004:00080000:3.0:1746065080.010841:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676029067578ns, next at 676590652783ns, rc = 0 00000100:00100000:1.0:1746065080.011020:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427840 00000100:00100000:1.0:1746065080.011025:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427840 00000100:00100000:1.0:1746065080.011050:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12186 00000100:00100000:1.0:1746065080.011055:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27907:x1830881261427840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.011064:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.011074:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc14626c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92c9fe expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.011107:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.011114:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011120:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011127:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.011133:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011137:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011156:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011162:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011170:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011175:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011179:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.011182:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011187:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011193:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9bccd00) 00010000:00010000:1.0:1746065080.011195:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.011198:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011202:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856200/0xad6b7ddc14626c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011210:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011214:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011218:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011222:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.011224:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011232:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011237:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bcc000) 00010000:00010000:1.0:1746065080.011239:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.011241:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011245:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857600/0xad6b7ddc14626ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.011263:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc14626c0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9fe expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.011270:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856000/0xad6b7ddc14626c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9fe expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.011280:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856000, rc 0) 00000100:00100000:1.0:1746065080.011312:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27907:x1830881261427840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 256us (633us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.011317:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12186 00000001:00080000:0.0:1746065080.013867:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975542 is committed 00000004:00080000:0.0:1746065080.013876:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1623 committed 00000004:00080000:0.0:1746065080.013882:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1633 committed 00000004:00080000:0.0:1746065080.013887:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1632 committed 00000004:00080000:0.0:1746065080.013888:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1622 committed 00010000:00010000:3.0:1746065080.013921:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.013930:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.013936:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.013940:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.013944:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.013949:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.013960:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9bcc000) 00010000:00010000:3.0:1746065080.013962:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.013965:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.013970:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1462688 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.014157:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065080.014171:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262638336:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.014259:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262638464:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.014311:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065080.014319:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262638720:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.014529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.014568:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065080.014574:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262638592:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.014591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.014614:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262638464 00000100:00100000:3.0:1746065080.014619:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262638464 00000100:00100000:3.0:1746065080.014656:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262638592 00000100:00100000:3.0:1746065080.014659:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262638592 00000100:00100000:3.0:1746065080.014673:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8577 00000100:00100000:3.0:1746065080.014679:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+43:3759:x1830881262638464:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065080.014804:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.014806:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.014808:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.014810:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.014812:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.014838:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+44:3759:x1830881262638464:12345-0@lo:2:osp-syn-0-1.0 Request processed in 158us (308us total) trans 21474839819 rc 0/0 00000100:00100000:3.0:1746065080.014844:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8577 00000100:00100000:3.0:1746065080.014857:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8578 00000100:00100000:3.0:1746065080.014862:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262638592:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065080.014918:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.014920:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.014922:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.014923:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.014925:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.014945:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+77:3759:x1830881262638592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 83us (353us total) trans 17179872540 rc 0/0 00000100:00100000:3.0:1746065080.014950:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8578 00000004:00080000:3.0:1746065080.014980:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d1f80/2, rc 0, transno 17179872540 00000100:00100000:3.0:1746065080.014984:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262638592:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065080.014994:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d1c00/2, rc 0, transno 21474839819 00000100:00100000:3.0:1746065080.014996:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262638464:0@lo:2:osp-syn-0-1.0 00000004:00010000:3.0:1746065080.015022:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012edac700 reply state ffff880090644000 transno 4294975542 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015032:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015038:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065080.015040:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065080.015043:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065080.015095:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065080.015105:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27905:x1830881261427712:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 5135us (5234us total) trans 4294975542 rc 0/0 00000100:00100000:3.0:1746065080.015112:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12185 00010000:00010000:3.0:1746065080.015128:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015134:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015139:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015143:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.015146:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015152:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015158:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:3.0:1746065080.015160:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.015162:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.015166:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14626b9 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065080.015427:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.015437:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262638336 00000100:00100000:2.0:1746065080.015441:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262638336 00000100:00080000:0.0:1746065080.015455:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065080.015457:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8579 00000100:00080000:0.0:1746065080.015458:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065080.015461:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+44:3761:x1830881262638336:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.015524:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3761:x1830881262638336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 63us (98us total) trans 21474839820 rc 0/0 00000100:00100000:2.0:1746065080.015529:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8579 00000004:00080000:0.0:1746065080.015536:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f0d3480/2, rc 0, transno 21474839820 00000100:00100000:0.0:1746065080.015539:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262638336:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.015542:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.015570:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262638720 00000100:00100000:2.0:1746065080.015573:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262638720 00000100:00100000:2.0:1746065080.015585:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8580 00000100:00100000:2.0:1746065080.015588:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+77:3762:x1830881262638720:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065080.015623:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.015625:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.015627:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.015628:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.015630:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.015646:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+78:3762:x1830881262638720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (103us total) trans 17179872541 rc 0/0 00000100:00100000:2.0:1746065080.015650:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8580 00000004:00080000:2.0:1746065080.015664:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6a00/2, rc 0, transno 17179872541 00000100:00100000:2.0:1746065080.015667:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262638720:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.015846:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.015926:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261427968 00000100:00100000:0.0:1746065080.015930:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261427968 00000100:00100000:0.0:1746065080.015958:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12187 00000100:00100000:0.0:1746065080.015963:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+275:27907:x1830881261427968:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.015972:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.015983:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14626d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca05 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.016014:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14626dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.016021:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14626dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.016028:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14626dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065080.016050:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1746065080.016054:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1746065080.016080:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14626d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca05 expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.016106:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14626dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca05 expref: 276 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.016112:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065080.016114:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1746065080.016116:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:0.0:1746065080.016149:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27907:x1830881261427968:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 185us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.016154:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12187 00000100:00100000:0.0:1746065080.017652:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.017700:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261428096 00000100:00100000:2.0:1746065080.017704:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261428096 00000100:00100000:2.0:1746065080.017922:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12188 00000100:00100000:2.0:1746065080.017930:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+276:27905:x1830881261428096:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.017944:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.017954:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca0c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.017983:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.017992:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 277 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.018004:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065080.018007:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.018009:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:2.0:1746065080.018035:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+277:27905:x1830881261428096:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.018041:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12188 00000100:00100000:0.0:1746065080.020873:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.020893:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261428224 00000100:00100000:1.0:1746065080.020899:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261428224 00000100:00100000:0.0:1746065080.020901:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.020940:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261428352 00000100:00100000:2.0:1746065080.020944:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261428352 00000100:00100000:2.0:1746065080.020973:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12189 00000100:00100000:2.0:1746065080.020979:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27905:x1830881261428352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.020994:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.021011:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc14626ea lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca1a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.021063:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14626f1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.021074:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14626f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.021083:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14626f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.021115:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33d:0x0]: returning size 5 00000004:00200000:2.0:1746065080.021119:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.021129:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14626f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.021149:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc14626ea lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca1a expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.021175:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14626f1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca1a expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.021186:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065080.021189:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065080.021192:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c600, rc 0) 00000100:00100000:2.0:1746065080.021227:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27905:x1830881261428352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 247us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.021232:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12189 00000100:00100000:1.0:1746065080.021490:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12190 00000100:00100000:1.0:1746065080.021496:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27907:x1830881261428224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.021504:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.021511:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc14626f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca13 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.021540:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.021547:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021553:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021577:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.021583:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021587:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021613:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021618:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021623:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021628:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021633:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.021636:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021644:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021652:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:1.0:1746065080.021654:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.021657:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021661:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857400/0xad6b7ddc14626ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021670:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021674:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021679:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021682:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.021684:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021689:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021694:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009d305a00) 00010000:00010000:1.0:1746065080.021696:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.021698:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021702:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1462706 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.021724:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc14626f8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca13 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.021730:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857200/0xad6b7ddc14626f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca13 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.021736:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:1.0:1746065080.022230:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27907:x1830881261428224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 732us (1362us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.022236:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12190 00000100:00100000:0.0:1746065080.025355:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.025405:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.025478:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261428736 00000100:00100000:1.0:1746065080.025486:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261428736 00000100:00100000:1.0:1746065080.025533:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12191 00000100:00100000:1.0:1746065080.025540:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27907:x1830881261428736:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065080.025543:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261428480 00000100:00100000:3.0:1746065080.025547:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261428480 00010000:00010000:1.0:1746065080.025565:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.025568:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1746065080.025579:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8581 00000100:00100000:3.0:1746065080.025584:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261428480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.025589:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539800/0xad6b7ddc14626dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca05 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.025592:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.025604:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:1.0:1746065080.025611:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.025619:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc146270d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca28 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.025689:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.025690:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca21 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.025698:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00002000:00010000:3.0:1746065080.025705:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x362:0x0] initial LVB size: 5, mtime: 0x6812d6b8, atime: 0x0, ctime: 0x6812d6b8, blocks: 0x8 00010000:00010000:1.0:1746065080.025706:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.025719:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.025720:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.025721:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.025725:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.025728:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.025729:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.025740:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.025747:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46e00, rc 0) 00000100:00100000:3.0:1746065080.025806:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881261428480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 220us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.025811:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8581 00010000:00010000:1.0:1746065080.026020:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.026028:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026033:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065080.026040:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 0 00010000:00010000:1.0:1746065080.026058:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026063:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026068:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026073:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026078:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.026082:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026087:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026094:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:1.0:1746065080.026096:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.026098:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026102:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857800/0xad6b7ddc1462714 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065080.026110:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099e12300 reply state ffff88013521c000 transno 4294975543 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026116:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.026121:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47600) 00010000:00010000:1.0:1746065080.026123:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.026125:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065080.026141:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856a00/0xad6b7ddc146270d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 280 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.026152:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.026157:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:1.0:1746065080.026159:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065080.026160:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926200, rc 0) 00000100:00100000:1.0:1746065080.026520:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27907:x1830881261428736:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 979us (1171us total) trans 4294975543 rc 0/0 00000100:00100000:1.0:1746065080.026526:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12191 00000100:00100000:0.0:1746065080.028084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.028161:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261428864 00000100:00100000:3.0:1746065080.028167:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261428864 00000100:00100000:0.0:1746065080.028397:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.028669:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8582 00000100:00100000:3.0:1746065080.028677:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261428864:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065080.028792:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261429120 00000100:00100000:1.0:1746065080.028797:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261429120 00000100:00100000:3.0:1746065080.028811:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261428864:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 135us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.028818:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8582 00000100:00100000:1.0:1746065080.028834:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12192 00000100:00100000:1.0:1746065080.028839:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27907:x1830881261429120:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.028853:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.028871:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927c00/0xad6b7ddc1462737 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca2f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.028949:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.028960:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.028965:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.028989:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.028998:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.029009:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262638848:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.029077:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.030399:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262638848:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.030416:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065080.030515:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.030575:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261429248 00000100:00100000:0.0:1746065080.030577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.030580:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261429248 00000100:00100000:1.0:1746065080.030652:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261429376 00000100:00100000:1.0:1746065080.030656:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261429376 00010000:00010000:1.0:1746065080.030670:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.030684:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8583 00000100:00100000:3.0:1746065080.030691:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261429248:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065080.030821:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3615 00000100:00100000:1.0:1746065080.030828:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+282:2005:x1830881261429376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.030836:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.030841:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.030850:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.030867:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1462729 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca28 expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.030966:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:1.0:1746065080.030971:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065080.030975:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261429248:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 284us (458us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065080.030978:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065080.030982:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8583 00010000:00010000:1.0:1746065080.030983:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.030997:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.031015:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+281:2005:x1830881261429376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 187us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.031021:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3615 00010000:00010000:1.0:1746065080.031037:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031042:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065080.031055:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 0 00000004:00080000:1.0:1746065080.031159:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x365:0x0], index 1: 0 00000004:00080000:1.0:1746065080.031164:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x364:0x0], index 0: 0 00000004:00080000:1.0:1746065080.031168:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x365:0x0], index 0: 0 00000004:00080000:1.0:1746065080.031170:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x366:0x0], index 1: 0 00010000:00010000:1.0:1746065080.031236:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031243:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031248:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031253:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.031256:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031262:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031269:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:1.0:1746065080.031271:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065080.031274:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031278:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926800/0xad6b7ddc146273e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.031309:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927c00/0xad6b7ddc1462737 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca2f expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.031317:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927c00/0xad6b7ddc1462737 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca2f expref: 281 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.031327:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927c00, rc 0) 00000100:00100000:1.0:1746065080.031360:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+280:27907:x1830881261429120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2520us (2962us total) trans 4294975544 rc 301/301 00000100:00100000:1.0:1746065080.031366:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12192 00000100:00100000:0.0:1746065080.032865:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.032987:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.033054:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261429632 00000100:00100000:2.0:1746065080.033059:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261429632 00000100:00100000:2.0:1746065080.033086:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4196 00000100:00100000:2.0:1746065080.033092:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27907:x1830881261429632:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.033393:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261429888 00000100:00100000:1.0:1746065080.033396:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261429888 00000100:00100000:1.0:1746065080.033422:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12193 00000100:00100000:1.0:1746065080.033427:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27905:x1830881261429888:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065080.033448:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.033464:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14626f1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca1a expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.033474:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065080.033478:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.033496:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.033504:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.033513:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:1.0:1746065080.033550:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099e12680 reply state ffff88009fadd000 transno 4294975546 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065080.033590:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27907:x1830881261429632:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 498us (727us total) trans 4294975545 rc 0/0 00000100:00100000:2.0:1746065080.033597:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4196 00010000:00010000:1.0:1746065080.033638:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.033643:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065080.033645:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.033647:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.033680:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27905:x1830881261429888:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 252us (692us total) trans 4294975546 rc 0/0 00000100:00100000:1.0:1746065080.033685:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12193 00000100:00100000:0.0:1746065080.035729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.035803:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261430144 00000100:00100000:2.0:1746065080.035809:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261430144 00000100:00100000:2.0:1746065080.036153:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4197 00000100:00100000:2.0:1746065080.036161:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27907:x1830881261430144:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.036312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.036463:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261430272 00000100:00100000:3.0:1746065080.036467:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261430272 00000100:00100000:3.0:1746065080.036492:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8584 00000100:00100000:3.0:1746065080.036497:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261430272:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:2.0:1746065080.036663:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27907:x1830881261430144:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 502us (938us total) trans 4294975547 rc 0/0 00000100:00100000:2.0:1746065080.036670:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4197 00002000:00010000:3.0:1746065080.036861:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065080.036863:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.036866:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb atime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.036867:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.036869:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065080.036905:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261430272:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 407us (593us total) trans 21474839821 rc 0/0 00000100:00100000:3.0:1746065080.036911:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8584 00000100:00100000:0.0:1746065080.038206:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.038271:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261430528 00000100:00100000:2.0:1746065080.038275:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261430528 00000100:00100000:2.0:1746065080.038442:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4198 00000100:00100000:2.0:1746065080.038449:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27905:x1830881261430528:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065080.038489:0:7207:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x33d:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462673 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e9 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.038523:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:2.0:1746065080.038532:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.038538:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.038572:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.038582:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 283 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.038593:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262638976:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.039165:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.039319:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.039354:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261430784 00000100:00100000:2.0:1746065080.039358:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261430784 00000100:00100000:2.0:1746065080.039387:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12194 00000100:00100000:2.0:1746065080.039393:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261430784:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.039404:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.039415:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146275a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca36 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.039497:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.039505:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039512:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039520:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.039525:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039651:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039691:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146276f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.039697:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146276f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039702:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146276f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.039709:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 0 00010000:00010000:2.0:1746065080.039763:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039768:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039800:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039809:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039814:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.039817:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039823:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039830:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:2.0:1746065080.039833:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.039836:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039841:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462761 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039849:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039853:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039857:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039861:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.039863:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039868:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039874:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47600) 00010000:00010000:2.0:1746065080.039876:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.039878:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039882:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462768 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.039907:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146275a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca36 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.039917:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146276f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca36 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.039922:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.039924:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.039925:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:2.0:1746065080.039955:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261430784:12345-192.168.202.27@tcp:101:bash.0 Request processed in 561us (636us total) trans 4294975548 rc 0/0 00000100:00100000:2.0:1746065080.039961:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12194 00000100:00100000:2.0:1746065080.040484:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262638976:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.040498:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065080.040846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.041097:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261430912 00000100:00100000:1.0:1746065080.041102:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261430912 00010000:00010000:1.0:1746065080.041119:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 286 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.041137:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3616 00000100:00100000:1.0:1746065080.041142:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+286:2005:x1830881261430912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.041150:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.041154:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 286 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.041162:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 286 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.041178:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc14626e3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca0c expref: 286 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.041187:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:1.0:1746065080.041191:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065080.041197:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065080.041201:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065080.041224:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.041246:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+285:2005:x1830881261430912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.041252:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3616 00010000:00010000:2.0:1746065080.041369:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.041374:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000040:00080000:2.0:1746065080.041509:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2417, 88 off200096 00000004:00080000:2.0:1746065080.041515:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676059740607ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.041541:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2421, 88 off200528 00000004:00080000:2.0:1746065080.041544:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676059770486ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.041566:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2422, 88 off200616 00000004:00080000:2.0:1746065080.041569:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676059795566ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.041578:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2418, 88 off200184 00000004:00080000:2.0:1746065080.041580:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676059806948ns, next at 676590652783ns, rc = 0 00000100:00100000:0.0:1746065080.041680:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.042025:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261431040 00000100:00100000:2.0:1746065080.042028:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261431040 00000100:00100000:2.0:1746065080.042046:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12195 00000100:00100000:2.0:1746065080.042050:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261431040:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.042059:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.042066:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a54ae00/0xad6b7ddc146277d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca3d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.042084:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc1462784 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.042090:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc1462784 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.042096:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc1462784 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.042144:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a54ae00/0xad6b7ddc146277d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca3d expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.042154:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc1462784 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca3d expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.042159:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.042162:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065080.042164:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8200, rc 0) 00000100:00100000:2.0:1746065080.042182:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261431040:12345-192.168.202.27@tcp:101:bash.0 Request processed in 131us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.042186:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12195 00000100:00100000:2.0:1746065080.043909:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:2.0:1746065080.044086:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975549 is committed 00000004:00080000:2.0:1746065080.044095:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1625 committed 00010000:00010000:0.0:1746065080.044143:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044151:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044156:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044161:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.044163:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044168:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044179:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec47600) 00010000:00010000:0.0:1746065080.044181:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.044183:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044187:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1462722 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044208:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044213:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044217:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044224:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.044226:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044231:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044237:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:0.0:1746065080.044239:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.044241:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.044245:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc146274c lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065080.044407:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261431296 00000100:00100000:3.0:1746065080.044413:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261431296 00000100:00100000:3.0:1746065080.044439:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12196 00000100:00100000:3.0:1746065080.044445:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261431296:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065080.044478:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.044491:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146276f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca36 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.044503:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:3.0:1746065080.044505:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.044632:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.044641:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.044647:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:3.0:1746065080.044671:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975550 00000004:00010000:3.0:1746065080.044683:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aec8e00 reply state ffff880099706000 transno 4294975551 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.044689:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.044693:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:3.0:1746065080.044695:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.044697:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065080.044743:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261431296:12345-192.168.202.27@tcp:36:bash.0 Request processed in 298us (839us total) trans 4294975551 rc 0/0 00000100:00100000:3.0:1746065080.044748:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12196 00000020:00080000:3.0:1746065080.044751:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00080000:2.0:1746065080.044799:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1635 committed 00000004:00080000:2.0:1746065080.044804:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1634 committed 00000004:00080000:2.0:1746065080.044805:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1624 committed 00000004:00010000:2.0:1746065080.044836:0:7207:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099e11f80 reply state ffff880099d43c00 transno 4294975549 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.044843:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.044848:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065080.044849:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065080.044851:0:7207:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065080.044855:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00010000:00010000:2.0:1746065080.044856:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065080.044859:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462673 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9e9 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746065080.044888:0:7207:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065080.044894:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27905:x1830881261430528:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 6446us (6691us total) trans 4294975549 rc 0/0 00000100:00100000:2.0:1746065080.044900:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4198 00000100:00100000:1.0:1746065080.045162:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262639232:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.045193:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.045220:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639232 00000100:00100000:1.0:1746065080.045222:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639232 00000100:00100000:1.0:1746065080.045242:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8585 00000100:00100000:1.0:1746065080.045246:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3759:x1830881262639232:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.045293:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.045299:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.045303:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.045307:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.045309:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.045314:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.045320:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012edbd000) 00002000:00010000:1.0:1746065080.045321:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1746065080.045322:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.045324:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00002000:00010000:1.0:1746065080.045324:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045326:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045327:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:3.0:1746065080.045329:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1462753 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00002000:00010000:1.0:1746065080.045329:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065080.045349:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3759:x1830881262639232:12345-0@lo:2:osp-syn-0-1.0 Request processed in 102us (154us total) trans 21474839822 rc 0/0 00000100:00100000:1.0:1746065080.045354:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8585 00000100:00100000:2.0:1746065080.045386:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262639104:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.045395:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262639488:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.045407:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.045415:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262639360:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.045437:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.045458:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.045539:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639104 00000100:00100000:3.0:1746065080.045543:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639104 00000100:00100000:3.0:1746065080.045570:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639360 00000100:00100000:1.0:1746065080.045571:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639488 00000100:00100000:3.0:1746065080.045572:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639360 00000100:00100000:1.0:1746065080.045573:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639488 00000100:00100000:1.0:1746065080.045594:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8586 00000100:00100000:1.0:1746065080.045598:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3762:x1830881262639104:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065080.045686:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065080.045688:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.045690:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb atime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.045691:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.045693:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x362:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065080.045715:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+47:3762:x1830881262639104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (307us total) trans 21474839823 rc 0/0 00000100:00100000:1.0:1746065080.045720:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8586 00000100:00100000:1.0:1746065080.045730:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8587 00000100:00100000:1.0:1746065080.045734:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+79:3761:x1830881262639488:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065080.045810:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045812:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045814:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045815:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045816:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065080.045836:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+80:3761:x1830881262639488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (378us total) trans 17179872542 rc 0/0 00000100:00100000:1.0:1746065080.045841:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8587 00000100:00100000:1.0:1746065080.045850:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8588 00000100:00100000:1.0:1746065080.045854:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+79:3760:x1830881262639360:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065080.045889:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045892:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.045893:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.045895:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.045896:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065080.045921:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+80:3760:x1830881262639360:12345-0@lo:2:osp-syn-1-1.0 Request processed in 62us (478us total) trans 17179872543 rc 0/0 00000100:00100000:1.0:1746065080.045926:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8588 00000004:00080000:0.0:1746065080.046035:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37e680/2, rc 0, transno 17179872543 00000100:00100000:0.0:1746065080.046043:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262639360:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.046049:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad5880/2, rc 0, transno 21474839823 00000100:00100000:2.0:1746065080.046053:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262639104:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065080.046056:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37ca80/2, rc 0, transno 17179872542 00000100:00100000:0.0:1746065080.046059:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262639488:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065080.046209:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad4a80/2, rc 0, transno 21474839822 00000100:00100000:1.0:1746065080.046213:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262639232:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.047233:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.047309:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261431424 00000100:00100000:2.0:1746065080.047314:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261431424 00000100:00100000:2.0:1746065080.047352:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12197 00000100:00100000:2.0:1746065080.047358:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27905:x1830881261431424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.047372:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.047384:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9000/0xad6b7ddc1462792 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca44 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.047420:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9000/0xad6b7ddc1462792 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca44 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.047429:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9000/0xad6b7ddc1462792 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca44 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.047440:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012ef2ac00) 00010000:00010000:2.0:1746065080.047442:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.047444:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9000, rc 0) 00000100:00100000:2.0:1746065080.047469:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27905:x1830881261431424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.047474:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12197 00000100:00100000:2.0:1746065080.047724:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.047874:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261431552 00000100:00100000:3.0:1746065080.047878:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261431552 00000100:00100000:3.0:1746065080.047896:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12198 00000100:00100000:3.0:1746065080.047901:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261431552:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.047908:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.047915:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462799 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca4b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.047948:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462799 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca4b expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.047956:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462799 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca4b expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.047965:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:3.0:1746065080.047967:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.047969:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9200, rc 0) 00000100:00100000:3.0:1746065080.048215:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261431552:12345-192.168.202.27@tcp:101:bash.0 Request processed in 312us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.048220:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12198 00000100:00100000:2.0:1746065080.049062:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.049156:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261431808 00000100:00100000:3.0:1746065080.049160:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261431808 00000100:00100000:3.0:1746065080.049181:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4199 00000100:00100000:3.0:1746065080.049185:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27905:x1830881261431808:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065080.049343:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x33d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065080.049397:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2419, 64 off200248 00000040:00080000:3.0:1746065080.049418:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2423, 64 off200680 00000040:00080000:3.0:1746065080.049539:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2424, 64 off200744 00000040:00080000:3.0:1746065080.049561:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2420, 64 off200312 00010000:00010000:3.0:1746065080.049598:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065080.049675:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.049684:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.049690:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.049695:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.049700:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00000100:00100000:2.0:1746065080.049702:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065080.049717:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.049758:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.049763:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.049768:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.049785:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.049790:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.049799:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33d:0x0].0x0 (ffff88012ef2ac00) 00010000:00010000:0.0:1746065080.049802:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065080.049804:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.049808:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc14627a0 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.049818:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.049819:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.049821:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.049828:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432064 00000100:00100000:0.0:1746065080.049831:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432064 00000100:00100000:3.0:1746065080.049844:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27905:x1830881261431808:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 657us (782us total) trans 4294975552 rc 0/0 00000100:00100000:3.0:1746065080.049850:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4199 00000100:00100000:0.0:1746065080.049850:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12199 00000100:00100000:0.0:1746065080.049854:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261432064:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.049861:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.049863:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065080.049874:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462799 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca4b expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.049881:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065080.049884:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065080.049889:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14627a7 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca52 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.049917:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14627ae lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.049924:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14627ae lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.049930:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14627ae lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:0.0:1746065080.050122:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2425, 88 off200832 00000004:00080000:0.0:1746065080.050132:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676068353307ns, next at 676590632635ns, rc = 0 00000040:00080000:0.0:1746065080.050161:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2421, 88 off200400 00000004:00080000:0.0:1746065080.050164:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676068390511ns, next at 676590652783ns, rc = 0 00000040:00080000:0.0:1746065080.050185:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2422, 88 off200488 00000004:00080000:0.0:1746065080.050188:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676068414277ns, next at 676590652783ns, rc = 0 00000040:00080000:0.0:1746065080.050196:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2426, 88 off200920 00000004:00080000:0.0:1746065080.050198:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676068424674ns, next at 676590632635ns, rc = 0 00000001:00080000:2.0:1746065080.053343:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975553 is committed 00000004:00080000:2.0:1746065080.053352:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1637 committed 00010000:00010000:0.0:1746065080.053926:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.053938:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.053944:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.053949:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.053953:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.053958:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.053972:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065080.053975:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.053978:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.053983:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04b600/0xad6b7ddc146278b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00080000:2.0:1746065080.054046:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1627 committed 00000004:00080000:2.0:1746065080.054660:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1626 committed 00000100:00100000:1.0:1746065080.054765:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262639744:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.054827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.054870:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065080.054875:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262639872:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.054890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.054912:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639744 00000100:00100000:1.0:1746065080.054919:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639744 00000100:00100000:1.0:1746065080.054942:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639872 00000100:00100000:1.0:1746065080.054944:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639872 00000100:00100000:1.0:1746065080.054954:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8589 00000100:00100000:1.0:1746065080.054959:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+48:3759:x1830881262639744:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065080.054980:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:867 count 1 00010000:00010000:1.0:1746065080.054998:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.055012:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.055023:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.055024:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.055027:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.055046:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.055057:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 31 pid: 10219 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746065080.055066:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262640128:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.055113:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.055126:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8590 00000100:00100000:1.0:1746065080.055131:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+48:3759:x1830881262639872:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.055239:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+49:3759:x1830881262639872:12345-0@lo:2:osp-syn-0-1.0 Request processed in 107us (347us total) trans 21474839824 rc 0/0 00000100:00100000:1.0:1746065080.055245:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8590 00000004:00080000:1.0:1746065080.055275:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad4000/2, rc 0, transno 21474839824 00000100:00100000:1.0:1746065080.055280:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262639872:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.055331:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262640000:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.055353:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.055366:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065080.055371:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262639616:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.055384:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.055401:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262640000 00000100:00100000:0.0:1746065080.055404:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262640000 00000100:00100000:0.0:1746065080.055420:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262639616 00000100:00100000:0.0:1746065080.055421:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262639616 00000100:00100000:0.0:1746065080.055432:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8591 00000100:00100000:0.0:1746065080.055437:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+50:3761:x1830881262640000:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.055497:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+51:3761:x1830881262640000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 60us (143us total) trans 21474839825 rc 0/0 00000100:00100000:0.0:1746065080.055502:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8591 00000100:00100000:0.0:1746065080.055512:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8592 00000100:00100000:0.0:1746065080.055515:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f86dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+50:3761:x1830881262639616:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065080.055523:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:866 count 1 00010000:00010000:0.0:1746065080.055531:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.055544:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.055549:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.055550:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.055552:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.055581:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.055589:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746065080.055596:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262640256:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.055617:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00000004:00080000:0.0:1746065080.055636:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad7100/2, rc 0, transno 21474839825 00000100:00100000:0.0:1746065080.055639:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262640000:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.055741:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262640512:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.055762:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.055789:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065080.055793:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262640640:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.055809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.055824:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262640512 00000100:00100000:3.0:1746065080.055827:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262640512 00000100:00100000:3.0:1746065080.055841:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262640640 00000100:00100000:3.0:1746065080.055843:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262640640 00000100:00100000:3.0:1746065080.055852:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8593 00000100:00100000:3.0:1746065080.055856:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+81:3759:x1830881262640512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.055866:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:868 count 1 00010000:00010000:3.0:1746065080.055878:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.055888:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.055893:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.055894:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.055896:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.055910:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.055918:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 40 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.055926:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262640896:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.055944:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.055957:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8594 00000100:00100000:3.0:1746065080.055961:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+81:3759:x1830881262640640:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.056030:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+82:3759:x1830881262640640:12345-0@lo:2:osp-syn-1-1.0 Request processed in 68us (219us total) trans 17179872544 rc 0/0 00000100:00100000:3.0:1746065080.056035:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8594 00000004:00080000:3.0:1746065080.056057:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37d180/2, rc 0, transno 17179872544 00000100:00100000:3.0:1746065080.056061:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262640640:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.056121:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1636 committed 00000100:00100000:2.0:1746065080.056154:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262640384:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.056176:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.056188:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065080.056191:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262640768:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.056202:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.056380:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262640384 00000100:00100000:3.0:1746065080.056384:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262640384 00000100:00100000:3.0:1746065080.056672:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262640768 00000100:00100000:3.0:1746065080.056675:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262640768 00000100:00100000:3.0:1746065080.057325:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8595 00000100:00100000:3.0:1746065080.057332:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+83:3762:x1830881262640384:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.057346:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:867 count 1 00010000:00010000:3.0:1746065080.057356:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.057367:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.057373:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.057374:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.057376:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.057393:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.057400:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 40 pid: 12260 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.057408:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262641024:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.057441:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.058035:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8596 00000100:00100000:2.0:1746065080.058042:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+83:3762:x1830881262640768:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.058126:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+84:3762:x1830881262640768:12345-0@lo:2:osp-syn-1-1.0 Request processed in 86us (1922us total) trans 17179872545 rc 0/0 00000100:00100000:2.0:1746065080.058132:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8596 00000004:00080000:2.0:1746065080.058159:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37ea00/2, rc 0, transno 17179872545 00000100:00100000:2.0:1746065080.058163:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262640768:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.058198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.058273:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262640128:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.058289:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.058348:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432320 00000100:00100000:2.0:1746065080.058351:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432320 00000100:00100000:2.0:1746065080.058377:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12200 00000100:00100000:2.0:1746065080.058382:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:27908:x1830881261432320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.058394:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.058405:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc14627d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca59 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.058463:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.058473:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058482:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058492:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.058497:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058501:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058582:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.058589:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058595:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065080.058602:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 2 00010000:00010000:2.0:1746065080.058641:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058646:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058654:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058659:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.058661:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058666:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058673:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.058676:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065080.058678:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058682:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc14627e6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058692:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058696:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058700:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058704:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058707:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.058709:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058716:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058720:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854c00) 00010000:00010000:2.0:1746065080.058722:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.058723:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058727:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc14627d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058732:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058736:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058739:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058742:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.058744:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058748:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058752:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854800) 00010000:00010000:2.0:1746065080.058753:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.058755:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058758:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8800/0xad6b7ddc14627df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.058796:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc14627d1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca59 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.058802:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc14627d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca59 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.058809:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:2.0:1746065080.058827:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27908:x1830881261432320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 446us (629us total) trans 4294975554 rc 301/301 00000100:00100000:2.0:1746065080.058832:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12200 00000100:00100000:0.0:1746065080.059069:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262640256:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065080.059082:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059119:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14627ae lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca52 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059124:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065080.059126:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065080.059132:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc14627a7 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca52 expref: 279 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065080.059141:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14627ae lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca52 expref: 278 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059153:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065080.059155:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065080.059157:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:0.0:1746065080.059173:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261432064:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9319us (9471us total) trans 4294975553 rc 0/0 00000100:00100000:0.0:1746065080.059178:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12199 00000100:00100000:3.0:1746065080.059291:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.059355:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.059372:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432448 00000100:00100000:3.0:1746065080.059375:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432448 00010000:00010000:3.0:1746065080.059389:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 32 pid: 10219 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.059402:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432576 00000100:00100000:3.0:1746065080.059403:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432576 00010000:00010000:3.0:1746065080.059410:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 33 pid: 3068 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.059420:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3617 00000100:00100000:3.0:1746065080.059424:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881261432448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.059430:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.059433:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 33 pid: 10219 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.059440:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 33 pid: 10219 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.059452:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146254d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c995 expref: 33 pid: 10219 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.059461:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.059462:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.059464:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.059475:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.059486:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.059498:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261432448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.059502:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3617 00000100:00100000:3.0:1746065080.059510:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3618 00000100:00100000:3.0:1746065080.059514:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261432576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.059518:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.059521:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.059527:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.059535:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146271b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca21 expref: 31 pid: 3068 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.059541:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.059542:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.059544:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.059549:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.059572:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.059583:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261432576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.059587:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3618 00010000:00010000:0.0:1746065080.059658:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059665:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059671:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059676:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059687:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065080.059867:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f86dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+51:3761:x1830881262639616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4351us (4482us total) trans 21474839826 rc 0/0 00000100:00100000:0.0:1746065080.059877:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8592 00010000:00010000:0.0:1746065080.059890:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.059894:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059900:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.059903:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059909:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059917:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059922:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc14627bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.059932:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.059933:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.059934:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065080.059949:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6d80/2, rc 0, transno 21474839826 00000100:00100000:0.0:1746065080.059953:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262639616:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065080.060234:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.060240:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.060246:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.060251:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.060297:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065080.060437:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.060442:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.060447:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a54ae00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.060449:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.060455:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.060465:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.060470:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a54ae00/0xad6b7ddc14627b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.060479:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.060481:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.060482:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065080.060641:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+51:3759:x1830881262639744:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5681us (5813us total) trans 21474839827 rc 0/0 00000100:00100000:2.0:1746065080.060647:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8589 00000004:00080000:0.0:1746065080.060852:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad5500/2, rc 0, transno 21474839827 00000100:00100000:0.0:1746065080.060857:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262639744:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.062293:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262640896:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.062312:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.062523:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.062573:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.063043:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432704 00000100:00100000:2.0:1746065080.063049:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432704 00010000:00010000:2.0:1746065080.063078:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 41 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746065080.063097:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3619 00000100:00100000:2.0:1746065080.063102:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261432704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.063112:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.063116:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 41 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.063124:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 41 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.063140:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc146252a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c98e expref: 41 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.063150:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.063152:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.063155:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.063162:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065080.063217:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065080.063270:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432832 00000100:00100000:1.0:1746065080.063274:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432832 00000100:00100000:1.0:1746065080.063298:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12201 00000100:00100000:1.0:1746065080.063303:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27908:x1830881261432832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.063320:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.063331:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927800/0xad6b7ddc14627f4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca60 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.063393:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.063402:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.063409:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065080.063427:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 2 00000004:00200000:1.0:1746065080.063431:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065080.063441:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.063458:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927800/0xad6b7ddc14627f4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 280 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.063540:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.063582:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261432704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 479us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.063591:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3619 00010000:00010000:3.0:1746065080.063666:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.063673:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.063679:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.063685:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.063696:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.063798:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.063803:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.063809:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.063812:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.063819:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.063829:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.063835:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc14627c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.063847:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.063849:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.063850:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065080.063893:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.063901:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:1.0:1746065080.063903:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065080.063906:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926e00, rc 0) 00000100:00100000:1.0:1746065080.063927:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27908:x1830881261432832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 624us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.063933:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12201 00000100:00100000:0.0:1746065080.064364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.064393:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.064453:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262641024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.064464:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.064479:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261432960 00000100:00100000:2.0:1746065080.064482:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261432960 00000100:00100000:2.0:1746065080.064504:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8597 00000100:00100000:2.0:1746065080.064508:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+40:26180:x1830881261432960:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.064516:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.064524:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca67 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.064535:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.064545:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.064547:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.064552:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.064625:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+84:3759:x1830881262640512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8767us (8860us total) trans 17179872546 rc 0/0 00000100:00100000:3.0:1746065080.064631:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8593 00000004:00080000:1.0:1746065080.064692:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37ce00/2, rc 0, transno 17179872546 00000100:00100000:1.0:1746065080.064699:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262640512:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065080.064959:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.064967:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8000, rc 0) 00000100:00100000:2.0:1746065080.064991:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+41:26180:x1830881261432960:12345-192.168.202.27@tcp:101:bash.0 Request processed in 482us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.064996:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8597 00000100:00100000:2.0:1746065080.065011:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261433088 00000100:00100000:2.0:1746065080.065013:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261433088 00010000:00010000:2.0:1746065080.065023:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 41 pid: 12260 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.065234:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3620 00000100:00100000:2.0:1746065080.065240:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261433088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.065246:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.065250:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 41 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.065257:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 41 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.065268:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc1462603 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92c9c6 expref: 41 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.065279:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.065280:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.065282:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.065288:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.065532:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.065568:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261433088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 327us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.065577:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3620 00010000:00010000:3.0:1746065080.065688:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.065695:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.065701:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.065707:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.065719:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.066179:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.066183:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.066189:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.066193:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.066199:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.066210:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.066215:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9600/0xad6b7ddc14627ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.066227:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.066228:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.066230:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.066285:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.066410:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+84:3762:x1830881262640384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9078us (10233us total) trans 17179872547 rc 0/0 00000100:00100000:3.0:1746065080.066417:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8595 00000004:00080000:2.0:1746065080.066543:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37c700/2, rc 0, transno 17179872547 00000100:00100000:2.0:1746065080.066548:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262640384:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.066686:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261433216 00000100:00100000:3.0:1746065080.066691:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261433216 00000100:00100000:3.0:1746065080.066716:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8598 00000100:00100000:3.0:1746065080.066721:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261433216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.066729:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.066737:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc1462809 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca6e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.066766:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262641152:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065080.067034:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.067185:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.067239:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261433344 00000100:00100000:2.0:1746065080.067242:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261433344 00000100:00100000:2.0:1746065080.067262:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8599 00000100:00100000:2.0:1746065080.067267:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:26180:x1830881261433344:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.067275:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.067284:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca75 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.067299:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.067308:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.067309:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.067315:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.067324:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.067331:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9800, rc 0) 00000100:00100000:2.0:1746065080.067362:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:26180:x1830881261433344:12345-192.168.202.27@tcp:101:bash.0 Request processed in 95us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.067367:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8599 00000100:00100000:1.0:1746065080.069198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.069240:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.069387:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261433472 00000100:00100000:2.0:1746065080.069393:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261433472 00002000:00010000:2.0:1746065080.069417:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/869 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.069420:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf4e00 with x1830881261433472 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.069428:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880076cf4e00. 00000100:00100000:2.0:1746065080.069440:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261433600 00000100:00100000:2.0:1746065080.069441:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261433600 00002000:00010000:2.0:1746065080.069451:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/868 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.069453:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf6300 with x1830881261433600 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.069457:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880076cf6300. 00000100:00100000:2.0:1746065080.069468:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1267 00000100:00100000:2.0:1746065080.069474:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881261433472:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:0.0:1746065080.069525:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1268 00000100:00100000:0.0:1746065080.069531:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881261433600:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065080.069609:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065080.069609:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.069612:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:0.0:1746065080.069612:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.069614:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065080.069614:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.069616:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:0.0:1746065080.069616:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.069617:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746065080.069618:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065080.069651:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881261433600:12345-192.168.202.27@tcp:10:bash.0 Request processed in 120us (411us total) trans 21474839828 rc 0/0 00000100:00100000:0.0:1746065080.069656:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1268 00002000:00010000:0.0:1746065080.069660:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/868 (0->18446744073709551615) 00002000:00100000:0.0:1746065080.069662:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf6300 with x1830881261433600 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065080.069665:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880076cf6300. 00002000:00010000:3.0:1746065080.069689:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb atime: 0 -> 1746065080 00000100:00100000:3.0:1746065080.069698:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262641152:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065080.069722:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc1462809 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca6e expref: 43 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.069733:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc1462809 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca6e expref: 43 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.069742:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:3.0:1746065080.070602:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261433216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3877us (4314us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.070612:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8598 00000100:00100000:2.0:1746065080.070695:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881261433472:12345-192.168.202.27@tcp:10:bash.0 Request processed in 1221us (1501us total) trans 17179872548 rc 0/0 00000100:00100000:2.0:1746065080.070702:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1267 00002000:00010000:2.0:1746065080.070705:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/869 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.070707:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf4e00 with x1830881261433472 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.070711:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880076cf4e00. 00000100:00100000:0.0:1746065080.072903:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.072945:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261433856 00000100:00100000:3.0:1746065080.072950:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261433856 00000100:00100000:3.0:1746065080.072978:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4200 00000100:00100000:3.0:1746065080.072984:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261433856:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065080.073175:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261433856:12345-192.168.202.27@tcp:35:bash.0 Request processed in 190us (276us total) trans 4294975555 rc 0/0 00000100:00100000:3.0:1746065080.073181:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4200 00000100:00100000:0.0:1746065080.073418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.073528:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261434112 00000100:00100000:3.0:1746065080.073532:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261434112 00000100:00100000:3.0:1746065080.073564:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4201 00000100:00100000:3.0:1746065080.073570:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27908:x1830881261434112:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.073657:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:27908:x1830881261434112:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 87us (239us total) trans 4294975556 rc 0/0 00000100:00100000:3.0:1746065080.073663:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4201 00000100:00100000:0.0:1746065080.075891:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.075947:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261434240 00000100:00100000:2.0:1746065080.075953:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261434240 00000100:00100000:2.0:1746065080.075999:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12202 00000100:00100000:2.0:1746065080.076005:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27908:x1830881261434240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.076022:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.076038:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462817 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca7c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.076086:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.076096:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076103:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076113:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.076117:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076122:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076175:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.076182:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076187:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.076214:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 5 00000004:00200000:2.0:1746065080.076217:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.076227:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076234:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076240:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076244:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076249:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076254:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076258:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.076261:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076265:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076274:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065080.076276:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.076279:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076283:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146281e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076308:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076313:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076317:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076326:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.076328:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076331:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076337:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854900) 00010000:00010000:2.0:1746065080.076339:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.076341:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076345:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462825 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.076367:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462817 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca7c expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.076377:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca7c expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.076383:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.076385:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.076387:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8600, rc 0) 00000100:00100000:2.0:1746065080.076433:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27908:x1830881261434240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 428us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.076439:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12202 00000100:00100000:0.0:1746065080.078139:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.079991:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261434368 00000100:00100000:2.0:1746065080.080001:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261434368 00000100:00100000:2.0:1746065080.080043:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 555 00000100:00100000:2.0:1746065080.080049:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+282:2004:x1830881261434368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.080061:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.080079:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146282c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca7c expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.080093:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.080096:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.080146:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+281:2004:x1830881261434368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.080152:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 555 00000100:00100000:3.0:1746065080.082118:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.082173:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261434624 00000100:00100000:2.0:1746065080.082179:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261434624 00000100:00100000:2.0:1746065080.082211:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12203 00000100:00100000:2.0:1746065080.082218:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27908:x1830881261434624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.082231:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.082246:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462833 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca83 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.082268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.082283:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261434880 00000100:00100000:0.0:1746065080.082286:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261434880 00000100:00100000:0.0:1746065080.082306:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12204 00000100:00100000:0.0:1746065080.082311:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27909:x1830881261434880:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065080.082322:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065080.082328:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065080.082332:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.082339:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,1 mode: --/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.082698:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c539a00/0xad6b7ddc14627ae lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca52 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.082816:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.082827:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 282 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.082837:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262641280:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065080.082928:0:7205:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 282 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.082941:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc1462784 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca3d expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.082950:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065080.082954:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: --/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.082960:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.082968:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.082978:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065080.082992:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.082998:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.083003:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.083011:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.083016:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.083021:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.083079:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.083086:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.083090:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.083098:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.083104:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065080.083170:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065080.085268:0:7203:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff88009aec9180 x1830881262641280) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 1/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 281 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.085283:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926e00/0xad6b7ddc14627fb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca60 expref: 281 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.085308:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262641280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.085327:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.085330:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.085336:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.085343:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.085349:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.085354:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.085374:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 5 00010000:00010000:2.0:1746065080.085461:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9600/0xad6b7ddc1462833 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.085473:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.085480:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.085485:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9c00, rc 0) 00000100:00100000:2.0:1746065080.087146:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27908:x1830881261434624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4921us (5026us total) trans 4294975557 rc 0/0 00000100:00100000:2.0:1746065080.087154:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12203 00000100:00100000:0.0:1746065080.088989:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.089157:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435008 00000100:00100000:2.0:1746065080.089165:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435008 00010000:00010000:2.0:1746065080.089194:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.089228:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3621 00000100:00100000:2.0:1746065080.089234:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+281:2006:x1830881261435008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.089247:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.089252:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.089261:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.089283:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146283a lrc: 0/0,0 mode: --/CW res: [0x240000403:0x33f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca83 expref: 281 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.089296:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:2.0:1746065080.089300:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.089309:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.089315:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.089345:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.089376:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+280:2006:x1830881261435008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.089382:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3621 00010000:00010000:0.0:1746065080.089521:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089527:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:0.0:1746065080.089725:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x33f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1746065080.089808:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089814:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089820:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089825:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae23c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.089828:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089834:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089841:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012ef2ae00) 00010000:00010000:0.0:1746065080.089844:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065080.089846:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089850:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146284f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089864:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089869:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089873:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089877:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089881:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.089883:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089887:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089892:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065080.089894:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.089896:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089900:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1462841 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065080.089909:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099d15c00 reply state ffff88012c454000 transno 4294975558 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089916:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.089921:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a700) 00010000:00010000:0.0:1746065080.089922:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065080.089924:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065080.089957:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27909:x1830881261434880:12345-192.168.202.27@tcp:36:rm.0 Request processed in 7645us (7688us total) trans 4294975558 rc 0/0 00000100:00100000:0.0:1746065080.089963:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12204 00000100:00100000:0.0:1746065080.091502:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.092331:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435136 00000100:00100000:2.0:1746065080.092339:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435136 00000100:00100000:2.0:1746065080.092377:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12205 00000100:00100000:2.0:1746065080.092384:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27908:x1830881261435136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.092402:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.092415:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146285d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca8a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.092469:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc1462864 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.092479:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc1462864 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.092488:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc1462864 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.092517:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 5 00000004:00200000:2.0:1746065080.092520:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.092532:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc1462864 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.092549:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146285d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca8a expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.092572:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc1462864 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca8a expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.092578:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.092580:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065080.092582:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:2.0:1746065080.092627:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27908:x1830881261435136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 243us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.092632:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12205 00000100:00100000:0.0:1746065080.096681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.096733:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435392 00000100:00100000:2.0:1746065080.096740:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435392 00000100:00100000:2.0:1746065080.096810:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12206 00000100:00100000:2.0:1746065080.096817:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27908:x1830881261435392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.096833:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.096847:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146286b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca91 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.096926:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462872 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.097131:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462872 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.097142:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462872 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.097152:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 5 00010000:00010000:2.0:1746065080.097233:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc146286b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca91 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.097246:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462872 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca91 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.097253:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.097255:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065080.097258:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8c00, rc 0) 00000100:00100000:2.0:1746065080.097487:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27908:x1830881261435392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 670us (812us total) trans 4294975559 rc 0/0 00000100:00100000:2.0:1746065080.097493:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12206 00000100:00100000:0.0:1746065080.099819:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.099989:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435520 00000100:00100000:3.0:1746065080.099995:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435520 00000100:00100000:3.0:1746065080.100034:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8600 00000100:00100000:3.0:1746065080.100040:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261435520:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065080.102063:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.102083:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.102096:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.102098:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.102100:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.102131:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.102141:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 41 pid: 12260 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.102152:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262641408:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.102242:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.105445:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.105628:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262641408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.105648:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.105940:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.106624:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435776 00000100:00100000:3.0:1746065080.106631:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435776 00002000:00100000:3.0:1746065080.106679:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x365:0x0] (0->4) req@ffff88009a6dfb80 x1830881261435776/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/0 e 0 to 0 dl 1746065091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065080.106688:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881261435776 ext(0->4) 00010000:00010000:3.0:1746065080.106695:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 42 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.106711:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 42 pid: 12260 timeout: 776 lvb_type: 0 00002000:00010000:3.0:1746065080.106716:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6dfb80 00000100:00100000:3.0:1746065080.106737:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 217 00000100:00100000:3.0:1746065080.106744:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261435776:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:2.0:1746065080.107096:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435648 00000100:00100000:2.0:1746065080.107101:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435648 00000100:00100000:2.0:1746065080.107128:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12207 00000100:00100000:2.0:1746065080.107133:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27910:x1830881261435648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.107147:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.107161:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1462887 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca98 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.107207:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.107217:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107226:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107234:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.107239:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107243:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107275:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107280:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107285:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107290:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107295:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6f800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.107297:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107644:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107653:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854900) 00010000:00010000:2.0:1746065080.107656:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.107659:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107664:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc146288e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107679:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107684:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107688:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107692:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.107694:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107699:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107705:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a700) 00010000:00010000:2.0:1746065080.107706:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.107709:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107713:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc1462895 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.107735:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1462887 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca98 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.107741:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1462887 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca98 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.107752:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9c00, rc 0) 00000100:00100000:3.0:1746065080.108527:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261435776:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1780us (2584us total) trans 17179872549 rc 0/0 00000100:00100000:3.0:1746065080.108536:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 217 00002000:00100000:3.0:1746065080.108543:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x365:0x0] (0->4) req@ffff88009a6dfb80 x1830881261435776/t17179872549(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/448 e 0 to 0 dl 1746065091 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065080.108551:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881261435776 ext(0->4) 00010000:00010000:3.0:1746065080.108567:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 44 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.108578:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 44 pid: 12260 timeout: 776 lvb_type: 0 00002000:00010000:3.0:1746065080.108584:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6dfb80 00000100:00100000:2.0:1746065080.108746:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27910:x1830881261435648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1611us (3307us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065080.108752:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12207 00000100:00100000:0.0:1746065080.114862:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.114913:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.114953:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261436032 00000100:00100000:2.0:1746065080.114962:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261436032 00000100:00100000:1.0:1746065080.115093:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261435904 00000100:00100000:1.0:1746065080.115097:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261435904 00010000:00010000:1.0:1746065080.115119:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 44 pid: 12260 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.115147:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3622 00000100:00100000:1.0:1746065080.115154:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881261435904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065080.115161:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12208 00010000:00010000:1.0:1746065080.115166:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065080.115167:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27910:x1830881261436032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.115178:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746065080.115179:0:8352:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065080.115181:0:8352:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065080.115186:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 44 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.115192:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc146289c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ca9f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.115196:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 44 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.115212:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8000/0xad6b7ddc1462802 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca67 expref: 44 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.115452:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.115455:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.115459:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.115467:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.115487:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.115511:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.115520:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115528:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115536:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.115545:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115549:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115586:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115592:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115602:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115607:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115612:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.115615:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115621:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115628:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854c00) 00010000:00010000:3.0:1746065080.115630:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115630:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.115632:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115636:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14628a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.115638:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115647:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115651:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.115655:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115655:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.115658:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.115660:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.115661:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115664:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.115667:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115669:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a700) 00010000:00010000:2.0:1746065080.115670:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.115671:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130113e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.115672:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.115674:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115676:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc14628aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.115679:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.115688:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.115694:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc1462880 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115694:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc146289c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca9f expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115700:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc146289c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca9f expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.115710:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47600, rc 0) 00000100:00100000:1.0:1746065080.115824:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881261435904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 669us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.115831:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3622 00000100:00100000:3.0:1746065080.116544:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881261435520:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 16502us (16771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.116548:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27910:x1830881261436032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1380us (1633us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.116562:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8600 00000100:00100000:2.0:1746065080.116564:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12208 00000100:00100000:0.0:1746065080.118720:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.118795:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261436288 00000100:00100000:2.0:1746065080.118802:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261436288 00000100:00100000:2.0:1746065080.118889:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12209 00000100:00100000:2.0:1746065080.118895:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27908:x1830881261436288:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065080.118930:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.118954:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9a00/0xad6b7ddc1462864 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca8a expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.118967:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.118970:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.118993:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.119002:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.119009:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065080.119164:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2427, 88 off201008 00000004:00080000:2.0:1746065080.119169:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676137394761ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.119210:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2423, 88 off200576 00000004:00080000:2.0:1746065080.119214:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676137439987ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.119238:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2424, 88 off200664 00000004:00080000:2.0:1746065080.119241:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676137467381ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.119249:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2428, 88 off201096 00000004:00080000:2.0:1746065080.119252:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676137478546ns, next at 676590632635ns, rc = 0 00000100:00100000:0.0:1746065080.120619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.120662:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261436416 00000100:00100000:3.0:1746065080.120667:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261436416 00000100:00100000:3.0:1746065080.120698:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12210 00000100:00100000:3.0:1746065080.120703:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27910:x1830881261436416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.120715:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.120729:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14628b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92caa6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.120767:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc14628bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.120793:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc14628bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.120800:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc14628bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065080.120828:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065080.120832:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065080.120855:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14628b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caa6 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.121005:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc14628bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caa6 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.121013:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.121016:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065080.121018:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6f800, rc 0) 00000100:00100000:3.0:1746065080.121248:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27910:x1830881261436416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 544us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.121254:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12210 00000001:00080000:2.0:1746065080.123372:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975560 is committed 00000004:00080000:2.0:1746065080.123383:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1639 committed 00000004:00080000:2.0:1746065080.123401:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1629 committed 00000004:00080000:2.0:1746065080.123420:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1628 committed 00000004:00080000:2.0:1746065080.123422:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1638 committed 00000004:00010000:2.0:1746065080.123481:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a6de680 reply state ffff88009ad02400 transno 4294975560 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123499:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123507:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.123510:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065080.123512:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065080.123598:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065080.123610:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27908:x1830881261436288:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 4712us (4893us total) trans 4294975560 rc 0/0 00000100:00100000:2.0:1746065080.123617:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12209 00000100:00100000:0.0:1746065080.123636:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1746065080.123640:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123647:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065080.123648:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262641536:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1746065080.123651:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123656:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.123659:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123665:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123673:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.123675:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.123678:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.123683:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46e00/0xad6b7ddc14628b1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065080.123686:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.123747:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262641664:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.123945:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262641920:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.123966:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.123984:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262641792:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.124000:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065080.124036:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.124042:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.124056:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.124060:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae22600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.124063:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.124067:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.124075:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a700) 00010000:00010000:3.0:1746065080.124077:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.124079:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.124083:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462848 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065080.124104:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262641536 00000100:00100000:3.0:1746065080.124110:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262641536 00000100:00100000:3.0:1746065080.124135:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262641920 00000100:00100000:3.0:1746065080.124137:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262641920 00000100:00100000:3.0:1746065080.124148:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262641792 00000100:00100000:3.0:1746065080.124150:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262641792 00000100:00100000:3.0:1746065080.124168:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8601 00000100:00100000:3.0:1746065080.124173:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+84:3761:x1830881262641536:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.124288:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+85:3761:x1830881262641536:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (601us total) trans 17179872550 rc 0/0 00000100:00100000:3.0:1746065080.124294:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8601 00000100:00100000:1.0:1746065080.124302:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8602 00000100:00100000:3.0:1746065080.124307:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8603 00000100:00100000:1.0:1746065080.124308:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+52:3761:x1830881262641920:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.124311:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+52:3760:x1830881262641792:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.124363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065080.124372:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.124375:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.124377:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.124379:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.124380:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065080.124384:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262641664 00000100:00100000:1.0:1746065080.124387:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262641664 00000100:00100000:3.0:1746065080.124402:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+54:3760:x1830881262641792:12345-0@lo:2:osp-syn-0-1.0 Request processed in 90us (401us total) trans 21474839829 rc 0/0 00000100:00100000:1.0:1746065080.124404:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8604 00000100:00100000:3.0:1746065080.124407:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8603 00000100:00100000:1.0:1746065080.124407:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+85:3759:x1830881262641664:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065080.124432:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf4000/2, rc 0, transno 21474839829 00000100:00100000:3.0:1746065080.124437:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262641792:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065080.124836:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6df100/2, rc 0, transno 17179872550 00000100:00100000:0.0:1746065080.124841:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262641536:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.124909:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+86:3759:x1830881262641664:12345-0@lo:2:osp-syn-1-1.0 Request processed in 500us (545us total) trans 17179872551 rc 0/0 00000100:00100000:1.0:1746065080.124915:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8604 00000004:00080000:0.0:1746065080.124920:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6ddf80/2, rc 0, transno 17179872551 00000100:00100000:0.0:1746065080.124923:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262641664:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.124953:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+53:3761:x1830881262641920:12345-0@lo:2:osp-syn-0-1.0 Request processed in 646us (986us total) trans 21474839830 rc 0/0 00000100:00100000:1.0:1746065080.124958:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8602 00000004:00080000:0.0:1746065080.124962:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf7800/2, rc 0, transno 21474839830 00000100:00100000:0.0:1746065080.124964:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262641920:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.126582:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.126631:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261436544 00000100:00100000:2.0:1746065080.126636:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261436544 00000100:00100000:0.0:1746065080.126664:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.127017:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261436672 00000100:00100000:2.0:1746065080.127020:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261436672 00000100:00100000:2.0:1746065080.127043:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12211 00000100:00100000:2.0:1746065080.127059:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27908:x1830881261436544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.127077:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.127094:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92caad expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.127117:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12212 00000100:00100000:3.0:1746065080.127125:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+279:27910:x1830881261436672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.127133:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.127135:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.127141:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f0a0800/0xad6b7ddc14628cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cab4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.127145:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.127157:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.127160:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.127163:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8200, rc 0) 00010000:00010000:3.0:1746065080.127178:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.127185:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127192:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065080.127195:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27908:x1830881261436544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 146us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.127200:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12211 00010000:00010000:3.0:1746065080.127205:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.127210:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127215:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127501:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127508:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127513:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127518:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127522:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.127526:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127531:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127539:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.127541:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.127543:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127547:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc14628d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127564:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127569:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127573:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127577:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.127579:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127583:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127589:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929fd700) 00010000:00010000:3.0:1746065080.127591:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.127593:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127597:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc14628db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.127620:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f0a0800/0xad6b7ddc14628cd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cab4 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.127627:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f0a0800/0xad6b7ddc14628cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cab4 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.127633:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0a0800, rc 0) 00000100:00100000:3.0:1746065080.128425:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+278:27910:x1830881261436672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1298us (1758us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.128432:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12212 00000100:00100000:0.0:1746065080.130248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.130282:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.130576:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261437056 00000100:00100000:1.0:1746065080.130583:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261437056 00000100:00100000:1.0:1746065080.130624:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261436928 00000100:00100000:1.0:1746065080.130626:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261436928 00000100:00100000:1.0:1746065080.130641:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12213 00000100:00100000:1.0:1746065080.130647:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27908:x1830881261437056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.130660:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.130675:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926c00/0xad6b7ddc14628e2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cac2 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.130723:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc14628e9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.130732:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc14628e9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.130741:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc14628e9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065080.130793:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x33f:0x0]: returning size 5 00000004:00200000:1.0:1746065080.130797:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065080.130809:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc14628e9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.130827:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926c00/0xad6b7ddc14628e2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac2 expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.130844:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc14628e9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac2 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.130850:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065080.130852:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065080.130854:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857e00, rc 0) 00000100:00100000:1.0:1746065080.130886:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27908:x1830881261437056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 240us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.130886:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12214 00000100:00100000:1.0:1746065080.130892:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12213 00000100:00100000:0.0:1746065080.130893:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27910:x1830881261436928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.130901:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.130903:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065080.130916:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc14628bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caa6 expref: 279 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.130937:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:0.0:1746065080.130945:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065080.131051:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14628f0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cabb expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.131143:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.131150:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131156:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131165:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.131170:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131174:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131449:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.131456:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131461:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065080.131466:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 0 00010000:00010000:0.0:1746065080.131482:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131487:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131492:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131496:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131500:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.131502:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131507:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131512:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a800) 00010000:00010000:0.0:1746065080.131514:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.131516:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131523:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14628f7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:0.0:1746065080.131530:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ed0a300 reply state ffff88009ade2000 transno 4294975561 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131535:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.131539:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:0.0:1746065080.131541:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065080.131543:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065080.131565:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb2200/0xad6b7ddc14628f0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.131575:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.131580:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:0.0:1746065080.131582:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065080.131583:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8e00, rc 0) 00000100:00100000:0.0:1746065080.132663:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:27910:x1830881261436928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1764us (2373us total) trans 4294975561 rc 0/0 00000100:00100000:0.0:1746065080.132670:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12214 00000100:00100000:0.0:1746065080.134287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.134543:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261437184 00000100:00100000:1.0:1746065080.134551:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261437184 00000100:00100000:1.0:1746065080.135031:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8605 00000100:00100000:1.0:1746065080.135040:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261437184:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.135054:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.135070:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cac9 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065080.135088:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x365:0x0] initial LVB size: 5, mtime: 0x6812d6b8, atime: 0x6812d6b8, ctime: 0x6812d6b8, blocks: 0x8 00010000:00010000:1.0:1746065080.135102:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.135104:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.135111:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.135124:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.135133:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00000100:00100000:1.0:1746065080.135172:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261437184:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 134us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.135177:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8605 00000100:00100000:0.0:1746065080.135932:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.136493:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261437440 00000100:00100000:1.0:1746065080.136500:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261437440 00000100:00100000:1.0:1746065080.136687:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12215 00000100:00100000:1.0:1746065080.136694:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:27910:x1830881261437440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.136709:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.136721:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146291a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cad0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.136812:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.136822:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.136828:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.136851:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.136861:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 282 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.136872:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262642048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.137909:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.140387:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.140524:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262642048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.140544:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.140607:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.140650:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261437568 00000100:00100000:2.0:1746065080.140655:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261437568 00000100:00100000:2.0:1746065080.140690:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8606 00000100:00100000:2.0:1746065080.140696:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881261437568:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065080.140818:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881261437568:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 120us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.140824:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8606 00000100:00100000:1.0:1746065080.141123:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261437696 00000100:00100000:1.0:1746065080.141127:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261437696 00010000:00010000:1.0:1746065080.141145:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.141163:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3623 00000100:00100000:1.0:1746065080.141168:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+283:2005:x1830881261437696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.141177:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.141182:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.141191:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.141211:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462905 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cabb expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.141234:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:1.0:1746065080.141238:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.141245:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.141251:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.141264:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.141283:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+282:2005:x1830881261437696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.141288:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3623 00010000:00010000:0.0:1746065080.141607:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141614:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065080.141632:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 0 00000004:00080000:0.0:1746065080.141755:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x366:0x0], index 0: 0 00000004:00080000:0.0:1746065080.141759:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x367:0x0], index 1: 0 00000004:00080000:0.0:1746065080.141763:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x368:0x0], index 1: 0 00000004:00080000:0.0:1746065080.141766:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x367:0x0], index 0: 0 00010000:00010000:0.0:1746065080.141856:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141862:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141868:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141872:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f182e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.141875:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141880:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141887:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:0.0:1746065080.141890:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065080.141892:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141896:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462921 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.141935:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146291a lrc: 1/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cad0 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.141941:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146291a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cad0 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.141953:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:0.0:1746065080.141977:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:27910:x1830881261437440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5284us (6047us total) trans 4294975562 rc 301/301 00000100:00100000:0.0:1746065080.141982:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12215 00000100:00100000:0.0:1746065080.144297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.144347:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261437824 00000100:00100000:2.0:1746065080.144355:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261437824 00000100:00100000:2.0:1746065080.145054:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8607 00000100:00100000:2.0:1746065080.145063:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261437824:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065080.145164:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261437824:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 102us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.145169:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8607 00000100:00100000:1.0:1746065080.145431:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.145516:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261438080 00000100:00100000:0.0:1746065080.145521:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261438080 00000100:00100000:0.0:1746065080.145563:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4202 00000100:00100000:0.0:1746065080.145569:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27910:x1830881261438080:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.145730:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27910:x1830881261438080:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 161us (299us total) trans 4294975563 rc 0/0 00000100:00100000:0.0:1746065080.145735:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4202 00000100:00100000:1.0:1746065080.150319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.150524:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261438336 00000100:00100000:2.0:1746065080.150533:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261438336 00000100:00100000:2.0:1746065080.151092:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4203 00000100:00100000:2.0:1746065080.151100:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27910:x1830881261438336:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065080.151267:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27910:x1830881261438336:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 168us (955us total) trans 4294975564 rc 0/0 00000100:00100000:2.0:1746065080.151274:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4203 00000100:00100000:1.0:1746065080.151629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.151691:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261438592 00000100:00100000:0.0:1746065080.151695:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261438592 00000100:00100000:0.0:1746065080.151720:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12216 00000100:00100000:0.0:1746065080.151725:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27908:x1830881261438592:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065080.151748:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.151769:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc14628e9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x33f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac2 expref: 283 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.151807:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:0.0:1746065080.151811:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065080.151835:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.151845:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.151853:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00010000:0.0:1746065080.151913:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880076cf4700 reply state ffff880131027000 transno 4294975565 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.151921:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.151926:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:0.0:1746065080.151929:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065080.151931:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065080.151968:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27908:x1830881261438592:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 243us (340us total) trans 4294975565 rc 0/0 00000100:00100000:0.0:1746065080.151973:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12216 00000100:00100000:0.0:1746065080.155127:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.155284:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261438720 00000100:00100000:2.0:1746065080.155290:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261438720 00000100:00100000:2.0:1746065080.155320:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8608 00000100:00100000:2.0:1746065080.155325:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261438720:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065080.155422:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065080.155425:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.155427:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb atime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.155429:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.155430:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065080.155613:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261438720:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 287us (490us total) trans 17179872552 rc 0/0 00000100:00100000:2.0:1746065080.155619:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8608 00000100:00100000:1.0:1746065080.155706:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.155810:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261438976 00000100:00100000:3.0:1746065080.155814:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261438976 00000100:00100000:3.0:1746065080.155983:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12217 00000100:00100000:3.0:1746065080.155989:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261438976:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.156004:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.156017:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462936 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cad7 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.156107:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.156117:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156126:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156133:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.156139:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156143:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156177:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc146294b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.156182:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc146294b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156188:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc146294b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065080.156196:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 0 00010000:00010000:3.0:1746065080.156245:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156250:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156254:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156259:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156263:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.156267:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156272:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156281:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065080.156284:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.156286:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156291:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc146293d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156313:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156321:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156324:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156328:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.156330:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156334:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156340:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:3.0:1746065080.156342:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.156344:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156348:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462944 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.156373:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462936 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cad7 expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.156397:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc146294b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cad7 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.156403:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.156404:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.156406:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1200, rc 0) 00000100:00100000:3.0:1746065080.157008:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261438976:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1018us (1301us total) trans 4294975566 rc 0/0 00000100:00100000:3.0:1746065080.157046:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12217 00000100:00100000:0.0:1746065080.157381:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.157757:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261439232 00000100:00100000:1.0:1746065080.157761:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261439232 00000100:00100000:1.0:1746065080.157807:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4204 00000100:00100000:1.0:1746065080.157812:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27908:x1830881261439232:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065080.157842:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x33f:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462872 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca91 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.157864:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065080.157873:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.157879:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.157925:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.157936:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 286 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.157947:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262642176:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.158142:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.158296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.158346:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261439360 00000100:00100000:3.0:1746065080.158350:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261439360 00000100:00100000:3.0:1746065080.158368:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12218 00000100:00100000:3.0:1746065080.158373:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261439360:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.158388:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.158395:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0a00/0xad6b7ddc1462960 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cade expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.158412:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462967 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.158418:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462967 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.158424:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462967 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.158479:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0a00/0xad6b7ddc1462960 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cade expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.158489:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462967 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cade expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.158494:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.158496:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065080.158498:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0000, rc 0) 00000100:00100000:3.0:1746065080.158525:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261439360:12345-192.168.202.27@tcp:101:bash.0 Request processed in 152us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.158533:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12218 00000100:00100000:0.0:1746065080.160157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.160185:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262642176:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.160203:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065080.160228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.160287:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261439488 00000100:00100000:2.0:1746065080.160292:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261439488 00000100:00100000:3.0:1746065080.160295:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261439744 00000100:00100000:3.0:1746065080.160298:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261439744 00010000:00010000:2.0:1746065080.160319:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 289 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.160324:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12219 00000100:00100000:3.0:1746065080.160329:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261439744:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:2.0:1746065080.160347:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3624 00000100:00100000:2.0:1746065080.160352:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+289:2005:x1830881261439488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.160356:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.160362:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.160366:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 289 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.160371:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1200/0xad6b7ddc146294b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cad7 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.160374:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 289 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.160382:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.160385:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.160386:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8200/0xad6b7ddc14628c6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caad expref: 288 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.160398:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.160401:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.160408:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.160413:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.160425:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.160448:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+287:2005:x1830881261439488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.160454:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3624 00010000:00010000:1.0:1746065080.160534:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.160540:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:1.0:1746065080.160700:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2429, 88 off201184 00000004:00080000:1.0:1746065080.160705:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676178930868ns, next at 676590632635ns, rc = 0 00010000:00010000:3.0:1746065080.160719:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.160726:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.160732:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:3.0:1746065080.160756:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975567 00000004:00010000:3.0:1746065080.160795:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ed08e00 reply state ffff880099700000 transno 4294975568 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.160803:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.160808:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.160810:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.160813:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000040:00080000:1.0:1746065080.160963:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2425, 88 off200752 00000004:00080000:1.0:1746065080.160968:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676179193890ns, next at 676590652783ns, rc = 0 00000100:00100000:3.0:1746065080.160995:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261439744:12345-192.168.202.27@tcp:36:bash.0 Request processed in 665us (766us total) trans 4294975568 rc 0/0 00000040:00080000:1.0:1746065080.160996:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2426, 88 off200840 00000004:00080000:1.0:1746065080.160999:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676179225265ns, next at 676590652783ns, rc = 0 00000100:00100000:3.0:1746065080.161001:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12219 00000020:00080000:3.0:1746065080.161004:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1746065080.161008:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2430, 88 off201272 00000004:00080000:1.0:1746065080.161010:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676179236907ns, next at 676590632635ns, rc = 0 00000100:00100000:2.0:1746065080.163355:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065080.163637:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975569 is committed 00000004:00080000:0.0:1746065080.163643:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1641 committed 00000004:00080000:0.0:1746065080.163658:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1631 committed 00000004:00080000:0.0:1746065080.163664:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1630 committed 00000004:00080000:0.0:1746065080.163665:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1640 committed 00010000:00010000:2.0:1746065080.163745:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163754:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163759:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163765:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.163769:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163798:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163809:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:2.0:1746065080.163812:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.163815:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163819:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14628fe lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163840:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163845:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163850:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163854:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f70be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.163856:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163860:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163865:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:2.0:1746065080.163868:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.163870:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163875:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146292f lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.163883:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.163888:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.163893:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.163897:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.163899:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.163903:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.163909:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:2.0:1746065080.163911:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.163913:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.163916:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc146296e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:3.0:1746065080.163998:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261439872 00000100:00100000:3.0:1746065080.164004:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261439872 00000100:00100000:3.0:1746065080.164034:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12220 00000100:00100000:3.0:1746065080.164041:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261439872:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.164054:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.164062:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462975 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cae5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.164095:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462975 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cae5 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.164104:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462975 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cae5 expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.164116:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.164117:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.164119:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:3.0:1746065080.164150:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:26180:x1830881261439872:12345-192.168.202.27@tcp:101:bash.0 Request processed in 110us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.164155:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12220 00000100:00100000:0.0:1746065080.164294:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ed09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262642432:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065080.164327:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ed08a80 reply state ffff88008f125000 transno 4294975569 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065080.164329:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065080.164336:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.164341:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065080.164343:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065080.164346:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065080.164350:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065080.164351:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1746065080.164351:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1746065080.164355:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462872 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca91 expref: 278 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.164356:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262642688:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.164370:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.164387:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262642304:0@lo:2:osp-syn-1-1.0 00010000:00080000:1.0:1746065080.164399:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065080.164401:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.164412:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27908:x1830881261439232:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 6599us (7032us total) trans 4294975569 rc 0/0 00000100:00100000:0.0:1746065080.164412:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065080.164416:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ed09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262642560:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.164418:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4204 00000100:00100000:0.0:1746065080.164430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.164439:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262642432 00000100:00100000:1.0:1746065080.164441:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262642432 00000100:00100000:0.0:1746065080.164449:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262642688 00000100:00100000:0.0:1746065080.164452:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262642688 00000100:00100000:1.0:1746065080.164458:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262642304 00000100:00100000:1.0:1746065080.164460:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262642304 00000100:00100000:0.0:1746065080.164469:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262642560 00000100:00100000:0.0:1746065080.164471:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262642560 00000100:00100000:1.0:1746065080.164473:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8609 00000100:00100000:1.0:1746065080.164478:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+54:3762:x1830881262642432:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.164482:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8610 00000100:00100000:0.0:1746065080.164486:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+87:3762:x1830881262642688:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065080.164567:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.164570:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.164572:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.164574:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.164575:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065080.164583:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+88:3762:x1830881262642688:12345-0@lo:2:osp-syn-1-1.0 Request processed in 96us (211us total) trans 17179872553 rc 0/0 00000100:00100000:0.0:1746065080.164588:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8610 00000100:00100000:0.0:1746065080.164599:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8611 00000100:00100000:0.0:1746065080.164603:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+87:3759:x1830881262642304:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065080.164641:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065080.164643:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.164644:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb atime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.164647:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.164648:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x365:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065080.165012:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8612 00000100:00100000:2.0:1746065080.165019:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+55:3759:x1830881262642560:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.165123:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.165129:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.165137:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.165141:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.165143:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.165147:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.165153:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff88012f854800) 00010000:00010000:3.0:1746065080.165155:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.165161:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.165164:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46200/0xad6b7ddc1462959 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065080.165516:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+88:3759:x1830881262642304:12345-0@lo:2:osp-syn-1-1.0 Request processed in 912us (1113us total) trans 17179872554 rc 0/0 00000100:00100000:0.0:1746065080.165521:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8611 00000004:00080000:0.0:1746065080.165566:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf5880/2, rc 0, transno 17179872554 00000100:00100000:0.0:1746065080.165570:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262642304:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065080.165585:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf5180/2, rc 0, transno 17179872553 00000100:00100000:0.0:1746065080.165588:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262642688:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.165643:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+56:3759:x1830881262642560:12345-0@lo:2:osp-syn-0-1.0 Request processed in 625us (1211us total) trans 21474839832 rc 0/0 00000100:00100000:2.0:1746065080.165649:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8612 00000004:00080000:0.0:1746065080.165891:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed09c00/2, rc 0, transno 21474839832 00000100:00100000:0.0:1746065080.165895:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262642560:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.166075:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+55:3762:x1830881262642432:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1595us (1744us total) trans 21474839831 rc 0/0 00000100:00100000:1.0:1746065080.166082:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8609 00000004:00080000:0.0:1746065080.166224:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed09880/2, rc 0, transno 21474839831 00000100:00100000:0.0:1746065080.166228:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262642432:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.167246:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.167293:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261440128 00000100:00100000:2.0:1746065080.167299:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261440128 00000100:00100000:2.0:1746065080.167867:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12221 00000100:00100000:2.0:1746065080.167875:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+277:26180:x1830881261440128:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.167890:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.167893:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.167914:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462975 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cae5 expref: 277 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.167929:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:2.0:1746065080.167932:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.167942:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc146297c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92caec expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.167977:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc1462983 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.167986:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc1462983 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.167994:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc1462983 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:2.0:1746065080.168148:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2427, 88 off200928 00000004:00080000:2.0:1746065080.168153:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676186378983ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.168822:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2431, 88 off201360 00000004:00080000:2.0:1746065080.168827:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676187053529ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.168842:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2432, 88 off201448 00000004:00080000:2.0:1746065080.168844:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676187070384ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.168853:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2428, 88 off201016 00000004:00080000:2.0:1746065080.168856:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676187082106ns, next at 676590652783ns, rc = 0 00000100:00100000:0.0:1746065080.169113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.170917:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261440256 00000100:00100000:3.0:1746065080.170925:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261440256 00000100:00100000:3.0:1746065080.170963:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12222 00000100:00100000:3.0:1746065080.170969:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27908:x1830881261440256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.170986:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.171024:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0a00/0xad6b7ddc146298a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92caf3 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.171064:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0a00/0xad6b7ddc146298a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caf3 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.171073:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0a00/0xad6b7ddc146298a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x33f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caf3 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.171086:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065080.171088:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.171090:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0a00, rc 0) 00000100:00100000:3.0:1746065080.171324:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27908:x1830881261440256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 354us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.171330:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12222 00000001:00080000:2.0:1746065080.176716:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975570 is committed 00000004:00080000:2.0:1746065080.176728:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1633 committed 00000004:00080000:2.0:1746065080.176743:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1643 committed 00000004:00080000:2.0:1746065080.176753:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1642 committed 00000004:00080000:2.0:1746065080.176755:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1632 committed 00000100:00100000:0.0:1746065080.176856:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065080.176872:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262642816:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.176883:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065080.176893:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262642944:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.176938:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.177016:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.177476:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262642944 00000100:00100000:1.0:1746065080.177483:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262642944 00000100:00100000:1.0:1746065080.177524:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262642816 00000100:00100000:1.0:1746065080.177527:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262642816 00010000:00010000:0.0:1746065080.177530:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc1462983 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caec expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.177540:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:0.0:1746065080.177542:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065080.177564:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8000/0xad6b7ddc146297c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caec expref: 279 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065080.178240:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc1462983 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caec expref: 278 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.178264:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:0.0:1746065080.178267:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065080.178269:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9e00, rc 0) 00000100:00100000:0.0:1746065080.178308:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+278:26180:x1830881261440128:12345-192.168.202.27@tcp:101:bash.0 Request processed in 10434us (11063us total) trans 4294975570 rc 0/0 00000100:00100000:0.0:1746065080.178315:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12221 00000100:00100000:3.0:1746065080.178760:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8613 00000100:00100000:3.0:1746065080.178768:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+89:3760:x1830881262642944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.178884:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065080.178893:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262643200:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.178910:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+90:3760:x1830881262642944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 143us (1972us total) trans 17179872555 rc 0/0 00000100:00100000:3.0:1746065080.178916:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8613 00000100:00100000:0.0:1746065080.178918:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.178928:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262643200 00000100:00100000:3.0:1746065080.178931:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262643200 00000100:00100000:3.0:1746065080.178949:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8614 00000100:00100000:3.0:1746065080.179255:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+89:3761:x1830881262642816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.179309:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+90:3761:x1830881262642816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 55us (2292us total) trans 17179872556 rc 0/0 00000100:00100000:0.0:1746065080.179374:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8615 00000100:00100000:0.0:1746065080.179381:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+55:3762:x1830881262643200:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.179452:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+56:3762:x1830881262643200:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (534us total) trans 21474839833 rc 0/0 00000100:00100000:0.0:1746065080.179457:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8615 00000004:00080000:0.0:1746065080.179482:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cff480/2, rc 0, transno 21474839833 00000100:00100000:0.0:1746065080.179485:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262643200:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.179492:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065080.179497:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262643072:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.179510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065080.179526:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cfca80/2, rc 0, transno 17179872556 00000100:00100000:0.0:1746065080.179529:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262642816:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.179539:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262643072 00000100:00100000:0.0:1746065080.179541:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262643072 00000100:00100000:0.0:1746065080.179563:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8616 00000100:00100000:0.0:1746065080.179567:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+56:3759:x1830881262643072:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.179612:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+57:3759:x1830881262643072:12345-0@lo:2:osp-syn-0-1.0 Request processed in 44us (101us total) trans 21474839834 rc 0/0 00000100:00100000:0.0:1746065080.179616:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8616 00000004:00080000:0.0:1746065080.179633:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cfc000/2, rc 0, transno 21474839834 00000100:00100000:0.0:1746065080.179636:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262643072:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.179672:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8614 00000004:00080000:3.0:1746065080.179701:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cfd880/2, rc 0, transno 17179872555 00000100:00100000:3.0:1746065080.179705:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262642944:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.182016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.182618:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.182815:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261440512 00000100:00100000:1.0:1746065080.182821:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261440512 00000100:00100000:1.0:1746065080.182860:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4205 00000100:00100000:1.0:1746065080.182867:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27908:x1830881261440512:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065080.183039:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x33f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065080.183088:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2433, 64 off201512 00000040:00080000:1.0:1746065080.183107:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2429, 64 off201080 00000040:00080000:1.0:1746065080.183115:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2430, 64 off201144 00000040:00080000:1.0:1746065080.183123:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2434, 64 off201576 00010000:00010000:1.0:1746065080.183162:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065080.183173:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.183182:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.183188:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.183193:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.183198:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.183216:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065080.183337:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27908:x1830881261440512:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 470us (1327us total) trans 4294975571 rc 0/0 00000100:00100000:1.0:1746065080.183343:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4205 00000100:00100000:0.0:1746065080.183802:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261440640 00000100:00100000:0.0:1746065080.183806:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261440640 00000100:00100000:0.0:1746065080.183832:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8617 00000100:00100000:0.0:1746065080.183838:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:26180:x1830881261440640:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.183847:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.183859:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cafa expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065080.183876:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065080.183888:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.183890:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.183895:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.183906:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.183915:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ac00, rc 0) 00000100:00100000:0.0:1746065080.183936:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:26180:x1830881261440640:12345-192.168.202.27@tcp:101:bash.0 Request processed in 98us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.183941:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8617 00010000:00010000:3.0:1746065080.184028:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.184035:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.184040:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.184044:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.184050:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.184059:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x33f:0x0].0x0 (ffff8800929fd100) 00010000:00010000:3.0:1746065080.184062:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746065080.184065:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.184069:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc1462991 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x33f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.184080:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.184081:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.184082:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.190029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.190121:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261440768 00000100:00100000:2.0:1746065080.190129:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261440768 00000100:00100000:2.0:1746065080.190234:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8618 00000100:00100000:2.0:1746065080.190242:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+44:26180:x1830881261440768:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.190257:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.190271:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb01 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.190289:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.190304:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.190306:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.190311:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 45 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.190323:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 45 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.190331:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:2.0:1746065080.191098:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+45:26180:x1830881261440768:12345-192.168.202.27@tcp:101:bash.0 Request processed in 854us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.191104:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8618 00000100:00100000:0.0:1746065080.196764:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.196825:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.197384:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261441024 00000100:00100000:1.0:1746065080.197391:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261441024 00000100:00100000:0.0:1746065080.197532:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.197596:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261441152 00000100:00100000:3.0:1746065080.197600:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261441152 00002000:00010000:3.0:1746065080.197622:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/870 (0->18446744073709551615) 00002000:00100000:3.0:1746065080.197625:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfc380 with x1830881261441152 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065080.197634:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfc380. 00000100:00100000:3.0:1746065080.197646:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261441280 00000100:00100000:3.0:1746065080.197648:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261441280 00002000:00010000:3.0:1746065080.197656:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/871 (0->18446744073709551615) 00002000:00100000:3.0:1746065080.197658:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cff100 with x1830881261441280 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065080.197664:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cff100. 00000100:00100000:3.0:1746065080.197675:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1269 00000100:00100000:3.0:1746065080.197681:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881261441152:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065080.197830:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.197833:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.197835:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.197837:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.197839:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.197875:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261441152:12345-192.168.202.27@tcp:10:bash.0 Request processed in 194us (1049us total) trans 21474839835 rc 0/0 00000100:00100000:3.0:1746065080.197881:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1269 00002000:00010000:3.0:1746065080.197884:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/870 (0->18446744073709551615) 00002000:00100000:3.0:1746065080.197886:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfc380 with x1830881261441152 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065080.197889:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfc380. 00000100:00100000:3.0:1746065080.197902:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1270 00000100:00100000:3.0:1746065080.197906:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261441280:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065080.197970:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.197972:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.197974:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.197975:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.197977:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.197993:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881261441280:12345-192.168.202.27@tcp:10:bash.0 Request processed in 87us (462us total) trans 17179872557 rc 0/0 00000100:00100000:3.0:1746065080.197998:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1270 00002000:00010000:3.0:1746065080.198000:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/871 (0->18446744073709551615) 00002000:00100000:3.0:1746065080.198002:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cff100 with x1830881261441280 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065080.198005:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cff100. 00000100:00100000:1.0:1746065080.198087:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12223 00000100:00100000:1.0:1746065080.198093:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+279:27912:x1830881261441024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.198106:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.198120:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb08 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.198171:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.198181:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198189:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198198:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.198203:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198208:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198275:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.198282:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198287:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065080.198294:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 2 00010000:00010000:1.0:1746065080.198334:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198339:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198343:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198347:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198351:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.198354:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198362:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198371:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4999900) 00010000:00010000:1.0:1746065080.198373:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.198376:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198381:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc14629ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198395:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198400:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198403:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198407:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.198409:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198413:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198417:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4999f00) 00010000:00010000:1.0:1746065080.198419:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.198421:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198425:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.198452:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.198462:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 281 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.198468:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:1.0:1746065080.198469:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065080.198471:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:1.0:1746065080.198492:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+281:27912:x1830881261441024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 399us (1736us total) trans 4294975572 rc 0/0 00000100:00100000:1.0:1746065080.198497:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12223 00000100:00100000:0.0:1746065080.202444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.203400:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.203464:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261441792 00000100:00100000:2.0:1746065080.203471:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261441792 00000100:00100000:2.0:1746065080.203503:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261441536 00000100:00100000:2.0:1746065080.203505:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261441536 00000100:00100000:2.0:1746065080.203514:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4206 00000100:00100000:2.0:1746065080.203520:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261441792:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065080.203893:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4207 00000100:00100000:0.0:1746065080.203900:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27912:x1830881261441536:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.204193:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27912:x1830881261441536:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 292us (794us total) trans 4294975574 rc 0/0 00000100:00100000:0.0:1746065080.204199:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4207 00000100:00100000:2.0:1746065080.204297:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261441792:12345-192.168.202.27@tcp:35:bash.0 Request processed in 776us (1861us total) trans 4294975573 rc 0/0 00000100:00100000:2.0:1746065080.204302:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4206 00000100:00100000:0.0:1746065080.212329:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.213263:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261442048 00000100:00100000:3.0:1746065080.213273:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261442048 00000100:00100000:3.0:1746065080.213887:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12224 00000100:00100000:3.0:1746065080.213895:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27912:x1830881261442048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.213914:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.213931:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc14629c9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb0f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.214010:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.214021:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.214027:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.214052:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.214063:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 284 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.214073:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262643328:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.214489:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.215031:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.215444:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261442304 00000100:00100000:1.0:1746065080.215449:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261442304 00000100:00100000:1.0:1746065080.215487:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12225 00000100:00100000:1.0:1746065080.215493:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27913:x1830881261442304:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065080.215517:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065080.215531:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a9e00/0xad6b7ddc1462983 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92caec expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.215998:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 284 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.216011:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462967 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cade expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.216021:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:1.0:1746065080.216025:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.216030:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.216035:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.216046:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.216061:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.216066:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.216071:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.216081:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.216087:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.216091:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.216143:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.216148:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.216153:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.216164:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.216169:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.216229:0:7204:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff88012e37f800 x1830881262643328) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 1/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.216238:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc14629bb lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb08 expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.216258:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262643328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.216270:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:3.0:1746065080.216273:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.216278:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.216283:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.216288:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.216292:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065080.216303:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 5 00010000:00010000:3.0:1746065080.216376:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc14629c9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.216388:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.216395:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.216401:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1a00, rc 0) 00000100:00100000:3.0:1746065080.216426:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27912:x1830881261442048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2532us (4103us total) trans 4294975575 rc 0/0 00000100:00100000:3.0:1746065080.216432:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12224 00000100:00100000:0.0:1746065080.219695:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.220595:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261442432 00000100:00100000:1.0:1746065080.220604:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261442432 00010000:00010000:0.0:1746065080.220652:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.221220:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3625 00000100:00100000:0.0:1746065080.221229:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+283:2006:x1830881261442432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.221242:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.221247:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.221263:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.221281:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc14629d0 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x341:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb0f expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.221308:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:0.0:1746065080.221313:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.221321:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.221327:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.221386:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065080.221429:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+282:2006:x1830881261442432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 202us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.221435:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3625 00010000:00010000:1.0:1746065080.221605:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221611:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:1.0:1746065080.221842:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x341:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1746065080.221916:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221923:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221928:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221932:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.221936:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221941:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221947:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff8800929fdb00) 00010000:00010000:1.0:1746065080.221949:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065080.221953:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221956:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc14629e5 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221972:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221976:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221980:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221984:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221987:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.221988:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221993:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.221998:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fd700) 00010000:00010000:1.0:1746065080.221999:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.222001:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.222005:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc14629d7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065080.222013:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f7fc380 reply state ffff88009fade000 transno 4294975576 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.222029:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.222034:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:1.0:1746065080.222035:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.222037:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.222093:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27913:x1830881261442304:12345-192.168.202.27@tcp:36:rm.0 Request processed in 6599us (7603us total) trans 4294975576 rc 0/0 00000100:00100000:1.0:1746065080.222099:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12225 00000100:00100000:0.0:1746065080.223734:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.224153:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261442560 00000100:00100000:1.0:1746065080.224160:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261442560 00000100:00100000:1.0:1746065080.224204:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12226 00000100:00100000:1.0:1746065080.224210:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27912:x1830881261442560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.224227:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.224243:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14629f3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb16 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.224291:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc14629fa lrc: 3/1,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.224300:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc14629fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.224308:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc14629fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065080.224336:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 5 00000004:00200000:1.0:1746065080.224339:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065080.224349:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc14629fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.224367:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc14629f3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb16 expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.224380:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc14629fa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb16 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.224385:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065080.224387:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065080.224390:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46a00, rc 0) 00000100:00100000:1.0:1746065080.224433:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27912:x1830881261442560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 222us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.224438:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12226 00000100:00100000:3.0:1746065080.228010:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.228205:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261442816 00000100:00100000:0.0:1746065080.228215:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261442816 00000100:00100000:0.0:1746065080.228257:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12227 00000100:00100000:0.0:1746065080.228264:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27912:x1830881261442816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.228278:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.228293:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc1462a01 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb1d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.228371:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462a08 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065080.228381:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462a08 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.228390:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462a08 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065080.228399:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 5 00010000:00010000:0.0:1746065080.228569:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b400/0xad6b7ddc1462a01 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb1d expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.228596:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462a08 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb1d expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.228602:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:0.0:1746065080.228605:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065080.228607:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6f800, rc 0) 00000100:00100000:0.0:1746065080.229931:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27912:x1830881261442816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1662us (1922us total) trans 4294975577 rc 0/0 00000100:00100000:0.0:1746065080.229938:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12227 00000100:00100000:2.0:1746065080.229984:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.229996:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261442944 00000100:00100000:0.0:1746065080.230000:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261442944 00000100:00100000:0.0:1746065080.230056:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12228 00000100:00100000:0.0:1746065080.230061:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27914:x1830881261442944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.230071:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.230081:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc1462a16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb24 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.230114:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065080.230121:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230128:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230135:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065080.230140:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230145:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230438:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230444:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230449:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230454:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230459:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.230462:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230470:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230478:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065080.230481:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.230483:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230488:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8c00/0xad6b7ddc1462a1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230496:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230500:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230505:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230508:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.230510:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230514:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230518:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:0.0:1746065080.230520:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.230522:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230526:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8a00/0xad6b7ddc1462a24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.230542:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc1462a16 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb24 expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.230548:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800727a8600/0xad6b7ddc1462a16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb24 expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.230564:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8600, rc 0) 00000100:00100000:0.0:1746065080.232147:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27914:x1830881261442944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2079us (2157us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065080.232155:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12228 00000100:00100000:1.0:1746065080.232207:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.232340:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443072 00000100:00100000:2.0:1746065080.232345:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443072 00000100:00100000:2.0:1746065080.232382:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8619 00000100:00100000:2.0:1746065080.232388:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261443072:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065080.232415:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.232428:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.232434:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065080.232436:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065080.232438:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.232463:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.232473:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 34 pid: 9550 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.232483:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262643456:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.232538:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.234669:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262643456:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.234687:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.234921:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.234954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.235015:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443328 00000100:00100000:1.0:1746065080.235020:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443328 00000100:00100000:1.0:1746065080.235217:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12229 00000100:00100000:1.0:1746065080.235224:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27914:x1830881261443328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.235241:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.235256:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462a32 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb2b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.235405:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443200 00000100:00100000:2.0:1746065080.235409:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443200 00002000:00100000:2.0:1746065080.235433:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x366:0x0] (0->4) req@ffff88008f7fed80 x1830881261443200/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/0 e 0 to 0 dl 1746065091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065080.235441:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881261443200 ext(0->4) 00010000:00010000:2.0:1746065080.235447:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 35 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.235457:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 35 pid: 9550 timeout: 776 lvb_type: 0 00002000:00010000:2.0:1746065080.235463:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7fed80 00000100:00100000:2.0:1746065080.235476:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 218 00000100:00100000:2.0:1746065080.235481:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261443200:12345-192.168.202.27@tcp:4:bash.0 00010000:00010000:1.0:1746065080.235769:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.235816:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235824:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235833:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.235838:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235843:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235866:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235870:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235875:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235880:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235885:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.235888:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235893:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235901:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090535100) 00010000:00010000:1.0:1746065080.235903:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.235906:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235911:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a39 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235921:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235926:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235931:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235934:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.235936:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235940:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235945:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:1.0:1746065080.235947:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.235949:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235953:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a40 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.235970:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462a32 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb2b expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.235976:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462a32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb2b expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.235985:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:1.0:1746065080.237006:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27914:x1830881261443328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1777us (2046us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.237014:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12229 00000100:00100000:2.0:1746065080.237119:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261443200:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1636us (2198us total) trans 21474839836 rc 0/0 00000100:00100000:2.0:1746065080.237126:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 218 00002000:00100000:2.0:1746065080.237133:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x366:0x0] (0->4) req@ffff88008f7fed80 x1830881261443200/t21474839836(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/448 e 0 to 0 dl 1746065091 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065080.237140:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881261443200 ext(0->4) 00010000:00010000:2.0:1746065080.237147:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 37 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.237157:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 37 pid: 9550 timeout: 776 lvb_type: 0 00002000:00010000:2.0:1746065080.237164:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7fed80 00000100:00100000:2.0:1746065080.239092:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.239115:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443456 00000100:00100000:2.0:1746065080.239120:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443456 00010000:00010000:2.0:1746065080.239143:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 37 pid: 9550 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.239689:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3626 00000100:00100000:2.0:1746065080.239696:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261443456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.239708:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065080.239721:0:9565:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1746065080.239724:0:9565:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065080.239729:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 37 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.239739:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 37 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.239757:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462998 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cafa expref: 37 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.239790:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.239792:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.239796:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.239807:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.239992:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.240171:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443584 00000100:00100000:1.0:1746065080.240175:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443584 00010000:00010000:2.0:1746065080.240293:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.240324:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261443456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 628us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.240330:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3626 00010000:00010000:3.0:1746065080.240599:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240608:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240622:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240628:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240634:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240640:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.240643:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240649:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240658:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.240669:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1462a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.240709:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261443072:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 8321us (8503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.240716:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8619 00000100:00100000:1.0:1746065080.241246:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12230 00000100:00100000:1.0:1746065080.241254:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27914:x1830881261443584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.241265:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.241277:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462a47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb32 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.241320:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.241329:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462a4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.241336:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462a4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065080.241363:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065080.241366:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065080.241384:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462a47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb32 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.241395:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462a4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb32 expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.241401:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090535300) 00010000:00010000:1.0:1746065080.241404:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065080.241406:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:1.0:1746065080.241436:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27914:x1830881261443584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 183us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.241440:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12230 00000100:00100000:0.0:1746065080.245496:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.245568:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.245863:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443840 00000100:00100000:1.0:1746065080.245870:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443840 00000100:00100000:1.0:1746065080.246193:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261443968 00000100:00100000:1.0:1746065080.246196:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261443968 00000100:00100000:1.0:1746065080.246371:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12231 00000100:00100000:1.0:1746065080.246378:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27912:x1830881261443840:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065080.246412:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.246433:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46a00/0xad6b7ddc14629fa lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb16 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.246445:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12232 00010000:00010000:1.0:1746065080.246446:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065080.246449:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.246455:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27914:x1830881261443968:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.246465:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.246468:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.246474:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462a5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb39 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.246477:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.246485:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.246509:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.246517:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.246524:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.246531:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.246536:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.246540:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:1.0:1746065080.246633:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2431, 88 off201232 00000004:00080000:1.0:1746065080.246638:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676264863781ns, next at 676590652783ns, rc = 0 00010000:00010000:3.0:1746065080.247279:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247286:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247291:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247296:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247301:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.247304:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247309:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247316:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090535300) 00010000:00010000:3.0:1746065080.247319:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.247322:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247327:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1462a63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247335:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247339:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247344:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247348:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.247350:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247354:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247359:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:3.0:1746065080.247360:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.247363:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247366:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc1462a6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.247387:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462a5c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb39 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.247394:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1462a5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb39 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.247400:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:3.0:1746065080.247443:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27914:x1830881261443968:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 990us (1874us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.247449:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12232 00000040:00080000:1.0:1746065080.247801:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2435, 88 off201664 00000004:00080000:1.0:1746065080.247805:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676266031532ns, next at 676590632635ns, rc = 0 00000040:00080000:1.0:1746065080.247817:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2436, 88 off201752 00000004:00080000:1.0:1746065080.247819:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676266045954ns, next at 676590632635ns, rc = 0 00000040:00080000:1.0:1746065080.247829:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2432, 88 off201320 00000004:00080000:1.0:1746065080.247832:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676266058691ns, next at 676590652783ns, rc = 0 00000100:00100000:0.0:1746065080.250643:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.250713:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261444224 00000100:00100000:3.0:1746065080.250721:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261444224 00000001:00080000:1.0:1746065080.250899:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975578 is committed 00000004:00080000:1.0:1746065080.250904:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1635 committed 00000004:00080000:1.0:1746065080.250909:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1645 committed 00000004:00080000:1.0:1746065080.250913:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1644 committed 00000004:00080000:1.0:1746065080.250915:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1634 committed 00000004:00010000:1.0:1746065080.250956:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f7fdc00 reply state ffff880099d42c00 transno 4294975578 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.250970:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.250976:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065080.250979:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065080.250982:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065080.250991:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.251003:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.251008:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.251012:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.251015:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.251019:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.251027:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009a4b5600) 00010000:00010000:3.0:1746065080.251029:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.251031:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.251036:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc14629de lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00080000:1.0:1746065080.251037:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065080.251057:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12233 00000100:00100000:3.0:1746065080.251064:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27914:x1830881261444224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.251077:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.251080:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065080.251089:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462a4e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb32 expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.251095:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090535300) 00010000:00010000:3.0:1746065080.251100:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.251111:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065080.251121:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262643840:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.251128:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262643584:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.251153:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.251154:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262643968:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.251174:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.251215:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.251231:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262643840 00000100:00100000:0.0:1746065080.251234:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262643840 00000100:00100000:0.0:1746065080.251250:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262643968 00000100:00100000:0.0:1746065080.251251:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262643968 00000100:00100000:0.0:1746065080.251259:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262643584 00000100:00100000:0.0:1746065080.251260:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262643584 00000100:00100000:3.0:1746065080.251769:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262643712:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.251804:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.252415:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27912:x1830881261443840:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 6035us (6923us total) trans 4294975578 rc 0/0 00000100:00100000:1.0:1746065080.252423:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12231 00010000:00010000:2.0:1746065080.252519:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.252527:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.252533:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.252537:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.252540:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.252545:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.252562:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:2.0:1746065080.252564:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.252567:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.252572:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462a55 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:3.0:1746065080.252925:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262643712 00000100:00100000:3.0:1746065080.252929:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262643712 00000100:00100000:3.0:1746065080.252951:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8620 00000100:00100000:3.0:1746065080.252957:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+93:3760:x1830881262643840:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065080.253066:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.253069:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.253071:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.253073:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.253075:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.253101:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+94:3760:x1830881262643840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 144us (1947us total) trans 17179872558 rc 0/0 00000100:00100000:3.0:1746065080.253106:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8620 00000100:00100000:3.0:1746065080.253117:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8621 00000100:00100000:3.0:1746065080.253122:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+93:3761:x1830881262643968:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.253160:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8622 00000100:00100000:2.0:1746065080.253167:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+94:3762:x1830881262643584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065080.253181:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:869 count 1 00000100:00100000:3.0:1746065080.253185:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+94:3761:x1830881262643968:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (2010us total) trans 17179872559 rc 0/0 00000100:00100000:3.0:1746065080.253191:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8621 00010000:00010000:2.0:1746065080.253193:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.253200:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8623 00000100:00100000:3.0:1746065080.253204:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+93:3760:x1830881262643712:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065080.253206:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 45 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.253212:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1746065080.253214:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:870 count 1 00010000:00010000:2.0:1746065080.253214:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.253216:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065080.253225:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.253229:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.253235:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 45 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.253236:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.253237:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.253240:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.253244:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 45 pid: 12260 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.253248:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.253253:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262644096:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.253255:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.253259:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.253271:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065080.253296:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac300 going to sleep for 11 seconds 00000004:00080000:0.0:1746065080.253436:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570c000/2, rc 0, transno 17179872559 00000100:00100000:0.0:1746065080.253441:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262643968:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.253500:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262644352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.253519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.253530:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065080.253534:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262644480:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.253544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.253566:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262644352 00000100:00100000:0.0:1746065080.253569:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262644352 00000100:00100000:0.0:1746065080.253583:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262644480 00000100:00100000:0.0:1746065080.253584:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262644480 00000100:00100000:0.0:1746065080.253593:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8624 00000100:00100000:0.0:1746065080.253597:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+58:3759:x1830881262644352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065080.253606:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:869 count 1 00002000:00010000:0.0:1746065080.253619:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065080.253624:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253631:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.253632:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.253634:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253642:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253648:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253659:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253667:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065080.253770:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+59:3759:x1830881262644352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 172us (251us total) trans 21474839837 rc 0/0 00000100:00100000:0.0:1746065080.253792:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8624 00000100:00100000:0.0:1746065080.253801:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8625 00000100:00100000:0.0:1746065080.253805:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+58:3759:x1830881262644480:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.253850:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+59:3759:x1830881262644480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 45us (304us total) trans 21474839838 rc 0/0 00000100:00100000:0.0:1746065080.253855:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8625 00010000:00010000:0.0:1746065080.253864:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065080.253868:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253874:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.253877:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253883:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253893:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253903:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc1462a78 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253912:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.253915:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253919:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1ac00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.253922:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253927:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253933:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253939:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc1462a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.253946:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.253947:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.253948:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065080.253960:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570d500/2, rc 0, transno 21474839838 00000100:00100000:0.0:1746065080.253963:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262644480:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1746065080.253969:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570ea00/2, rc 0, transno 21474839837 00000100:00100000:0.0:1746065080.253972:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262644352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.253980:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262644608:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.253993:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.254002:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065080.254006:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262644224:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.254017:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.254027:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262644608 00000100:00100000:0.0:1746065080.254029:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262644608 00000100:00100000:0.0:1746065080.254040:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262644224 00000100:00100000:0.0:1746065080.254041:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262644224 00000100:00100000:0.0:1746065080.254049:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8626 00000100:00100000:0.0:1746065080.254053:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+60:3761:x1830881262644608:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.254104:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+61:3761:x1830881262644608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 50us (109us total) trans 21474839839 rc 0/0 00000100:00100000:0.0:1746065080.254109:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8626 00000100:00100000:0.0:1746065080.254117:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8627 00000100:00100000:0.0:1746065080.254121:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+60:3761:x1830881262644224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065080.254128:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:868 count 1 00010000:00010000:0.0:1746065080.254136:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.254145:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.254150:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065080.254151:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065080.254153:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.254167:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.254175:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 34 pid: 3068 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.254184:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262644736:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.254203:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000004:00080000:0.0:1746065080.254219:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570f100/2, rc 0, transno 21474839839 00000100:00100000:0.0:1746065080.254222:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262644608:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.254605:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+94:3760:x1830881262643712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1399us (2798us total) trans 17179872560 rc 0/0 00000100:00100000:3.0:1746065080.254610:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8623 00010000:00010000:3.0:1746065080.254630:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065080.254646:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc000/2, rc 0, transno 17179872558 00000100:00100000:3.0:1746065080.254650:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262643840:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065080.254656:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd500/2, rc 0, transno 17179872560 00000100:00100000:3.0:1746065080.254659:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262643712:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065080.254672:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc1462a8d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb40 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.254739:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.254747:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.254753:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.254761:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.254766:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.254770:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255014:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.255021:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255026:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.255033:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x343:0x0]: returning size 0 00010000:00010000:3.0:1746065080.255053:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255057:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255064:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255069:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255088:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.255090:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255095:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255102:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:3.0:1746065080.255104:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.255107:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255111:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462a94 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065080.255118:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f7fdf80 reply state ffff8801318c4000 transno 4294975579 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255124:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.255129:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:3.0:1746065080.255130:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.255132:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065080.255150:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47c00/0xad6b7ddc1462a8d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 280 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.255167:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 279 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.255173:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:3.0:1746065080.255175:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.255176:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1000, rc 0) 00000100:00100000:3.0:1746065080.255214:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+280:27914:x1830881261444224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4151us (4577us total) trans 4294975579 rc 0/0 00000100:00100000:3.0:1746065080.255221:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12233 00000100:00100000:2.0:1746065080.257070:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262644096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.257094:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.257222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.257235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.257813:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262644736:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.257826:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.257947:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.257999:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261444352 00000100:00100000:2.0:1746065080.258005:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261444352 00010000:00010000:2.0:1746065080.258031:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 46 pid: 12260 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746065080.258051:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261444480 00000100:00100000:2.0:1746065080.258052:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261444480 00010000:00010000:2.0:1746065080.258060:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 35 pid: 3068 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.258072:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3627 00000100:00100000:2.0:1746065080.258078:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881261444352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.258087:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.258091:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 46 pid: 12260 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.258100:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 46 pid: 12260 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.258117:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc1462913 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cac9 expref: 46 pid: 12260 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.258127:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.258129:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.258133:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258144:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258159:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.258185:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261444352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.258192:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3627 00000100:00100000:2.0:1746065080.258203:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3628 00000100:00100000:2.0:1746065080.258208:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261444480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.258214:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.258218:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 35 pid: 3068 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.258227:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 35 pid: 3068 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.258238:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9800/0xad6b7ddc1462810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ca75 expref: 35 pid: 3068 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.258246:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.258247:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.258250:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258255:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258270:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.258280:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261444480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.258285:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3628 00010000:00010000:2.0:1746065080.258298:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258305:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258312:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258318:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258329:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065080.258525:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+94:3762:x1830881262643584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5359us (7308us total) trans 17179872561 rc 0/0 00000100:00100000:2.0:1746065080.258532:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8622 00010000:00010000:2.0:1746065080.258546:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.258550:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258567:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130112400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.258571:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258578:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258586:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258591:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1462a71 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.258603:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.258604:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.258606:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065080.258655:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.258661:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.258670:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.258676:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.258686:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065080.258809:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+61:3761:x1830881262644224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4687us (4791us total) trans 21474839840 rc 0/0 00000100:00100000:1.0:1746065080.258815:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8627 00000004:00080000:1.0:1746065080.258840:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd180/2, rc 0, transno 17179872561 00000100:00100000:1.0:1746065080.258845:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262643584:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065080.258974:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.258979:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.258985:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1a000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.258988:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.258993:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.259002:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.259008:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc1462a86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.259018:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.259019:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.259020:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065080.259036:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570ca80/2, rc 0, transno 21474839840 00000100:00100000:0.0:1746065080.259039:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262644224:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.259071:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.259177:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261444608 00000100:00100000:3.0:1746065080.259181:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261444608 00000100:00100000:3.0:1746065080.259204:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261444864 00000100:00100000:3.0:1746065080.259205:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261444864 00000100:00100000:3.0:1746065080.259217:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12234 00000100:00100000:3.0:1746065080.259222:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27912:x1830881261444608:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.259235:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.259244:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb47 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.259276:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.259285:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.259296:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065080.259298:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.259301:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:3.0:1746065080.259318:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27912:x1830881261444608:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 96us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.259323:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12234 00000100:00100000:3.0:1746065080.259333:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12235 00000100:00100000:3.0:1746065080.259337:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27914:x1830881261444864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.259342:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.259347:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462ab7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb4e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.259393:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.259401:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.259407:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 4/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.259424:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.259432:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 282 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.259441:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262644864:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.259470:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.264520:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.264623:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262644864:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.264644:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065080.265146:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261444992 00000100:00100000:2.0:1746065080.265152:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261444992 00010000:00010000:2.0:1746065080.265178:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.265374:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3629 00000100:00100000:2.0:1746065080.265381:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+283:2007:x1830881261444992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.265395:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.265400:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.265409:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.265426:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1462aa2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb40 expref: 283 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.265438:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:2.0:1746065080.265442:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.265450:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.265455:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.265468:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.265499:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+282:2007:x1830881261444992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 118us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.265504:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3629 00010000:00010000:3.0:1746065080.265611:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.265617:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065080.265635:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x343:0x0]: returning size 0 00000004:00080000:3.0:1746065080.265750:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x369:0x0], index 1: 0 00000004:00080000:3.0:1746065080.265754:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x368:0x0], index 0: 0 00000004:00080000:3.0:1746065080.265757:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x369:0x0], index 0: 0 00000004:00080000:3.0:1746065080.265759:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x36a:0x0], index 1: 0 00000100:00100000:0.0:1746065080.266016:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065080.266194:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266201:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266206:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266211:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.266214:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266219:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266226:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:3.0:1746065080.266229:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.266231:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 2/0,0 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266239:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1462abe lrc: 0/0,0 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.266270:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462ab7 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb4e expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.266277:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462ab7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb4e expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.266286:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47600, rc 0) 00000100:00100000:3.0:1746065080.266317:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27914:x1830881261444864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6979us (7245us total) trans 4294975580 rc 301/301 00000100:00100000:3.0:1746065080.266323:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12235 00000100:00100000:3.0:1746065080.266335:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261445120 00000100:00100000:3.0:1746065080.266338:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261445120 00000100:00100000:3.0:1746065080.267294:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12236 00000100:00100000:3.0:1746065080.267302:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+281:27912:x1830881261445120:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.267318:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.267330:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462acc lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb55 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.267370:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ad3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.267378:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.267385:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065080.267408:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x341:0x0]: returning size 5 00000004:00200000:3.0:1746065080.267411:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.267418:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.267431:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ae22600/0xad6b7ddc1462acc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb55 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.267441:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ad3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb55 expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.267447:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:3.0:1746065080.267449:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065080.267451:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5000, rc 0) 00000100:00100000:3.0:1746065080.267478:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27912:x1830881261445120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 177us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.267483:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12236 00000100:00100000:1.0:1746065080.273138:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.273161:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261445248 00000100:00100000:1.0:1746065080.273168:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261445248 00000100:00100000:1.0:1746065080.273347:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8628 00000100:00100000:1.0:1746065080.273354:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f86cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261445248:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.273367:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.273381:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 2/0,0 mode: --/PR res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb5c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065080.273399:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x366:0x0] initial LVB size: 5, mtime: 0x6812d6b8, atime: 0x0, ctime: 0x6812d6b8, blocks: 0x8 00010000:00010000:1.0:1746065080.273413:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.273415:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.273422:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 35 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.273439:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 35 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.273447:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00000100:00100000:1.0:1746065080.273485:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f86cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261445248:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 131us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.273491:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8628 00000100:00100000:1.0:1746065080.273613:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.273790:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261445504 00000100:00100000:2.0:1746065080.273793:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261445504 00000100:00100000:2.0:1746065080.273816:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4208 00000100:00100000:2.0:1746065080.273821:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27914:x1830881261445504:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065080.273980:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27914:x1830881261445504:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 158us (366us total) trans 4294975581 rc 0/0 00000100:00100000:2.0:1746065080.273986:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4208 00000100:00100000:0.0:1746065080.275867:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.275918:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261445632 00000100:00100000:3.0:1746065080.275924:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261445632 00000100:00100000:3.0:1746065080.275965:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8629 00000100:00100000:3.0:1746065080.275971:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881261445632:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065080.276049:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881261445632:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.276055:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8629 00000100:00100000:0.0:1746065080.276312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.276347:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261445888 00000100:00100000:1.0:1746065080.276350:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261445888 00000100:00100000:1.0:1746065080.276407:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4209 00000100:00100000:1.0:1746065080.276413:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27914:x1830881261445888:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.276532:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27914:x1830881261445888:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 118us (220us total) trans 4294975582 rc 0/0 00000100:00100000:1.0:1746065080.276537:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4209 00000100:00100000:0.0:1746065080.277762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.277791:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261446016 00000100:00100000:1.0:1746065080.277796:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261446016 00000100:00100000:1.0:1746065080.277820:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8630 00000100:00100000:1.0:1746065080.277831:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261446016:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065080.277896:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261446016:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 70us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.277902:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8630 00000100:00100000:0.0:1746065080.279161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.279213:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261446272 00000100:00100000:3.0:1746065080.279217:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261446272 00000100:00100000:3.0:1746065080.279255:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12237 00000100:00100000:3.0:1746065080.279261:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261446272:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.279276:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.279290:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc1462ae1 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb63 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.279383:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.279394:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279403:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279411:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.279416:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279421:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279457:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462af6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.279463:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462af6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279468:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462af6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065080.279475:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x343:0x0]: returning size 0 00010000:00010000:3.0:1746065080.279518:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279524:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279528:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279533:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279537:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.279540:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279545:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279560:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14700) 00010000:00010000:3.0:1746065080.279563:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.279566:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279570:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462ae8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279579:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279583:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279586:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279590:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.279592:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279596:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279600:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:3.0:1746065080.279602:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.279603:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279607:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462aef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.279630:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc1462ae1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb63 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.279640:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462af6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb63 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.279645:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.279647:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.279648:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:3.0:1746065080.279684:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261446272:12345-192.168.202.27@tcp:101:bash.0 Request processed in 423us (525us total) trans 4294975583 rc 0/0 00000100:00100000:3.0:1746065080.279689:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12237 00000100:00100000:0.0:1746065080.281844:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.281923:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261446528 00000100:00100000:1.0:1746065080.281930:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261446528 00000100:00100000:1.0:1746065080.281975:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12238 00000100:00100000:1.0:1746065080.281981:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27912:x1830881261446528:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065080.282015:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.282032:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ad3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x341:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb55 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.282046:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065080.282050:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.282070:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.282079:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.282086:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065080.282157:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009570e680 reply state ffff88009afc9000 transno 4294975584 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.282165:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.282170:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065080.282172:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.282174:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.282234:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27912:x1830881261446528:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 252us (395us total) trans 4294975584 rc 0/0 00000100:00100000:1.0:1746065080.282239:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12238 00000100:00100000:0.0:1746065080.282460:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.282537:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261446656 00000100:00100000:2.0:1746065080.282541:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261446656 00000100:00100000:2.0:1746065080.282570:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12239 00000100:00100000:2.0:1746065080.282575:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261446656:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.282585:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.282593:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b0b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb6a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.282609:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462b12 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.282615:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462b12 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.282621:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462b12 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.282676:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b0b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb6a expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.282686:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462b12 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb6a expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.282691:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.282692:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065080.282694:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00000100:00100000:2.0:1746065080.282727:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261446656:12345-192.168.202.27@tcp:101:bash.0 Request processed in 151us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.282732:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12239 00000100:00100000:0.0:1746065080.284869:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.284911:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261446784 00000100:00100000:2.0:1746065080.284916:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261446784 00000100:00100000:0.0:1746065080.284941:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.284959:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8631 00000100:00100000:2.0:1746065080.284966:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261446784:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:0.0:1746065080.285047:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261447040 00000100:00100000:0.0:1746065080.285050:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261447040 00002000:00010000:2.0:1746065080.285058:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065080.285061:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.285062:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb atime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.285065:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.285066:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065080.285083:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12240 00000100:00100000:0.0:1746065080.285088:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261447040:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:2.0:1746065080.285096:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261446784:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 130us (324us total) trans 21474839841 rc 0/0 00000100:00100000:2.0:1746065080.285102:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8631 00010000:00010000:0.0:1746065080.285117:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.285131:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462af6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb63 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.285152:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:0.0:1746065080.285155:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065080.285237:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.285246:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.285253:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:0.0:1746065080.285273:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975585 00000004:00010000:0.0:1746065080.285283:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009570e300 reply state ffff88012fc03000 transno 4294975586 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.285290:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.285294:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:0.0:1746065080.285296:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065080.285298:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065080.286640:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261447040:12345-192.168.202.27@tcp:36:bash.0 Request processed in 1546us (1693us total) trans 4294975586 rc 0/0 00000100:00100000:0.0:1746065080.286648:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12240 00000020:00080000:0.0:1746065080.286653:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065080.287578:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.287621:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261447424 00000100:00100000:2.0:1746065080.287627:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261447424 00000100:00100000:0.0:1746065080.287697:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.287817:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261447296 00000100:00100000:3.0:1746065080.287821:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261447296 00000100:00100000:0.0:1746065080.287852:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12241 00000100:00100000:3.0:1746065080.287853:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4210 00000100:00100000:3.0:1746065080.287860:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27912:x1830881261447296:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.287860:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261447424:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.287888:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.287901:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462b20 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb71 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1746065080.287903:0:7207:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x341:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462a08 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb1d expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.287929:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065080.287935:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462b20 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb71 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.287937:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.287943:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.287944:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462b20 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb71 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.287957:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:0.0:1746065080.287960:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065080.287962:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f182e00, rc 0) 00010000:00010000:3.0:1746065080.287964:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.287973:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 292 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.287982:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262644992:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.288000:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261447424:12345-192.168.202.27@tcp:101:bash.0 Request processed in 141us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.288005:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12241 00000100:00100000:3.0:1746065080.288025:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.290249:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.290267:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261447552 00000100:00100000:1.0:1746065080.290273:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261447552 00010000:00010000:1.0:1746065080.290298:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 292 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.290326:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3630 00000100:00100000:1.0:1746065080.290331:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+292:2005:x1830881261447552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.290341:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.290346:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 292 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.290355:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 292 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.290368:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:1.0:1746065080.290372:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065080.290378:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065080.290382:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065080.290393:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.290420:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+292:2005:x1830881261447552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.290425:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3630 00000100:00100000:1.0:1746065080.291163:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.291420:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261447808 00000100:00100000:2.0:1746065080.291425:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261447808 00000100:00100000:2.0:1746065080.291449:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12242 00000100:00100000:2.0:1746065080.291454:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261447808:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.291466:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.291468:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.291480:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462b20 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb71 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.291491:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.291494:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.291502:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1462b2e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb78 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.291533:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462b35 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.291540:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462b35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.291546:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462b35 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065080.291721:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2437, 88 off201840 00000004:00080000:2.0:1746065080.291726:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676309952325ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.291751:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2433, 88 off201408 00000004:00080000:2.0:1746065080.291754:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676309980989ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.291764:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2434, 88 off201496 00000004:00080000:2.0:1746065080.291767:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676309993249ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.291790:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2438, 88 off201928 00000004:00080000:2.0:1746065080.291792:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676310018830ns, next at 676590632635ns, rc = 0 00010000:00010000:3.0:1746065080.292062:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1462ab0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb47 expref: 293 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.292073:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262644992:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.292085:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.292091:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065080.292098:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000040:00080000:0.0:1746065080.292826:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2435, 88 off201584 00000004:00080000:0.0:1746065080.292832:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676311058342ns, next at 676590652783ns, rc = 0 00000040:00080000:0.0:1746065080.292846:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2439, 88 off202016 00000004:00080000:0.0:1746065080.292849:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676311075295ns, next at 676590632635ns, rc = 0 00000040:00080000:0.0:1746065080.292857:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2440, 88 off202104 00000004:00080000:0.0:1746065080.292859:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676311085805ns, next at 676590632635ns, rc = 0 00000040:00080000:0.0:1746065080.292866:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2436, 88 off201672 00000004:00080000:0.0:1746065080.292868:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676311094895ns, next at 676590652783ns, rc = 0 00000001:00080000:1.0:1746065080.293450:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975587 is committed 00000004:00080000:1.0:1746065080.293455:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1647 committed 00000004:00080000:1.0:1746065080.293460:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1637 committed 00000004:00080000:1.0:1746065080.293463:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1636 committed 00000004:00080000:1.0:1746065080.293465:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1646 committed 00000100:00100000:1.0:1746065080.293502:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009835b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262645120:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.293516:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262645248:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.293538:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.293568:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262645504:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.293587:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.293608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.293619:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065080.293623:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262645376:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.293637:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065080.293642:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.293650:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.293653:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645120 00000100:00100000:0.0:1746065080.293656:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645120 00010000:00010000:2.0:1746065080.293658:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.293663:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.293666:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.293672:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.293673:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645504 00000100:00100000:0.0:1746065080.293675:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645504 00010000:00010000:2.0:1746065080.293680:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:2.0:1746065080.293682:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065080.293683:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645248 00000100:00100000:0.0:1746065080.293684:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645248 00010000:00010000:2.0:1746065080.293685:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.293688:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462a9b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.293691:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645376 00000100:00100000:0.0:1746065080.293692:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645376 00010000:00010000:2.0:1746065080.293702:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065080.293702:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8632 00010000:00010000:2.0:1746065080.293706:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065080.293706:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+62:3762:x1830881262645120:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1746065080.293709:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.293713:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.293715:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.293719:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.293724:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:2.0:1746065080.293726:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.293728:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.293731:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462b04 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.293739:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.293743:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.293753:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.293756:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0bbc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.293759:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.293763:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.293768:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.293770:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.293792:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.293796:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462b19 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065080.293803:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+63:3762:x1830881262645120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (264us total) trans 21474839842 rc 0/0 00000100:00100000:0.0:1746065080.293809:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8632 00000100:00100000:2.0:1746065080.293814:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8633 00000100:00100000:0.0:1746065080.293818:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8634 00000100:00100000:2.0:1746065080.293820:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+95:3761:x1830881262645504:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.293822:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+62:3759:x1830881262645248:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.293862:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+63:3759:x1830881262645248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 40us (252us total) trans 21474839843 rc 0/0 00000100:00100000:0.0:1746065080.293866:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8634 00000100:00100000:0.0:1746065080.293873:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8635 00000100:00100000:0.0:1746065080.293876:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+96:3759:x1830881262645376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.293896:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+96:3761:x1830881262645504:12345-0@lo:2:osp-syn-1-1.0 Request processed in 76us (307us total) trans 17179872562 rc 0/0 00000100:00100000:2.0:1746065080.293901:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8633 00000100:00100000:0.0:1746065080.293917:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+96:3759:x1830881262645376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 40us (280us total) trans 17179872563 rc 0/0 00000100:00100000:0.0:1746065080.293924:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8635 00000004:00080000:0.0:1746065080.293946:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098358a80/2, rc 0, transno 17179872562 00000100:00100000:0.0:1746065080.293951:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262645504:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065080.293963:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098358000/2, rc 0, transno 17179872563 00000100:00100000:0.0:1746065080.293967:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262645376:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065080.293976:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098358380/2, rc 0, transno 21474839843 00000100:00100000:0.0:1746065080.293980:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262645248:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.294034:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462b35 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb78 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.294040:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.294042:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.294050:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1462b2e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb78 expref: 282 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065080.294060:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462b35 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb78 expref: 281 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.294076:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.294078:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.294080:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47800, rc 0) 00000100:00100000:3.0:1746065080.294109:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261447808:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2655us (2947us total) trans 4294975587 rc 0/0 00000100:00100000:3.0:1746065080.294116:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12242 00000004:00080000:1.0:1746065080.294190:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009835b100/2, rc 0, transno 21474839842 00000100:00100000:1.0:1746065080.294207:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262645120:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.296392:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.296516:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261447936 00000100:00100000:2.0:1746065080.296522:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261447936 00000100:00100000:2.0:1746065080.296708:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8636 00000100:00100000:2.0:1746065080.296716:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+45:26180:x1830881261447936:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.296729:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.296743:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb7f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.296761:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.296820:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.296821:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.296829:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.296839:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.296848:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112800, rc 0) 00000100:00100000:2.0:1746065080.296883:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881261447936:12345-192.168.202.27@tcp:101:bash.0 Request processed in 169us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.296889:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8636 00000001:00080000:0.0:1746065080.298227:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975588 is committed 00000004:00080000:0.0:1746065080.298234:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1639 committed 00000004:00080000:0.0:1746065080.298249:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1649 committed 00000004:00080000:0.0:1746065080.298642:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1648 committed 00000004:00080000:0.0:1746065080.298645:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1638 committed 00000004:00010000:0.0:1746065080.298679:0:7207:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098358700 reply state ffff88008f1db000 transno 4294975588 ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.298692:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065080.298699:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:0.0:1746065080.298702:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065080.298704:0:7207:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065080.298709:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:0.0:1746065080.298710:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065080.298715:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462a08 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb1d expref: 279 pid: 7204 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065080.298801:0:7207:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065080.298810:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+279:27912:x1830881261447296:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 10951us (11112us total) trans 4294975588 rc 0/0 00000100:00100000:0.0:1746065080.298818:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4210 00010000:00010000:2.0:1746065080.299127:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00000100:00100000:1.0:1746065080.299138:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262645632:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.299173:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.299203:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065080.299208:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262646016:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.299225:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.299244:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645632 00000100:00100000:1.0:1746065080.299248:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645632 00000100:00100000:1.0:1746065080.299268:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262646016 00000100:00100000:1.0:1746065080.299269:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262646016 00000100:00100000:1.0:1746065080.299280:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8637 00000100:00100000:1.0:1746065080.299285:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+63:3762:x1830881262645632:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1746065080.299306:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.299313:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.299318:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.299322:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.299328:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.299336:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff880099d36d00) 00010000:00010000:2.0:1746065080.299339:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.299341:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065080.299346:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc1462b27 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00000100:00100000:2.0:1746065080.299371:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8638 00000100:00100000:2.0:1746065080.299378:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+96:3762:x1830881262646016:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.299459:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+97:3762:x1830881262646016:12345-0@lo:2:osp-syn-1-1.0 Request processed in 81us (232us total) trans 17179872564 rc 0/0 00000100:00100000:2.0:1746065080.299464:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8638 00000004:00080000:2.0:1746065080.299491:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf5c00/2, rc 0, transno 17179872564 00000100:00100000:2.0:1746065080.299496:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262646016:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.299769:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262645760:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.299814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.299859:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645760 00000100:00100000:2.0:1746065080.299862:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645760 00000100:00100000:3.0:1746065080.299876:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262645888:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.299882:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8639 00000100:00100000:2.0:1746065080.299887:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+64:3759:x1830881262645760:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.299897:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.299949:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+65:3759:x1830881262645760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 61us (133us total) trans 21474839845 rc 0/0 00000100:00100000:2.0:1746065080.299954:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8639 00000100:00100000:2.0:1746065080.299963:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262645888 00000100:00100000:2.0:1746065080.299965:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262645888 00000100:00100000:2.0:1746065080.299977:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8640 00000100:00100000:2.0:1746065080.299980:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+97:3760:x1830881262645888:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065080.300021:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.300024:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.300026:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.300027:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:2.0:1746065080.300029:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x367:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1746065080.300048:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1746065080.300051:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.300053:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb atime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.300054:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:1.0:1746065080.300056:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x366:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065080.300084:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+65:3762:x1830881262645632:12345-0@lo:2:osp-syn-0-1.0 Request processed in 798us (911us total) trans 21474839844 rc 0/0 00000100:00100000:1.0:1746065080.300089:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8637 00000004:00080000:0.0:1746065080.300144:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec9c00/2, rc 0, transno 21474839845 00000100:00100000:2.0:1746065080.300164:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+98:3760:x1830881262645888:12345-0@lo:2:osp-syn-1-1.0 Request processed in 182us (266us total) trans 17179872565 rc 0/0 00000100:00100000:2.0:1746065080.300173:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8640 00000100:00100000:1.0:1746065080.300177:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.300201:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262645760:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065080.300204:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf6a00/2, rc 0, transno 17179872565 00000100:00100000:3.0:1746065080.300207:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262645888:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.300233:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261448064 00000100:00100000:2.0:1746065080.300236:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261448064 00000100:00100000:2.0:1746065080.300251:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8641 00000100:00100000:2.0:1746065080.300256:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+36:26180:x1830881261448064:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.300264:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.300275:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb86 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.300362:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.300377:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.300378:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.300384:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.300396:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.300403:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00000100:00100000:2.0:1746065080.300424:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261448064:12345-192.168.202.27@tcp:101:bash.0 Request processed in 168us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.300550:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8641 00000004:00080000:2.0:1746065080.300582:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecaa00/2, rc 0, transno 21474839844 00000100:00100000:2.0:1746065080.300586:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262645632:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.301074:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.301118:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261448192 00000100:00100000:3.0:1746065080.301122:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261448192 00000100:00100000:3.0:1746065080.301594:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12243 00000100:00100000:3.0:1746065080.301601:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+278:27912:x1830881261448192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.301614:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.301625:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5400/0xad6b7ddc1462b4a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb8d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.301660:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5400/0xad6b7ddc1462b4a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb8d expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.301669:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5400/0xad6b7ddc1462b4a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x341:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb8d expref: 279 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.301680:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff88009af4dc00) 00010000:00010000:3.0:1746065080.301682:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.301684:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5400, rc 0) 00000100:00100000:3.0:1746065080.301714:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+279:27912:x1830881261448192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 113us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.301720:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12243 00000100:00100000:0.0:1746065080.302160:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.302183:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.302229:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261448320 00000100:00100000:2.0:1746065080.302232:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261448320 00002000:00010000:2.0:1746065080.302250:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/873 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.302253:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009835b480 with x1830881261448320 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.302260:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009835b480. 00000100:00100000:2.0:1746065080.302270:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261448448 00000100:00100000:2.0:1746065080.302272:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261448448 00002000:00010000:2.0:1746065080.302279:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/872 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.302281:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098358e00 with x1830881261448448 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.302284:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098358e00. 00000100:00100000:2.0:1746065080.302293:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1271 00000100:00100000:2.0:1746065080.302297:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881261448320:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:3.0:1746065080.302303:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1272 00000100:00100000:3.0:1746065080.302310:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881261448448:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065080.302396:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x368:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.302399:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x368:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.302401:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x368:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.302403:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x368:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.302405:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x368:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.302422:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881261448448:12345-192.168.202.27@tcp:10:bash.0 Request processed in 112us (238us total) trans 21474839846 rc 0/0 00000100:00100000:3.0:1746065080.302427:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1272 00002000:00010000:3.0:1746065080.302430:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/872 (0->18446744073709551615) 00002000:00100000:3.0:1746065080.302432:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098358e00 with x1830881261448448 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065080.302436:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098358e00. 00002000:00010000:2.0:1746065080.302509:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x369:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.302511:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x369:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.302513:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x369:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.302515:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x369:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.302516:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x369:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.302534:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881261448320:12345-192.168.202.27@tcp:10:bash.0 Request processed in 235us (374us total) trans 17179872566 rc 0/0 00000100:00100000:2.0:1746065080.302539:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1271 00002000:00010000:2.0:1746065080.302541:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/873 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.302543:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009835b480 with x1830881261448320 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.302546:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009835b480. 00000100:00100000:0.0:1746065080.305320:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.305396:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.305441:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261448704 00000100:00100000:1.0:1746065080.305449:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261448704 00000100:00100000:1.0:1746065080.305478:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261448960 00000100:00100000:1.0:1746065080.305479:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261448960 00000100:00100000:1.0:1746065080.305490:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4211 00000100:00100000:1.0:1746065080.305497:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+280:27912:x1830881261448704:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065080.305617:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4212 00000100:00100000:2.0:1746065080.305624:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261448960:12345-192.168.202.27@tcp:35:bash.0 00000004:00080000:1.0:1746065080.305681:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x341:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065080.305729:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2437, 64 off201736 00000040:00080000:1.0:1746065080.305748:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2441, 64 off202168 00000040:00080000:1.0:1746065080.305756:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2442, 64 off202232 00000100:00100000:2.0:1746065080.305791:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+281:26180:x1830881261448960:12345-192.168.202.27@tcp:35:bash.0 Request processed in 166us (393us total) trans 4294975589 rc 0/0 00000100:00100000:2.0:1746065080.305800:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4212 00000040:00080000:1.0:1746065080.306012:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2438, 64 off201800 00010000:00010000:1.0:1746065080.306044:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065080.306056:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.306065:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.306072:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.306076:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.306081:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.306092:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065080.306192:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27912:x1830881261448704:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 694us (878us total) trans 4294975590 rc 0/0 00000100:00100000:1.0:1746065080.306201:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4211 00010000:00010000:3.0:1746065080.306861:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.306868:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.306874:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.306877:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.306883:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.306893:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x341:0x0].0x0 (ffff88009af4dc00) 00010000:00010000:3.0:1746065080.306896:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746065080.306899:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.306904:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b51 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x341:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065080.306926:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.306928:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.306929:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.315862:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.315940:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261449088 00000100:00100000:1.0:1746065080.315947:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261449088 00000100:00100000:3.0:1746065080.317403:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12244 00000100:00100000:3.0:1746065080.317415:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+281:27915:x1830881261449088:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1746065080.317436:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.317455:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462b58 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb94 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.317510:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.317520:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317529:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317537:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.317541:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317545:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317612:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.317619:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317624:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065080.317652:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x343:0x0]: returning size 5 00000004:00200000:3.0:1746065080.317656:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.317667:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317674:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317681:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317686:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317690:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317695:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317699:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.317702:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317707:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317715:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009df61d00) 00010000:00010000:3.0:1746065080.317718:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.317721:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317725:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462b5f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317740:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317744:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317748:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317752:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.317754:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317758:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317762:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009df61800) 00010000:00010000:3.0:1746065080.317764:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.317765:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317768:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462b66 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.317805:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462b58 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb94 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.317820:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb94 expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.317824:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.317826:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.317828:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4e00, rc 0) 00000100:00100000:3.0:1746065080.317888:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27915:x1830881261449088:12345-192.168.202.27@tcp:101:rm.0 Request processed in 477us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.317893:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12244 00000100:00100000:0.0:1746065080.321410:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.321454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.321480:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261449344 00000100:00100000:1.0:1746065080.321488:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261449344 00000100:00100000:3.0:1746065080.321518:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261449600 00000100:00100000:3.0:1746065080.321522:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261449600 00000100:00100000:1.0:1746065080.321530:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12245 00000100:00100000:1.0:1746065080.321537:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27916:x1830881261449344:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065080.321542:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12246 00000100:00100000:3.0:1746065080.321547:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27915:x1830881261449600:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065080.321562:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.321577:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462b74 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cb9b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.321583:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065080.321598:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462b35 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb78 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.321613:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462b6d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb94 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.321622:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462b12 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb6a expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.321628:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.321631:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.321643:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.321646:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.321651:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.321654:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.321657:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.321660:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.321665:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065080.321668:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x343:0x0]: returning size 5 00010000:00010000:3.0:1746065080.321669:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.321673:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.321717:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.321723:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 2/1,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.321727:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.321740:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462b74 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.321748:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.321757:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.321767:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262646144:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.321769:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 6/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.321791:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 6/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.321800:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:1.0:1746065080.321837:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27916:x1830881261449344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 300us (432us total) trans 4294975591 rc 0/0 00000100:00100000:3.0:1746065080.321841:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.321842:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12245 00000100:00100000:3.0:1746065080.325351:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262646144:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.325374:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065080.325835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.325890:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261449728 00000100:00100000:2.0:1746065080.325896:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261449728 00010000:00010000:2.0:1746065080.325922:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.325951:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3631 00000100:00100000:2.0:1746065080.325957:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+282:2007:x1830881261449728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.325967:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.325972:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.325981:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.325996:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462b82 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb9b expref: 282 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.326022:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.326026:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.326033:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.326037:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.326059:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.326090:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+281:2007:x1830881261449728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.326096:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3631 00010000:00010000:3.0:1746065080.326242:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326248:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:3.0:1746065080.326422:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x343:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1746065080.326470:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326478:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326483:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326487:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.326490:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326495:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326501:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.326503:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065080.326506:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326509:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462b97 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x343:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326523:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326526:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326530:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326534:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326537:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.326539:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326543:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326547:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065080.326549:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.326550:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326562:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462b7b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:3.0:1746065080.326571:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009835b800 reply state ffff880099701000 transno 4294975592 ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326577:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.326581:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065080.326583:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.326585:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065080.326616:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27915:x1830881261449600:12345-192.168.202.27@tcp:36:rm.0 Request processed in 5068us (5161us total) trans 4294975592 rc 0/0 00000100:00100000:3.0:1746065080.326621:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12246 00000100:00100000:0.0:1746065080.332043:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.332127:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261449856 00000100:00100000:3.0:1746065080.332135:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261449856 00000100:00100000:3.0:1746065080.332175:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12247 00000100:00100000:3.0:1746065080.332182:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27916:x1830881261449856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.332200:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.332217:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462b9e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cba2 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.332271:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ba5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.332281:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ba5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.332291:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ba5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065080.332323:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x343:0x0]: returning size 5 00000004:00200000:3.0:1746065080.332326:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.332337:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ba5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.332357:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462b9e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x343:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cba2 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.332370:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5000/0xad6b7ddc1462ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x343:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cba2 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.332377:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800929a3b00) 00010000:00010000:3.0:1746065080.332379:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065080.332382:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5000, rc 0) 00000100:00100000:3.0:1746065080.332420:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27916:x1830881261449856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 238us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.332426:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12247 00000100:00100000:0.0:1746065080.336852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.337517:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261450112 00000100:00100000:1.0:1746065080.337526:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261450112 00000100:00100000:1.0:1746065080.337586:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4213 00000100:00100000:1.0:1746065080.337593:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27916:x1830881261450112:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065080.337758:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x343:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065080.337816:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2443, 64 off202296 00000040:00080000:1.0:1746065080.337831:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2439, 64 off201864 00000040:00080000:1.0:1746065080.337837:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2440, 64 off201928 00000040:00080000:1.0:1746065080.337843:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2444, 64 off202360 00010000:00010000:1.0:1746065080.337878:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 3/0,1 mode: --/PW res: [0x240000403:0x343:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065080.337891:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.337900:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.337906:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.337911:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.337915:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065080.337937:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065080.338066:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27916:x1830881261450112:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 472us (1220us total) trans 4294975593 rc 0/0 00000100:00100000:1.0:1746065080.338072:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4213 00010000:00010000:2.0:1746065080.338974:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.338981:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.338987:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.338991:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.338997:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.339009:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x343:0x0].0x0 (ffff8800929a3b00) 00010000:00010000:2.0:1746065080.339011:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065080.339014:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 1/0,0 mode: --/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.339019:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462bac lrc: 0/0,0 mode: --/PW res: [0x240000403:0x343:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.339030:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.339032:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.339033:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.343907:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.344616:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261450240 00000100:00100000:2.0:1746065080.344625:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261450240 00000100:00100000:2.0:1746065080.344678:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12248 00000100:00100000:2.0:1746065080.344686:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27917:x1830881261450240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.344706:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.344723:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462bb3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cba9 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.344807:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.344817:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344826:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344834:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.344839:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344844:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344878:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344883:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344888:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344893:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344898:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.344900:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344908:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344917:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c800) 00010000:00010000:2.0:1746065080.344920:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.344923:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344927:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462bba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344937:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344941:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344946:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344949:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.344951:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344956:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344961:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065080.344963:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.344965:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344969:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462bc1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.344991:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462bb3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cba9 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.344998:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462bb3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cba9 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.345008:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0e00, rc 0) 00000100:00100000:2.0:1746065080.345056:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27917:x1830881261450240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 370us (1155us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065080.345062:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12248 00000100:00100000:0.0:1746065080.349117:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.350146:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261450368 00000100:00100000:2.0:1746065080.350154:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261450368 00000100:00100000:2.0:1746065080.351991:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12249 00000100:00100000:2.0:1746065080.352004:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27917:x1830881261450368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.352022:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.352040:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0600/0xad6b7ddc1462bc8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbb0 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.352095:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.352105:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352115:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352123:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.352132:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352136:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352165:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352170:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352174:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352179:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352184:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.352188:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352193:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352202:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.352205:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.352207:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352212:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462bcf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352221:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352226:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352229:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352233:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.352235:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352238:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352243:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065080.352244:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.352246:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352250:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462bd6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.352270:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0600/0xad6b7ddc1462bc8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbb0 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.352276:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0600/0xad6b7ddc1462bc8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbb0 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.352287:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0600, rc 0) 00000100:00100000:2.0:1746065080.353398:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27917:x1830881261450368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1396us (4283us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065080.353406:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12249 00000100:00100000:0.0:1746065080.359148:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.359259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.359313:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261450496 00000100:00100000:2.0:1746065080.359321:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261450496 00000100:00100000:2.0:1746065080.359609:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261450624 00000100:00100000:2.0:1746065080.359612:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261450624 00000100:00100000:1.0:1746065080.359651:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12250 00000100:00100000:3.0:1746065080.359656:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12251 00000100:00100000:1.0:1746065080.359659:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27917:x1830881261450496:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065080.359663:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27916:x1830881261450624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.359678:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.359682:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.359694:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462bdd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbb7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.359704:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc1462be4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbbe expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.359738:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.359738:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462beb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.359747:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359756:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359764:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.359769:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359793:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359824:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.359909:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462beb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.359917:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462beb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.359926:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359931:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359935:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359940:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.359943:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065080.359946:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00010000:00010000:3.0:1746065080.359948:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065080.359949:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065080.359957:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880134bac200) 00010000:00010000:3.0:1746065080.359959:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.359962:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359966:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5600/0xad6b7ddc1462bf2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.359972:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462bdd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbb7 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.359973:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359978:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.359982:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.359985:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462beb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbb7 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.359986:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.359988:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.359990:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880134bac200) 00010000:00010000:3.0:1746065080.359992:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.359992:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065080.359994:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47800, rc 0) 00010000:00010000:3.0:1746065080.359996:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065080.359998:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.359999:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.360002:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc1462bf9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.360016:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc1462be4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbbe expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.360021:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc1462be4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbbe expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.360026:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5800, rc 0) 00000100:00100000:1.0:1746065080.360031:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27917:x1830881261450496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 373us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.360036:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12250 00000100:00100000:3.0:1746065080.360038:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27916:x1830881261450624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 377us (781us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.360042:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12251 00000100:00100000:1.0:1746065080.363910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.363965:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261450880 00000100:00100000:3.0:1746065080.363973:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261450880 00000100:00100000:3.0:1746065080.364016:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12252 00000100:00100000:3.0:1746065080.364023:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27917:x1830881261450880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.364040:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.364043:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065080.364066:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462beb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbb7 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.364079:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880134bac200) 00010000:00010000:3.0:1746065080.364087:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.364096:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462c00 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbc5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.364170:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.364180:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364188:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364195:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.364201:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364206:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364448:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.364454:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364459:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.364465:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00010000:00010000:3.0:1746065080.364482:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364487:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364491:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364495:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364499:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.364502:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364507:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364514:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9300) 00010000:00010000:3.0:1746065080.364516:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.364518:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364523:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462c07 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065080.364531:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a6dc380 reply state ffff8801315d8000 transno 4294975594 ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364537:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.364541:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:3.0:1746065080.364544:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.364546:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065080.364572:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462c00 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.364583:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.364588:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:3.0:1746065080.364590:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.364591:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f182e00, rc 0) 00000100:00100000:3.0:1746065080.364636:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27917:x1830881261450880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 613us (735us total) trans 4294975594 rc 0/0 00000100:00100000:3.0:1746065080.364641:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12252 00000100:00100000:0.0:1746065080.367173:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.367262:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261451136 00000100:00100000:3.0:1746065080.367269:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261451136 00000100:00100000:3.0:1746065080.368712:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12253 00000100:00100000:3.0:1746065080.368723:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27917:x1830881261451136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.368744:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.368847:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462c23 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbcc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.368930:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.368941:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.368947:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 4/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.368970:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.368979:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 288 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.368996:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262646272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.369090:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.369525:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.369596:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261451392 00000100:00100000:2.0:1746065080.369622:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261451392 00000100:00100000:2.0:1746065080.369651:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12254 00000100:00100000:2.0:1746065080.369657:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27918:x1830881261451392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.369666:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.369673:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c31 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbd3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.369708:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.369716:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.369724:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.369732:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00010000:00010000:2.0:1746065080.370627:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370634:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370639:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370644:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.370647:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370652:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370661:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065080.370664:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065080.370666:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370670:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c38 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.370702:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c31 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbd3 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.370708:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c31 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbd3 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.370714:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0e00, rc 0) 00000100:00100000:2.0:1746065080.370893:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27918:x1830881261451392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1234us (1366us total) trans 4294975595 rc 301/301 00000100:00100000:2.0:1746065080.370899:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12254 00000100:00100000:3.0:1746065080.371149:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262646272:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.371163:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.372612:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.372652:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261451520 00000100:00100000:1.0:1746065080.372658:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261451520 00010000:00010000:1.0:1746065080.372683:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 290 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.372718:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3632 00000100:00100000:1.0:1746065080.372724:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+290:2005:x1830881261451520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.372734:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.372739:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 290 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.372748:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 290 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.372761:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462c15 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbc5 expref: 290 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.372941:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065080.372946:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.372954:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.372962:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.372978:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.373045:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373051:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.373070:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00000004:00080000:3.0:1746065080.373199:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x36a:0x0], index 0: 0 00000004:00080000:3.0:1746065080.373204:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x36b:0x0], index 1: 0 00000004:00080000:3.0:1746065080.373208:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x36c:0x0], index 1: 0 00000004:00080000:3.0:1746065080.373211:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x36b:0x0], index 0: 0 00010000:00010000:3.0:1746065080.373286:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373292:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373297:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373302:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.373305:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373311:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373319:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:3.0:1746065080.373321:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.373323:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373331:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c2a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.373364:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462c23 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbcc expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.373370:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462c23 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbcc expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.373381:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:1.0:1746065080.373421:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+289:2005:x1830881261451520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 696us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.373427:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3632 00000100:00100000:3.0:1746065080.374583:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27917:x1830881261451136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5855us (7409us total) trans 4294975596 rc 301/301 00000100:00100000:3.0:1746065080.374590:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12253 00000100:00100000:2.0:1746065080.380470:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.384716:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261451776 00000100:00100000:0.0:1746065080.384727:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261451776 00000100:00100000:0.0:1746065080.384767:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4214 00000100:00100000:0.0:1746065080.384784:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27917:x1830881261451776:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.384992:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27917:x1830881261451776:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 216us (4529us total) trans 4294975597 rc 0/0 00000100:00100000:0.0:1746065080.384998:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4214 00000100:00100000:0.0:1746065080.387473:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.387520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.387529:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261452032 00000100:00100000:1.0:1746065080.387535:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261452032 00000100:00100000:1.0:1746065080.387576:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4215 00000100:00100000:1.0:1746065080.387582:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27917:x1830881261452032:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.387737:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27917:x1830881261452032:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 154us (270us total) trans 4294975598 rc 0/0 00000100:00100000:1.0:1746065080.387743:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4215 00000100:00100000:3.0:1746065080.387920:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261452160 00000100:00100000:3.0:1746065080.387923:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261452160 00000100:00100000:3.0:1746065080.387949:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12255 00000100:00100000:3.0:1746065080.387954:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27918:x1830881261452160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.387962:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.387976:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462c4d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbda expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.388026:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462c54 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.388036:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462c54 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.388044:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462c54 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.388067:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00000004:00200000:3.0:1746065080.388071:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.388080:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462c54 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.388098:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462c4d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbda expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.388108:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462c54 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbda expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.388115:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.388117:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.388120:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9200, rc 0) 00000100:00100000:3.0:1746065080.388154:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27918:x1830881261452160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 199us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.388159:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12255 00000100:00100000:0.0:1746065080.391160:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.391205:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261452288 00000100:00100000:2.0:1746065080.391212:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261452288 00000100:00100000:2.0:1746065080.391244:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8642 00000100:00100000:2.0:1746065080.391250:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881261452288:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.391263:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.391276:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbe1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.391293:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.391305:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.391306:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.391313:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.391325:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.391334:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0c00, rc 0) 00000100:00100000:2.0:1746065080.391377:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881261452288:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 126us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.391382:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8642 00000100:00100000:0.0:1746065080.394549:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.394599:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261452544 00000100:00100000:2.0:1746065080.394606:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261452544 00000100:00100000:2.0:1746065080.394652:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12256 00000100:00100000:2.0:1746065080.394658:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261452544:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.394676:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.394693:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462c62 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbe8 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.394835:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.394845:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.394856:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.394864:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.394869:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.394874:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.394914:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c77 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.394921:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c77 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.394926:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c77 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.394933:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00010000:00010000:2.0:1746065080.394990:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.394996:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395000:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395005:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395009:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.395013:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395021:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395029:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cc00) 00010000:00010000:2.0:1746065080.395032:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.395035:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395038:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462c69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395061:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395065:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395070:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395073:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.395076:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395080:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395086:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065080.395088:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.395094:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395098:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462c70 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.395124:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462c62 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe8 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.395140:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c77 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe8 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.395145:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.395147:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.395149:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1200, rc 0) 00000100:00100000:2.0:1746065080.395196:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261452544:12345-192.168.202.27@tcp:101:bash.0 Request processed in 537us (653us total) trans 4294975599 rc 0/0 00000100:00100000:2.0:1746065080.395203:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12256 00000100:00100000:0.0:1746065080.396649:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.396705:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261452800 00000100:00100000:1.0:1746065080.396711:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261452800 00000100:00100000:1.0:1746065080.396750:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4216 00000100:00100000:1.0:1746065080.396756:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27918:x1830881261452800:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.396906:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27918:x1830881261452800:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 149us (261us total) trans 4294975600 rc 0/0 00000100:00100000:1.0:1746065080.396912:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4216 00000100:00100000:1.0:1746065080.403029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.403107:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261452928 00000100:00100000:3.0:1746065080.403114:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261452928 00000100:00100000:3.0:1746065080.403157:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12257 00000100:00100000:3.0:1746065080.403164:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261452928:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.403580:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.403596:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc1462c85 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbef expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.403624:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462c8c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.403638:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462c8c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.403648:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462c8c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.403705:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065080.403730:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9400/0xad6b7ddc1462c85 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbef expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.403756:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462c8c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbef expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.403763:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.403766:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1746065080.403767:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261453056 00010000:00010000:3.0:1746065080.403768:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9600, rc 0) 00000100:00100000:1.0:1746065080.403770:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261453056 00000100:00100000:1.0:1746065080.403817:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 556 00000100:00100000:1.0:1746065080.403823:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2007:x1830881261453056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065080.403825:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261452928:12345-192.168.202.27@tcp:101:bash.0 Request processed in 661us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.403830:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12257 00010000:00010000:1.0:1746065080.403831:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.403841:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1200/0xad6b7ddc1462c77 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe8 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.403849:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:1.0:1746065080.403852:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.403868:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881261453056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.403873:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 556 00000100:00100000:1.0:1746065080.403906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.405355:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261453312 00000100:00100000:3.0:1746065080.405362:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261453312 00000100:00100000:3.0:1746065080.405397:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12258 00000100:00100000:3.0:1746065080.405402:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27918:x1830881261453312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.405416:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.405425:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462c93 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbf6 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.405487:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c9a lrc: 3/1,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.405499:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c9a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.405506:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c9a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.405514:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00010000:00010000:3.0:1746065080.405591:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462c93 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbf6 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.405602:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c9a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbf6 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.405607:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.405609:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065080.405611:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47600, rc 0) 00000100:00100000:3.0:1746065080.405649:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:27918:x1830881261453312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 246us (1742us total) trans 4294975601 rc 0/0 00000100:00100000:3.0:1746065080.405654:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12258 00000100:00100000:2.0:1746065080.407573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.407625:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261453568 00000100:00100000:3.0:1746065080.407630:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261453568 00000100:00100000:3.0:1746065080.407670:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12259 00000100:00100000:3.0:1746065080.407677:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261453568:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065080.407706:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.407723:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462c54 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbda expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.407927:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.407982:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261453696 00000100:00100000:2.0:1746065080.407986:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261453696 00000100:00100000:2.0:1746065080.408007:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12260 00000100:00100000:2.0:1746065080.408012:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:27918:x1830881261453696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.408020:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.408030:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0600/0xad6b7ddc1462ca8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cbfd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.408085:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.408094:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.408101:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.408120:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00000004:00200000:2.0:1746065080.408123:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.408133:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.408150:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0600/0xad6b7ddc1462ca8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.408160:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.408167:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.408169:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.408171:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1400, rc 0) 00010000:00010000:3.0:1746065080.408247:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.408250:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.408359:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.408368:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.408373:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065080.409575:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:27918:x1830881261453696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 190us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.409586:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12260 00010000:00010000:3.0:1746065080.409809:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.409820:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 297 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.409831:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262646400:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.409909:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.412278:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.412328:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.412397:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261454080 00000100:00100000:2.0:1746065080.412403:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261454080 00000100:00100000:2.0:1746065080.412449:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12261 00000100:00100000:2.0:1746065080.412456:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+298:27918:x1830881261454080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.412474:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.412490:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462cbd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc04 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.412559:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.412573:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412582:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412591:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.412597:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412602:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412674:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.412682:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065080.412687:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261453824 00010000:00010000:2.0:1746065080.412688:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065080.412690:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261453824 00000004:00200000:2.0:1746065080.412695:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 0 00010000:00010000:1.0:1746065080.412703:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 300 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.412720:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3633 00000100:00100000:1.0:1746065080.412724:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+300:2004:x1830881261453824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.412731:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.412735:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 301 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.412743:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 301 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.412751:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412755:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.412757:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.412760:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.412760:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.412765:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.412767:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.412770:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.412792:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.412794:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412800:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.412804:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.412805:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c900) 00010000:00010000:2.0:1746065080.412807:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.412810:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412814:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4800/0xad6b7ddc1462cc4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412822:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412826:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412830:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065080.412833:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+301:2004:x1830881261453824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (505us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065080.412834:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.412836:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065080.412839:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3633 00010000:00010000:2.0:1746065080.412840:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412844:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065080.412846:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.412848:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.412853:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5c00/0xad6b7ddc1462ccb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.413095:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1400/0xad6b7ddc1462caf lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbfd expref: 300 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.413105:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262646400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.413118:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.413124:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.413129:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:3.0:1746065080.413174:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975602 00000004:00010000:3.0:1746065080.413192:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aecb480 reply state ffff880099704000 transno 4294975604 ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.413200:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.413205:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.413207:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.413209:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065080.413246:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261453568:12345-192.168.202.27@tcp:36:bash.0 Request processed in 5570us (5678us total) trans 4294975604 rc 0/0 00000100:00100000:3.0:1746065080.413251:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12259 00000020:00080000:3.0:1746065080.413254:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1746065080.414058:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc1462cbd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 301 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.414075:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 300 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.414082:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.414083:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:2.0:1746065080.414085:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:2.0:1746065080.414155:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+300:27918:x1830881261454080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1698us (1882us total) trans 4294975603 rc 0/0 00000100:00100000:2.0:1746065080.414160:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12261 00000100:00100000:0.0:1746065080.414838:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.415033:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261454336 00000100:00100000:2.0:1746065080.415038:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261454336 00000100:00100000:2.0:1746065080.415210:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4217 00000100:00100000:2.0:1746065080.415217:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261454336:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065080.415319:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261454336:12345-192.168.202.27@tcp:35:bash.0 Request processed in 103us (481us total) trans 4294975605 rc 0/0 00000100:00100000:2.0:1746065080.415325:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4217 00000100:00100000:0.0:1746065080.418927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.418972:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261454592 00000100:00100000:1.0:1746065080.418980:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261454592 00000100:00100000:1.0:1746065080.419027:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4218 00000100:00100000:1.0:1746065080.419034:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+301:27918:x1830881261454592:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.419209:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+302:27918:x1830881261454592:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 175us (290us total) trans 4294975606 rc 0/0 00000100:00100000:1.0:1746065080.419216:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4218 00000100:00100000:0.0:1746065080.419689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.419744:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261454848 00000100:00100000:2.0:1746065080.419748:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261454848 00000100:00100000:2.0:1746065080.419932:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12262 00000100:00100000:2.0:1746065080.419940:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261454848:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.419952:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.419955:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.419976:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462c9a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbf6 expref: 302 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.419990:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.419994:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.420003:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462ce0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc0b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.420032:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.420042:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.420047:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.420071:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.420081:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 302 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.420091:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262646528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.420148:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.423674:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.423741:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.423796:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261455104 00000100:00100000:3.0:1746065080.423804:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261455104 00010000:00010000:3.0:1746065080.423832:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 303 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.423856:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3634 00000100:00100000:3.0:1746065080.423862:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+303:2005:x1830881261455104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.423873:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.423878:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 303 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.423888:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 303 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.423904:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.423908:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.423915:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.423921:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.423933:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.423968:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+303:2005:x1830881261455104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.423974:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3634 00000100:00100000:3.0:1746065080.423994:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261454976 00000100:00100000:3.0:1746065080.423996:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261454976 00000100:00100000:3.0:1746065080.424012:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4219 00000100:00100000:3.0:1746065080.424017:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+303:27918:x1830881261454976:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065080.424098:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+303:27918:x1830881261454976:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 81us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.424104:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4219 00010000:00010000:3.0:1746065080.424143:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4a00/0xad6b7ddc1462cd2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc04 expref: 302 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.424155:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262646528:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.424168:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.424175:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.424183:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:3.0:1746065080.424343:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2441, 88 off202016 00000004:00080000:3.0:1746065080.424348:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676442573885ns, next at 676590652783ns, rc = 0 00000040:00080000:3.0:1746065080.424374:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2445, 88 off202448 00000004:00080000:3.0:1746065080.424378:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676442604100ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.424415:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2446, 88 off202536 00000004:00080000:3.0:1746065080.424418:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676442644490ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.424432:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2442, 88 off202104 00000004:00080000:3.0:1746065080.424436:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676442662485ns, next at 676590652783ns, rc = 0 00000001:00080000:0.0:1746065080.428541:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975607 is committed 00000004:00080000:0.0:1746065080.428561:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1641 committed 00000004:00080000:0.0:1746065080.428579:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1651 committed 00000004:00080000:0.0:1746065080.428585:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1650 committed 00000004:00080000:0.0:1746065080.428587:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1640 committed 00010000:00010000:2.0:1746065080.428662:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.428676:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.428683:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.428687:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4c00 already unused, calling callback (ffffffffa0f21690) 00000100:00100000:3.0:1746065080.429193:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262646912:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.429242:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.429274:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065080.429278:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262646784:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.429292:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.429302:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647296:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.429314:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.429358:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262647040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.429400:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262646656:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065080.429487:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429494:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429506:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065080.429509:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.429512:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429517:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc1462b89 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429529:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429534:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429538:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429542:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.429545:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429549:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429564:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800929a3600) 00010000:00010000:2.0:1746065080.429565:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.429567:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429572:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4e00/0xad6b7ddc1462c0e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.429585:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429589:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429593:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429600:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.429602:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429606:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429611:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.429612:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.429614:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.429618:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835de00/0xad6b7ddc1462cb6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065080.430562:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647424:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.430586:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.430599:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647936:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.430610:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.430621:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065080.430625:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647808:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.430635:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.430652:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262646912 00000100:00100000:3.0:1746065080.430658:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262646912 00000100:00100000:3.0:1746065080.430681:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262646784 00000100:00100000:3.0:1746065080.430683:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262646784 00000100:00100000:3.0:1746065080.430691:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647296 00000100:00100000:3.0:1746065080.430693:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647296 00000100:00100000:3.0:1746065080.430700:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647424 00000100:00100000:3.0:1746065080.430701:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647424 00000100:00100000:3.0:1746065080.430710:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647936 00000100:00100000:3.0:1746065080.430711:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647936 00000100:00100000:3.0:1746065080.430716:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647808 00000100:00100000:3.0:1746065080.430718:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647808 00000100:00100000:3.0:1746065080.430726:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8643 00000100:00100000:3.0:1746065080.430731:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+100:3760:x1830881262646912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.430750:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:873 count 1 00010000:00010000:3.0:1746065080.430767:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430796:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430802:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.430804:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.430806:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430824:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430834:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 46 pid: 12260 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.430849:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262648192:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.430886:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.430898:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8644 00000100:00100000:3.0:1746065080.430903:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+100:3760:x1830881262646784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.430912:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:872 count 1 00002000:00010000:3.0:1746065080.430925:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.430930:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430936:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.430937:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.430941:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430950:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430956:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430962:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.430973:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065080.431110:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+101:3760:x1830881262646784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 207us (1816us total) trans 17179872567 rc 0/0 00000100:00100000:3.0:1746065080.431119:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8644 00000100:00100000:3.0:1746065080.431130:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8645 00000100:00100000:3.0:1746065080.431134:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+100:3760:x1830881262647296:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.431189:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+101:3760:x1830881262647296:12345-0@lo:2:osp-syn-1-1.0 Request processed in 54us (1874us total) trans 17179872568 rc 0/0 00000100:00100000:3.0:1746065080.431194:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8645 00000100:00100000:3.0:1746065080.431201:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8646 00000100:00100000:3.0:1746065080.431205:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+67:3760:x1830881262647424:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065080.431214:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:870 count 1 00010000:00010000:3.0:1746065080.431224:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431234:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 38 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.431239:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.431240:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.431242:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431255:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 38 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.431262:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 38 pid: 9549 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.431270:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262648320:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.431287:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.431299:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8647 00000100:00100000:3.0:1746065080.431303:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3760:x1830881262647936:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065080.431350:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.431352:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.431354:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.431356:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.431357:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.431373:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+68:3760:x1830881262647936:12345-0@lo:2:osp-syn-0-1.0 Request processed in 70us (763us total) trans 21474839847 rc 0/0 00000100:00100000:3.0:1746065080.431378:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8647 00000100:00100000:3.0:1746065080.431387:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8648 00000100:00100000:3.0:1746065080.431390:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+67:3760:x1830881262647808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065080.431397:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:873 count 1 00002000:00010000:3.0:1746065080.431406:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.431410:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431416:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.431417:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.431420:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431427:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431433:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431439:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431448:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065080.431516:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+68:3760:x1830881262647808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 125us (879us total) trans 21474839848 rc 0/0 00000100:00100000:3.0:1746065080.431520:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8648 00010000:00010000:3.0:1746065080.431531:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065080.431535:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431540:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.431543:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431549:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431572:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431578:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462cf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431588:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.431590:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431596:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.431598:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431604:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431610:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431615:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131055e00/0xad6b7ddc1462d03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.431622:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.431623:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.431625:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.431628:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065080.431648:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834f480/2, rc 0, transno 21474839848 00000100:00100000:3.0:1746065080.431652:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647808:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1746065080.431658:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c380/2, rc 0, transno 21474839847 00000100:00100000:3.0:1746065080.431661:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647936:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065080.431668:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37d880/2, rc 0, transno 17179872567 00000100:00100000:3.0:1746065080.431671:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262646784:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065080.431677:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37c000/2, rc 0, transno 17179872568 00000100:00100000:3.0:1746065080.431679:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647296:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065080.434156:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc0b expref: 281 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434169:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.434171:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.434184:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462ce0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc0b expref: 281 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065080.434199:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc0b expref: 280 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434222:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.434224:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.434226:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0e00, rc 0) 00000100:00100000:3.0:1746065080.434269:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:26180:x1830881261454848:12345-192.168.202.27@tcp:101:bash.0 Request processed in 14328us (14579us total) trans 4294975607 rc 0/0 00000100:00100000:3.0:1746065080.434275:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12262 00000100:00100000:3.0:1746065080.434418:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.434446:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262647168:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.434473:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.434486:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262647680:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.434499:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.434508:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065080.434512:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262647552:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.434523:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.434532:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262648064:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.434542:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.434568:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262646656 00000100:00100000:3.0:1746065080.434574:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262646656 00000100:00100000:3.0:1746065080.434591:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647168 00000100:00100000:3.0:1746065080.434593:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647168 00000100:00100000:3.0:1746065080.434598:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647680 00000100:00100000:3.0:1746065080.434599:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647680 00000100:00100000:3.0:1746065080.434605:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647552 00000100:00100000:3.0:1746065080.434606:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647552 00000100:00100000:3.0:1746065080.434611:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262648064 00000100:00100000:3.0:1746065080.434613:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262648064 00000100:00100000:3.0:1746065080.434619:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8649 00000100:00100000:3.0:1746065080.434624:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+102:3762:x1830881262646656:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.434642:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:871 count 1 00010000:00010000:3.0:1746065080.434656:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434669:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434675:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.434676:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.434679:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434698:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434707:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.434715:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262648448:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.434744:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.434755:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8650 00000100:00100000:3.0:1746065080.434760:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+102:3762:x1830881262647168:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.434868:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+103:3762:x1830881262647168:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (394us total) trans 17179872569 rc 0/0 00000100:00100000:3.0:1746065080.434874:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8650 00000100:00100000:3.0:1746065080.434882:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8651 00000100:00100000:3.0:1746065080.434886:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+70:3762:x1830881262647680:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065080.434895:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:872 count 1 00010000:00010000:3.0:1746065080.434904:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434913:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434918:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.434920:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.434922:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434934:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.434941:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.434949:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262648576:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.434969:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.434980:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8652 00000100:00100000:3.0:1746065080.434984:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+70:3762:x1830881262647552:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065080.434991:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:871 count 1 00002000:00010000:3.0:1746065080.435003:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.435008:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435013:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.435014:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.435018:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435026:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435032:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435038:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435057:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065080.435159:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+71:3762:x1830881262647552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 174us (634us total) trans 21474839849 rc 0/0 00000100:00100000:3.0:1746065080.435164:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8652 00000100:00100000:3.0:1746065080.435173:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8653 00000100:00100000:3.0:1746065080.435176:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+70:3762:x1830881262648064:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.435219:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+71:3762:x1830881262648064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 42us (676us total) trans 21474839850 rc 0/0 00000100:00100000:3.0:1746065080.435223:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8653 00000004:00080000:3.0:1746065080.435249:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834ca80/2, rc 0, transno 21474839849 00000100:00100000:3.0:1746065080.435254:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262647552:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1746065080.435260:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d500/2, rc 0, transno 21474839850 00000100:00100000:3.0:1746065080.435262:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262648064:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065080.435269:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37f480/2, rc 0, transno 17179872569 00000100:00100000:3.0:1746065080.435272:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262647168:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065080.435285:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.435289:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435295:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c5c5c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.435299:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435305:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435315:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435321:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1462d18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435335:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.435336:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.435337:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065080.435356:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.435375:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262647040 00000100:00100000:3.0:1746065080.435378:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262647040 00000100:00100000:3.0:1746065080.435389:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8654 00000100:00100000:3.0:1746065080.435392:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+103:3761:x1830881262647040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.435401:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:874 count 1 00002000:00010000:3.0:1746065080.435413:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.435417:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.435423:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.435424:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.435426:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.439914:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.439936:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.439942:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.439969:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.439992:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.439998:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.440011:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c5c4600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.440014:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.440021:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.440035:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.440041:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1462d1f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.440070:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.440071:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.440073:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065080.440177:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+104:3761:x1830881262647040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4779us (4815us total) trans 17179872570 rc 0/0 00000100:00100000:3.0:1746065080.440184:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8654 00000004:00080000:0.0:1746065080.440210:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37fb80/2, rc 0, transno 17179872570 00000100:00100000:0.0:1746065080.440216:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262647040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.442229:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.442400:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261455360 00000100:00100000:3.0:1746065080.442407:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261455360 00000100:00100000:3.0:1746065080.442446:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12263 00000100:00100000:3.0:1746065080.442451:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+280:27919:x1830881261455360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.442467:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.442482:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462d26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc12 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.442544:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.442562:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442571:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442582:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.442588:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442592:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442672:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462d3b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.442678:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462d3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442684:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462d3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065080.442691:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 2 00010000:00010000:3.0:1746065080.442746:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442752:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442757:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442761:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442765:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e4e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.442768:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442799:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442807:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:3.0:1746065080.442879:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.442883:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442890:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1462d2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442901:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442906:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442910:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442913:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.442916:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442920:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442925:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561200) 00010000:00010000:3.0:1746065080.442927:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.442929:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442933:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc1462d34 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.442966:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc1462d26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc12 expref: 283 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.442977:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462d3b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc12 expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.442988:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:3.0:1746065080.442990:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.442992:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:3.0:1746065080.443858:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+282:27919:x1830881261455360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1402us (1629us total) trans 4294975608 rc 0/0 00000100:00100000:3.0:1746065080.443864:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12263 00000100:00100000:1.0:1746065080.444111:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.444128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.444145:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262648320:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.444162:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.444188:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262648448:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.444197:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.444208:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262648192:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.444212:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262648576:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.444218:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444219:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.444232:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261455616 00000100:00100000:3.0:1746065080.444235:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261455616 00010000:00010000:3.0:1746065080.444273:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 39 pid: 9549 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.444302:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261455488 00000100:00100000:3.0:1746065080.444304:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261455488 00010000:00010000:3.0:1746065080.444313:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 47 pid: 12260 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.444323:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3635 00000100:00100000:3.0:1746065080.444327:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3636 00000100:00100000:3.0:1746065080.444330:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881261455488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065080.444330:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261455616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.444338:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.444338:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.444342:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 47 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.444342:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 39 pid: 9549 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.444350:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 39 pid: 9549 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.444353:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 47 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.444365:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1462b3c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb7f expref: 47 pid: 12260 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.444365:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1462ada lrc: 0/0,0 mode: --/PR res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb5c expref: 39 pid: 9549 timeout: 776 lvb_type: 1 00010000:00010000:3.0:1746065080.444375:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.444377:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.444379:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.444380:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.444381:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444382:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.444388:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444388:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.444399:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.444399:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.444632:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881261455488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 298us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.444632:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261455616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 301us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.444637:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3635 00000100:00100000:3.0:1746065080.444642:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3636 00010000:00010000:3.0:1746065080.444657:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.444663:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.444670:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444673:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444678:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.444681:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444684:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.444688:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.445853:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1746065080.445853:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065080.446020:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+104:3760:x1830881262646912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15286us (16776us total) trans 17179872571 rc 0/0 00000100:00100000:3.0:1746065080.446027:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8643 00000100:00100000:2.0:1746065080.446037:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+71:3760:x1830881262647424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14831us (15450us total) trans 21474839851 rc 0/0 00000100:00100000:2.0:1746065080.446045:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8646 00010000:00010000:3.0:1746065080.446047:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065080.446052:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.446058:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.446062:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.446068:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.446079:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746065080.446083:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834e680/2, rc 0, transno 21474839851 00010000:00010000:3.0:1746065080.446085:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462cee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.446087:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262647424:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.446096:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1746065080.446096:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37e300/2, rc 0, transno 17179872571 00010000:00010000:3.0:1746065080.446099:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.446099:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262646912:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065080.446104:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.446106:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.446111:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.446118:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.446123:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131054400/0xad6b7ddc1462cfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.450633:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.454687:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.454692:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.454695:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.454876:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.454900:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.454925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.454999:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.455055:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261455744 00000100:00100000:2.0:1746065080.455062:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261455744 00010000:00010000:2.0:1746065080.455091:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.455112:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261455872 00000100:00100000:2.0:1746065080.455114:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261455872 00010000:00010000:2.0:1746065080.455124:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.455138:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3637 00000100:00100000:2.0:1746065080.455143:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881261455744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.455153:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.455157:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.455166:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.455184:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146299f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb01 expref: 46 pid: 3068 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.455199:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.455201:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.455205:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455211:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455228:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.455260:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881261455744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.455266:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3637 00000100:00100000:2.0:1746065080.455277:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3638 00000100:00100000:2.0:1746065080.455282:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261455872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.455288:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.455291:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.455298:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.455309:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1462b43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cb86 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.455316:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.455317:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.455320:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455325:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455335:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.455346:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261455872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.455350:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3638 00010000:00010000:2.0:1746065080.455364:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455369:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455378:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455384:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455395:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.455471:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.455478:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.455485:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.455488:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.455489:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456256 00000100:00100000:3.0:1746065080.455493:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456256 00010000:00010000:0.0:1746065080.455495:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.455510:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.455514:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4220 00010000:00010000:0.0:1746065080.455516:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc1462d11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.455518:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27919:x1830881261456256:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:0.0:1746065080.455532:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.455534:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.455535:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065080.455566:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+71:3762:x1830881262647680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20679us (21065us total) trans 21474839852 rc 0/0 00000100:00100000:2.0:1746065080.455572:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8651 00000100:00100000:2.0:1746065080.455583:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456000 00000100:00100000:2.0:1746065080.455585:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456000 00000100:00100000:2.0:1746065080.455599:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8655 00000100:00100000:2.0:1746065080.455603:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261456000:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.455610:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.455618:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc19 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.455624:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+283:27919:x1830881261456256:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 106us (626us total) trans 4294975609 rc 0/0 00000100:00100000:3.0:1746065080.455629:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4220 00010000:00010000:2.0:1746065080.455631:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.455635:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.455636:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.455639:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 38 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455657:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.455665:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 776 lvb_type: 1 00000004:00080000:3.0:1746065080.455669:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d880/2, rc 0, transno 21474839852 00000100:00100000:3.0:1746065080.455674:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262647680:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.455675:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262648704:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.455728:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c03c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065080.455740:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455746:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455753:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455758:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.455767:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.456245:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.456249:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.456255:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.456258:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.456263:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.456272:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.456277:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc1462d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.456287:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.456288:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.456290:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065080.468008:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+104:3762:x1830881262646656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 33377us (33583us total) trans 17179872572 rc 0/0 00000100:00100000:2.0:1746065080.468019:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8649 00000004:00080000:0.0:1746065080.468031:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37c380/2, rc 0, transno 17179872572 00000100:00100000:0.0:1746065080.468038:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262646656:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.473964:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262648704:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.473976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065080.473988:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 38 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.474001:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:3.0:1746065080.474037:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+38:26180:x1830881261456000:12345-192.168.202.27@tcp:101:bash.0 Request processed in 18432us (19110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.474044:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8655 00000100:00100000:1.0:1746065080.474054:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456384 00000100:00100000:1.0:1746065080.474061:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456384 00010000:00010000:1.0:1746065080.474086:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746065080.474116:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3639 00000100:00100000:1.0:1746065080.474122:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261456384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.474132:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.474136:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746065080.474150:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746065080.474168:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc1462c5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbe1 expref: 38 pid: 3067 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746065080.474190:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.474192:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.474197:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.474204:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.474227:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.474237:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137347480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881262648832:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065080.474296:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.475220:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.475261:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456512 00000100:00100000:3.0:1746065080.475265:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456512 00000100:00100000:3.0:1746065080.475298:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8656 00000100:00100000:3.0:1746065080.475303:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261456512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.475315:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.475325:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc1462d50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc20 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.475359:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262648960:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065080.475721:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.477393:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137347480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881262648832:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065080.477408:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.477454:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261456384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3331us (3482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.477462:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3639 00000100:00100000:0.0:1746065080.477625:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.477706:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456640 00000100:00100000:2.0:1746065080.477711:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456640 00002000:00010000:3.0:1746065080.477722:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb mtime: 0 -> 1746065080 00002000:00010000:3.0:1746065080.477725:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb atime: 0 -> 1746065080 00002000:00010000:3.0:1746065080.477726:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb ctime: 0 -> 1746065080 00000100:00100000:2.0:1746065080.477738:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8657 00000100:00100000:3.0:1746065080.477740:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881262648960:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065080.477743:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+45:26180:x1830881261456640:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.477752:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.477759:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc1462d50 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc20 expref: 38 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.477763:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc27 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.477791:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.477792:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc1462d50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc20 expref: 38 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.477802:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3400, rc 0) 00010000:00010000:2.0:1746065080.477803:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.477805:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.477811:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 46 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.477822:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261456512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2519us (2603us total) trans 0 rc 301/301 00010000:00010000:2.0:1746065080.477822:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 46 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.477827:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8656 00010000:00010000:2.0:1746065080.477829:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0200, rc 0) 00000100:00100000:2.0:1746065080.477842:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881261456640:12345-192.168.202.27@tcp:101:bash.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.477847:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8657 00000100:00100000:0.0:1746065080.481457:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.481498:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.481543:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456896 00000100:00100000:2.0:1746065080.481578:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456896 00002000:00010000:2.0:1746065080.481609:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/875 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.481612:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55880 with x1830881261456896 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.481620:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095f55880. 00000100:00100000:2.0:1746065080.481648:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261456768 00000100:00100000:2.0:1746065080.481650:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261456768 00002000:00010000:2.0:1746065080.481660:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/874 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.481662:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f54380 with x1830881261456768 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.481667:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f54380. 00000100:00100000:0.0:1746065080.481671:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1273 00000100:00100000:0.0:1746065080.481679:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881261456896:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:2.0:1746065080.481691:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1274 00000100:00100000:2.0:1746065080.481696:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881261456768:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065080.481817:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065080.481817:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.481820:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.481820:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x36b:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.481821:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb atime from disk: 1746065080 -> 0 00002000:00010000:0.0:1746065080.481821:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x36b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.481823:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.481823:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x36b:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.481825:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x36a:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746065080.481825:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065080.481861:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261456896:12345-192.168.202.27@tcp:10:bash.0 Request processed in 183us (409us total) trans 17179872573 rc 0/0 00000100:00100000:0.0:1746065080.481866:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1273 00002000:00010000:0.0:1746065080.481869:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/875 (0->18446744073709551615) 00002000:00100000:0.0:1746065080.481871:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55880 with x1830881261456896 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065080.481874:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095f55880. 00000100:00100000:2.0:1746065080.482082:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881261456768:12345-192.168.202.27@tcp:10:bash.0 Request processed in 384us (583us total) trans 21474839853 rc 0/0 00000100:00100000:2.0:1746065080.482087:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1274 00002000:00010000:2.0:1746065080.482090:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/874 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.482091:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f54380 with x1830881261456768 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.482095:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f54380. 00000100:00100000:0.0:1746065080.485859:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.485986:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261457152 00000100:00100000:3.0:1746065080.485993:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261457152 00000100:00100000:3.0:1746065080.486029:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4221 00000100:00100000:3.0:1746065080.486035:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261457152:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065080.486261:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:26180:x1830881261457152:12345-192.168.202.27@tcp:35:bash.0 Request processed in 225us (408us total) trans 4294975610 rc 0/0 00000100:00100000:3.0:1746065080.486267:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4221 00000100:00100000:2.0:1746065080.496425:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.496458:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261457408 00000100:00100000:2.0:1746065080.496465:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261457408 00000100:00100000:2.0:1746065080.496500:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12264 00000100:00100000:2.0:1746065080.496507:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27920:x1830881261457408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.496521:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.496534:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462d5e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc2e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.496619:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.496629:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.496637:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065080.496645:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 5 00010000:00010000:2.0:1746065080.496710:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462d5e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.496725:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.496731:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.496734:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065080.496736:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0800, rc 0) 00000100:00100000:2.0:1746065080.496768:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27920:x1830881261457408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 262us (356us total) trans 4294975611 rc 0/0 00000100:00100000:2.0:1746065080.496789:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12264 00000100:00100000:1.0:1746065080.498653:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.498702:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261457664 00000100:00100000:0.0:1746065080.498711:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261457664 00000100:00100000:2.0:1746065080.499322:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12265 00000100:00100000:2.0:1746065080.499332:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27921:x1830881261457664:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065080.499370:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065080.499388:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462ce7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc0b expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.499403:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462d3b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc12 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.499419:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462c8c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cbef expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.499427:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.499430:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.499448:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.499457:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.499464:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.499472:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.499477:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.499481:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.499545:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.499564:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 283 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.499571:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.499594:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 283 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.499604:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 283 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.499615:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262649088:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.500136:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.501734:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262649088:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.501751:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065080.501823:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.501888:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261457792 00000100:00100000:1.0:1746065080.501893:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261457792 00010000:00010000:1.0:1746065080.501916:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 284 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.501994:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3640 00000100:00100000:1.0:1746065080.502001:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+284:2005:x1830881261457792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.502011:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.502016:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 284 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.502025:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 284 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.502039:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462d65 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc2e expref: 284 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.502061:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:1.0:1746065080.502065:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.502071:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.502077:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.502115:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.502144:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+283:2005:x1830881261457792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 143us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.502150:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3640 00010000:00010000:2.0:1746065080.502191:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502196:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00080000:2.0:1746065080.502501:0:7204:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x345:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1746065080.502563:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502570:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502576:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502580:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.502583:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502588:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502595:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065080.502597:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065080.502600:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502604:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1462d81 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x345:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502622:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502627:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502631:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502635:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502638:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.502640:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502644:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502649:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065080.502651:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.502652:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502656:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462d73 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:2.0:1746065080.502666:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880137347480 reply state ffff88009a901000 transno 4294975612 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502672:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.502677:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.502679:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065080.502681:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065080.502723:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27921:x1830881261457664:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3390us (4071us total) trans 4294975612 rc 0/0 00000100:00100000:2.0:1746065080.502728:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12265 00000100:00100000:0.0:1746065080.505218:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.505297:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261457920 00000100:00100000:2.0:1746065080.505304:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261457920 00000100:00100000:2.0:1746065080.505338:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12266 00000100:00100000:2.0:1746065080.505344:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27920:x1830881261457920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.505362:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.505379:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1462d88 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc35 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.505427:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462d8f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.505436:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462d8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.505445:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462d8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065080.505474:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x345:0x0]: returning size 5 00000004:00200000:2.0:1746065080.505477:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.505488:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462d8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.505507:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1462d88 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x345:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc35 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.505519:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0e00/0xad6b7ddc1462d8f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x345:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc35 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.505527:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012d56c900) 00010000:00010000:2.0:1746065080.505529:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065080.505531:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0e00, rc 0) 00000100:00100000:2.0:1746065080.505582:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27920:x1830881261457920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 237us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.505587:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12266 00000100:00100000:1.0:1746065080.509297:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.509649:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261458176 00000100:00100000:0.0:1746065080.509657:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261458176 00000100:00100000:0.0:1746065080.509699:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4222 00000100:00100000:0.0:1746065080.509705:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27920:x1830881261458176:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065080.509876:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x345:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065080.509923:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2443, 64 off202168 00000040:00080000:0.0:1746065080.509943:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2447, 64 off202600 00000040:00080000:0.0:1746065080.509951:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2448, 64 off202664 00000040:00080000:0.0:1746065080.509959:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2444, 64 off202232 00010000:00010000:0.0:1746065080.509996:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x345:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:0.0:1746065080.510008:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065080.510016:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065080.510022:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065080.510027:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065080.510031:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065080.510052:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065080.510075:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.510081:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.510089:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.510092:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.510098:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.510107:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x345:0x0].0x0 (ffff88012d56c900) 00010000:00010000:2.0:1746065080.510109:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065080.510113:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.510117:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462d96 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x345:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065080.510124:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.510125:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.510126:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.510184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.510260:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261458304 00000100:00100000:3.0:1746065080.510264:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261458304 00000100:00100000:3.0:1746065080.510287:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12267 00000100:00100000:3.0:1746065080.510292:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27922:x1830881261458304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.510301:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.510315:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462d9d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc3c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.510353:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.510360:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.510364:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27920:x1830881261458176:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 658us (1074us total) trans 4294975613 rc 0/0 00010000:00010000:3.0:1746065080.510367:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.510371:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4222 00010000:00010000:3.0:1746065080.510373:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.510378:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510382:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510400:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510405:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510410:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510418:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510422:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.510424:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510428:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510435:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065080.510437:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.510439:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510443:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462da4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510593:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510599:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510603:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510607:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.510609:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510614:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510621:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:3.0:1746065080.510623:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.510625:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510629:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462dab lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.510650:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462d9d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc3c expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.510656:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462d9d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc3c expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.510670:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:3.0:1746065080.510702:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+286:27922:x1830881261458304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 410us (518us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.510707:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12267 00000100:00100000:0.0:1746065080.512746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.513238:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261458432 00000100:00100000:2.0:1746065080.513244:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261458432 00000100:00100000:2.0:1746065080.513322:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12268 00000100:00100000:2.0:1746065080.513329:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+286:27922:x1830881261458432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.513344:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.513358:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462db2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc43 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.513405:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.513414:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513422:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513429:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.513435:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513439:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513471:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513476:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513481:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513486:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513490:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.513493:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513499:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513506:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56c600) 00010000:00010000:2.0:1746065080.513509:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.513512:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513516:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1600/0xad6b7ddc1462db9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513523:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513527:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513531:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513535:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.513536:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513540:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513544:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.513546:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.513548:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513564:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc1462dc0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.513583:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462db2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc43 expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.513589:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0800/0xad6b7ddc1462db2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc43 expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.513599:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0800, rc 0) 00000100:00100000:2.0:1746065080.513648:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+286:27922:x1830881261458432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 319us (906us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065080.513654:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12268 00000100:00100000:0.0:1746065080.515699:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.515980:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261458560 00000100:00100000:2.0:1746065080.515987:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261458560 00000100:00100000:0.0:1746065080.516000:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.516358:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261458688 00000100:00100000:2.0:1746065080.516361:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261458688 00000100:00100000:1.0:1746065080.516362:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12269 00000100:00100000:1.0:1746065080.516370:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27920:x1830881261458560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.516383:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065080.516385:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12270 00000100:00100000:2.0:1746065080.516390:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27922:x1830881261458688:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.516395:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.516398:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462dc7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc4a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.516400:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462dce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc51 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.516435:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462dd5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.516436:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.516444:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.516450:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.516451:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.516456:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516461:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.516465:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516468:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065080.516479:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065080.516483:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065080.516492:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516496:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516500:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516505:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.516557:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462dce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc51 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.516571:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc51 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.516578:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.516580:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065080.516582:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00010000:00010000:1.0:1746065080.516584:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.516587:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516592:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516598:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.516600:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.516602:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516606:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462ddc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065080.516622:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27922:x1830881261458688:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 231us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.516627:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12270 00010000:00010000:1.0:1746065080.516679:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516684:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516688:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516692:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.516694:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516698:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516704:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:1.0:1746065080.516705:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.516707:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516711:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1462de3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.516728:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462dc7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc4a expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.516734:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462dc7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc4a expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.516739:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46400, rc 0) 00000100:00100000:1.0:1746065080.516766:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27920:x1830881261458560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 398us (1072us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.516770:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12269 00000100:00100000:1.0:1746065080.519212:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.519277:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261458944 00000100:00100000:2.0:1746065080.519283:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261458944 00000100:00100000:2.0:1746065080.519316:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12271 00000100:00100000:2.0:1746065080.519323:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27922:x1830881261458944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.519336:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.519338:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.519356:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462dd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc51 expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.519367:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.519375:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.519383:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462dea lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc58 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.519452:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.519461:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519468:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519479:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.519484:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519489:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519751:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.519758:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519764:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065080.519771:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00010000:00010000:2.0:1746065080.519813:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519818:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519823:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519828:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519832:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.519835:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519844:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519851:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012d56cc00) 00010000:00010000:2.0:1746065080.519853:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.519855:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519859:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462df1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:2.0:1746065080.519866:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cfe680 reply state ffff88009a5f2000 transno 4294975614 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519872:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.519876:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.519878:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065080.519880:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065080.519897:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc1462dea lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.519909:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.519914:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065080.519916:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.519918:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:2.0:1746065080.520101:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27922:x1830881261458944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 777us (894us total) trans 4294975614 rc 0/0 00000100:00100000:2.0:1746065080.520110:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12271 00000100:00100000:0.0:1746065080.525097:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.525178:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261459200 00000100:00100000:2.0:1746065080.525186:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261459200 00000100:00100000:2.0:1746065080.525222:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12272 00000100:00100000:2.0:1746065080.525228:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27922:x1830881261459200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.525245:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.525258:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462e0d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc5f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.525333:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065080.525344:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.525350:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.525373:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.525382:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 290 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.525391:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262649216:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.526102:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.528319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.528498:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262649216:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065080.528521:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065080.528537:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261459328 00000100:00100000:1.0:1746065080.528542:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261459328 00010000:00010000:1.0:1746065080.528578:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 291 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.528612:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3641 00000100:00100000:1.0:1746065080.528618:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+291:2005:x1830881261459328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.528627:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.528631:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 291 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.528639:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 291 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.528654:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462dff lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc58 expref: 291 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.528674:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:1.0:1746065080.528677:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.528684:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.528688:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.528700:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.528726:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+290:2005:x1830881261459328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.528731:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3641 00010000:00010000:0.0:1746065080.529171:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.529178:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065080.529196:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00000100:00100000:1.0:1746065080.529427:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.529482:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261459584 00000100:00100000:2.0:1746065080.529485:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261459584 00000100:00100000:2.0:1746065080.529506:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12273 00000100:00100000:2.0:1746065080.529510:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27923:x1830881261459584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.529520:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.529531:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf200/0xad6b7ddc1462e1b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc66 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.529583:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.529591:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529597:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529603:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.529608:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529612:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529667:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.529673:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529678:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.529686:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00010000:00010000:2.0:1746065080.529726:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529731:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529736:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529740:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.529744:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529749:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529756:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:2.0:1746065080.529758:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065080.529761:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529765:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462e30 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529795:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529800:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529804:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529811:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529814:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.529816:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529820:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529826:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14700) 00010000:00010000:2.0:1746065080.529828:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.529830:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529833:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462e22 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529839:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529843:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529846:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529850:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.529852:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529857:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529865:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.529867:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.529869:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529872:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462e29 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.529894:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf200/0xad6b7ddc1462e1b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc66 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.529901:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf200/0xad6b7ddc1462e1b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc66 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.529913:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:2.0:1746065080.529951:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27923:x1830881261459584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 439us (524us total) trans 4294975615 rc 301/301 00000100:00100000:2.0:1746065080.529956:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12273 00000004:00080000:0.0:1746065080.530036:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x36d:0x0], index 1: 0 00000004:00080000:0.0:1746065080.530041:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x36c:0x0], index 0: 0 00000004:00080000:0.0:1746065080.530045:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x36d:0x0], index 0: 0 00000004:00080000:0.0:1746065080.530048:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x36e:0x0], index 1: 0 00010000:00010000:0.0:1746065080.530109:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530114:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530118:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530122:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.530124:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530129:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530136:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff88012d56cb00) 00010000:00010000:0.0:1746065080.530137:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065080.530139:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530143:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462e14 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.530165:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462e0d lrc: 1/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc5f expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.530170:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462e0d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc5f expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.530181:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bec00, rc 0) 00000100:00100000:0.0:1746065080.530200:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27922:x1830881261459200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4973us (5110us total) trans 4294975616 rc 301/301 00000100:00100000:0.0:1746065080.530205:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12272 00000100:00100000:0.0:1746065080.532852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.532944:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261459840 00000100:00100000:2.0:1746065080.532951:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261459840 00000100:00100000:2.0:1746065080.533032:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4223 00000100:00100000:2.0:1746065080.533039:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27922:x1830881261459840:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065080.533191:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27922:x1830881261459840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 152us (345us total) trans 4294975617 rc 0/0 00000100:00100000:2.0:1746065080.533197:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4223 00000100:00100000:0.0:1746065080.535067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.535255:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261460096 00000100:00100000:3.0:1746065080.535262:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261460096 00000100:00100000:3.0:1746065080.535301:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4224 00000100:00100000:3.0:1746065080.535308:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27922:x1830881261460096:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.535449:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27922:x1830881261460096:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 141us (386us total) trans 4294975618 rc 0/0 00000100:00100000:3.0:1746065080.535455:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4224 00000100:00100000:0.0:1746065080.535615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.535680:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261460224 00000100:00100000:1.0:1746065080.535684:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261460224 00000100:00100000:1.0:1746065080.535707:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12274 00000100:00100000:1.0:1746065080.535712:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27923:x1830881261460224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.535721:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.535737:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1462e45 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc6d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.535813:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462e4c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.535822:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462e4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.535831:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462e4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065080.535849:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00000004:00200000:1.0:1746065080.535853:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065080.535862:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462e4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.535880:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47000/0xad6b7ddc1462e45 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc6d expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.535894:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462e4c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc6d expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.535900:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.535903:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065080.535905:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:1.0:1746065080.535925:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27923:x1830881261460224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 213us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.535930:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12274 00000100:00100000:2.0:1746065080.539034:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.539105:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261460352 00000100:00100000:3.0:1746065080.539111:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261460352 00000100:00100000:3.0:1746065080.539144:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8658 00000100:00100000:3.0:1746065080.539151:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881261460352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.539165:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.539179:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc74 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065080.539197:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.539211:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065080.539211:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065080.539213:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.539220:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.539237:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065080.539245:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:0.0:1746065080.539264:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261460608 00000100:00100000:0.0:1746065080.539268:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261460608 00000100:00100000:0.0:1746065080.539292:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12275 00000100:00100000:0.0:1746065080.539297:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261460608:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.539307:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.539328:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462e5a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc7b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.539376:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261460352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 225us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.539381:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8658 00010000:00010000:0.0:1746065080.539424:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065080.539433:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539441:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539449:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065080.539455:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539459:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539491:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462e6f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065080.539496:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462e6f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539500:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462e6f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065080.539507:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00010000:00010000:0.0:1746065080.539572:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539581:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539586:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539591:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539596:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.539599:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539704:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539713:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c512e00) 00010000:00010000:0.0:1746065080.539716:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.539718:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539722:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462e61 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539928:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539934:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539938:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539942:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.539944:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539948:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539955:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:0.0:1746065080.539957:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.539964:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.539969:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1462e68 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065080.540002:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc1462e5a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc7b expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.540013:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462e6f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc7b expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.540019:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:0.0:1746065080.540021:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065080.540023:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6f800, rc 0) 00000100:00100000:0.0:1746065080.540051:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261460608:12345-192.168.202.27@tcp:101:bash.0 Request processed in 754us (840us total) trans 4294975619 rc 0/0 00000100:00100000:0.0:1746065080.540057:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12275 00000100:00100000:0.0:1746065080.541510:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.541666:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261460864 00000100:00100000:2.0:1746065080.541672:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261460864 00000100:00100000:2.0:1746065080.541707:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4225 00000100:00100000:2.0:1746065080.541712:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27923:x1830881261460864:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065080.542270:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27923:x1830881261460864:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 556us (762us total) trans 4294975620 rc 0/0 00000100:00100000:2.0:1746065080.542277:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4225 00000100:00100000:0.0:1746065080.542646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.542695:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.542751:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261460992 00000100:00100000:3.0:1746065080.542754:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261460992 00000100:00100000:3.0:1746065080.542802:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 557 00000100:00100000:3.0:1746065080.542808:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+296:2005:x1830881261460992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.542816:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.542830:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f800/0xad6b7ddc1462e6f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc7b expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.542835:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261461120 00000100:00100000:1.0:1746065080.542838:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261461120 00000100:00100000:1.0:1746065080.542864:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12276 00000100:00100000:1.0:1746065080.542869:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261461120:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065080.542879:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.542887:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462e7d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc82 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.542906:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462e84 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.542915:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462e84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.542922:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462e84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.542980:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f47800/0xad6b7ddc1462e7d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc82 expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.542994:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462e84 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc82 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.543001:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.543003:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065080.543005:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00000100:00100000:1.0:1746065080.543025:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261461120:12345-192.168.202.27@tcp:101:bash.0 Request processed in 156us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.543031:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12276 00010000:00010000:3.0:1746065080.543108:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.543112:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.543131:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+296:2005:x1830881261460992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 324us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.543137:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 557 00000100:00100000:0.0:1746065080.544992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.545030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.545272:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261461376 00000100:00100000:1.0:1746065080.545277:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261461376 00000100:00100000:1.0:1746065080.545303:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261461632 00000100:00100000:1.0:1746065080.545305:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261461632 00000100:00100000:1.0:1746065080.545329:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12277 00000100:00100000:1.0:1746065080.545335:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27923:x1830881261461376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.545351:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.545364:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462e8b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc89 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.545432:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462e92 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.545441:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462e92 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.545448:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462e92 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065080.545455:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00010000:00010000:1.0:1746065080.545520:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46600/0xad6b7ddc1462e8b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc89 expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.545532:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462e92 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc89 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.545538:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.545540:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065080.545543:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46400, rc 0) 00000100:00100000:1.0:1746065080.545587:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27923:x1830881261461376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 252us (600us total) trans 4294975621 rc 0/0 00000100:00100000:1.0:1746065080.545592:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12277 00000100:00100000:1.0:1746065080.545604:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12278 00000100:00100000:1.0:1746065080.545608:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261461632:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065080.545624:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.545633:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46c00/0xad6b7ddc1462e4c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc6d expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.545640:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.545643:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.545717:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.545723:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.545728:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:1.0:1746065080.545750:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975622 00000004:00010000:1.0:1746065080.545762:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098671500 reply state ffff88009afcb000 transno 4294975623 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.545768:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.545795:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.545797:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.545799:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.545833:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261461632:12345-192.168.202.27@tcp:36:bash.0 Request processed in 224us (802us total) trans 4294975623 rc 0/0 00000100:00100000:1.0:1746065080.545837:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12278 00000020:00080000:1.0:1746065080.545840:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065080.547742:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.548837:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261461760 00000100:00100000:2.0:1746065080.548847:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261461760 00000100:00100000:2.0:1746065080.548892:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12279 00000100:00100000:2.0:1746065080.548899:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+300:27923:x1830881261461760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.548916:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.548931:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462ea7 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc90 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.548994:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.549004:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.549013:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.549032:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00000004:00200000:2.0:1746065080.549036:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.549046:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.549063:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462ea7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 302 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.549080:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.549086:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.549088:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.549091:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:2.0:1746065080.549134:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+301:27923:x1830881261461760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 236us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.549139:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12279 00000100:00100000:0.0:1746065080.550536:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.550806:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261462016 00000100:00100000:3.0:1746065080.550811:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261462016 00000100:00100000:3.0:1746065080.550848:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12280 00000100:00100000:3.0:1746065080.550855:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261462016:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.550869:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.550873:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065080.550888:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462e92 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc89 expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.550905:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.550908:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.550915:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462eb5 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc97 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.550943:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.550952:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.550957:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 4/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.550978:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.550988:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 301 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.550997:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262649344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.551069:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.551919:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.551972:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261462272 00000100:00100000:0.0:1746065080.551976:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261462272 00000100:00100000:0.0:1746065080.552009:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4226 00000100:00100000:0.0:1746065080.552016:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+302:27923:x1830881261462272:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.552194:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+303:27923:x1830881261462272:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 177us (276us total) trans 4294975624 rc 0/0 00000100:00100000:0.0:1746065080.552201:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4226 00000100:00100000:2.0:1746065080.553266:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.553283:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261462656 00000100:00100000:2.0:1746065080.553287:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261462656 00000100:00100000:2.0:1746065080.553318:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12281 00000100:00100000:0.0:1746065080.553319:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.553324:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+303:27923:x1830881261462656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.553335:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065080.553380:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261462400 00000100:00100000:3.0:1746065080.553383:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261462400 00010000:00010000:3.0:1746065080.553398:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 304 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.553427:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3642 00000100:00100000:3.0:1746065080.553432:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+304:2004:x1830881261462400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.553440:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.553444:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 304 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.553614:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 304 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.553631:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.553638:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.553645:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.553645:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf200/0xad6b7ddc1462ec3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cc9e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.553651:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.553662:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.553693:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065080.553696:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+305:2004:x1830881261462400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 264us (377us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065080.553700:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065080.553702:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3642 00010000:00010000:2.0:1746065080.553706:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553716:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.553721:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553725:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.553732:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462eae lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc90 expref: 304 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.553743:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262649344:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.553757:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.553762:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.553766:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.553807:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.553813:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553818:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.553824:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 0 00010000:00010000:2.0:1746065080.553866:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553872:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553876:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553881:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.553884:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553889:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553895:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.553897:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065080.553900:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553904:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462ed8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553912:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553917:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00000040:00080000:3.0:1746065080.553918:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2449, 88 off202752 00010000:00010000:2.0:1746065080.553921:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065080.553923:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676572148878ns, next at 676590632635ns, rc = 0 00010000:00010000:2.0:1746065080.553925:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553928:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.553930:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553934:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553939:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.553940:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.553942:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553945:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462eca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553952:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553956:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553960:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553963:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf000 already unused, calling callback (ffffffffa0f21690) 00000040:00080000:3.0:1746065080.553964:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2445, 88 off202320 00010000:00010000:2.0:1746065080.553965:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065080.553967:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676572193331ns, next at 676590652783ns, rc = 0 00010000:00010000:2.0:1746065080.553969:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553973:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.553975:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.553977:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.553981:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1462ed1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000040:00080000:3.0:1746065080.553989:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2446, 88 off202408 00000004:00080000:3.0:1746065080.553992:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676572218008ns, next at 676590652783ns, rc = 0 00010000:00010000:2.0:1746065080.554002:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf200/0xad6b7ddc1462ec3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc9e expref: 304 pid: 7231 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746065080.554003:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2450, 88 off202840 00000004:00080000:3.0:1746065080.554005:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676572231897ns, next at 676590632635ns, rc = 0 00010000:00010000:2.0:1746065080.554009:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf200/0xad6b7ddc1462ec3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc9e expref: 304 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.554018:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:2.0:1746065080.554037:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+304:27923:x1830881261462656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 714us (773us total) trans 4294975625 rc 301/301 00000100:00100000:2.0:1746065080.554043:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12281 00000001:00080000:0.0:1746065080.555418:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975626 is committed 00000004:00080000:0.0:1746065080.555424:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1653 committed 00000004:00080000:0.0:1746065080.555433:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1643 committed 00000004:00080000:0.0:1746065080.555436:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1642 committed 00000004:00080000:0.0:1746065080.555437:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1652 committed 00010000:00010000:2.0:1746065080.555501:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555508:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555513:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555517:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.555520:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555524:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555532:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.555534:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.555536:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555540:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1462d7a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555558:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555563:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555566:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555571:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.555573:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555576:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555581:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012d56c100) 00010000:00010000:2.0:1746065080.555582:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.555584:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555587:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1462df8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.555598:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.555602:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.555606:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.555608:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.555610:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.555614:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.555619:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.555621:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.555623:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.555627:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c000/0xad6b7ddc1462ea0 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065080.556685:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262649472:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.556734:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.556805:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649472 00000100:00100000:1.0:1746065080.556811:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649472 00000100:00100000:1.0:1746065080.556844:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8659 00000100:00100000:1.0:1746065080.556850:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+71:3762:x1830881262649472:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065080.556871:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:874 count 1 00010000:00010000:1.0:1746065080.556889:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.556904:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.556910:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065080.556911:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065080.556913:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.556933:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 37 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.556943:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 37 pid: 10219 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.556951:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262649600:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.557004:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.557234:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262649728:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.557256:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.557271:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065080.557275:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262649856:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.557290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.557356:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262649984:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.557377:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.557400:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649728 00000100:00100000:1.0:1746065080.557403:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649728 00000100:00100000:1.0:1746065080.557416:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649856 00000100:00100000:1.0:1746065080.557417:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649856 00000100:00100000:1.0:1746065080.557425:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649984 00000100:00100000:1.0:1746065080.557427:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649984 00000100:00100000:0.0:1746065080.557439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.557444:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8660 00000100:00100000:1.0:1746065080.557448:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+74:3759:x1830881262649728:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.557455:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8661 00002000:00080000:1.0:1746065080.557459:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:875 count 1 00000100:00100000:0.0:1746065080.557460:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+74:3759:x1830881262649856:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065080.557473:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065080.557478:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.557483:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.557485:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.557488:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.557497:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.557503:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.557508:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.557523:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065080.557574:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262649856:12345-0@lo:2:osp-syn-0-1.0 Request processed in 114us (282us total) trans 21474839854 rc 0/0 00000100:00100000:0.0:1746065080.557580:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8661 00000100:00100000:0.0:1746065080.557593:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8662 00000100:00100000:0.0:1746065080.557597:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+75:3761:x1830881262649984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.557641:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+76:3759:x1830881262649728:12345-0@lo:6:osp-syn-0-1.0 Request processed in 191us (383us total) trans 21474839855 rc 0/0 00000100:00100000:0.0:1746065080.557641:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+76:3761:x1830881262649984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 45us (264us total) trans 21474839856 rc 0/0 00000100:00100000:1.0:1746065080.557646:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8660 00000100:00100000:0.0:1746065080.557648:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8662 00010000:00010000:0.0:1746065080.557657:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.557662:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.557668:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa086fd70) 00000004:00080000:1.0:1746065080.557671:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2d80/2, rc 0, transno 21474839856 00010000:00010000:0.0:1746065080.557671:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.557675:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262649984:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065080.557677:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.557688:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.557693:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1462eed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.557705:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.557706:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.557708:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.557716:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261462912 00000100:00100000:0.0:1746065080.557719:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261462912 00000100:00100000:0.0:1746065080.557742:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4227 00000100:00100000:0.0:1746065080.557747:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+282:27923:x1830881261462912:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:3.0:1746065080.557835:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc97 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.557842:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.557844:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1746065080.557852:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27923:x1830881261462912:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 104us (414us total) trans 4294975627 rc 0/0 00010000:00010000:3.0:1746065080.557853:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462eb5 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc97 expref: 284 pid: 7205 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746065080.557860:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4227 00010000:00010000:3.0:1746065080.557865:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc97 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.557882:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.557883:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.557886:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3e00, rc 0) 00000100:00100000:3.0:1746065080.557903:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261462016:12345-192.168.202.27@tcp:101:bash.0 Request processed in 7049us (7372us total) trans 4294975626 rc 0/0 00000100:00100000:3.0:1746065080.557908:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12280 00000100:00100000:1.0:1746065080.557958:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009835a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262650496:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.557980:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.558005:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065080.558010:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262650112:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.558024:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.558042:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262650496 00000100:00100000:1.0:1746065080.558045:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262650496 00000100:00100000:1.0:1746065080.558058:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262650112 00000100:00100000:1.0:1746065080.558060:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262650112 00000100:00100000:1.0:1746065080.558069:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8663 00000100:00100000:1.0:1746065080.558073:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+105:3761:x1830881262650496:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.558107:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8664 00000100:00100000:2.0:1746065080.558113:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+106:3761:x1830881262650112:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.558122:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262650368:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.558140:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.558144:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+106:3761:x1830881262650496:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (163us total) trans 17179872574 rc 0/0 00000100:00100000:1.0:1746065080.558149:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8663 00000100:00100000:1.0:1746065080.558157:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262650368 00000100:00100000:2.0:1746065080.558158:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065080.558159:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262650368 00000100:00100000:2.0:1746065080.558161:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262650240:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.558170:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8665 00000100:00100000:1.0:1746065080.558173:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+106:3760:x1830881262650368:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.558175:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.558190:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262650240 00000100:00100000:2.0:1746065080.558193:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262650240 00000100:00100000:2.0:1746065080.558208:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8666 00000100:00100000:2.0:1746065080.558211:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+108:3760:x1830881262650240:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:1.0:1746065080.558211:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.558214:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.558216:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.558217:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00080000:2.0:1746065080.558220:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:876 count 1 00002000:00010000:1.0:1746065080.558220:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1746065080.558231:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.558235:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.558239:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+108:3760:x1830881262650368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (98us total) trans 17179872575 rc 0/0 00000100:00100000:1.0:1746065080.558244:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8665 00010000:00010000:2.0:1746065080.558247:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.558248:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.558250:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.558258:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746065080.558262:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009835a680/2, rc 0, transno 17179872574 00010000:00010000:2.0:1746065080.558263:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.558265:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262650496:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1746065080.558270:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.558278:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1746065080.558279:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:875 count 1 00010000:00010000:1.0:1746065080.558286:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.558295:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 47 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.558300:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065080.558301:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065080.558303:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.558319:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 47 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.558327:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 47 pid: 9550 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.558335:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262650624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.558414:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+108:3760:x1830881262650240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 201us (237us total) trans 17179872576 rc 0/0 00000100:00100000:2.0:1746065080.558420:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8666 00000004:00080000:2.0:1746065080.558441:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1880/2, rc 0, transno 17179872576 00000100:00100000:2.0:1746065080.558444:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262650240:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.558449:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3480/2, rc 0, transno 17179872575 00000100:00100000:2.0:1746065080.558451:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262650368:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.558462:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1180/2, rc 0, transno 21474839854 00000100:00100000:2.0:1746065080.558465:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262649856:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065080.558471:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0000/2, rc 0, transno 21474839855 00000100:00100000:2.0:1746065080.558474:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262649728:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065080.558578:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.558583:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.558589:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.558591:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.558597:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.558607:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.558612:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc1462ef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.558622:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.558623:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.558624:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.559582:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.560058:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262649600:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.560071:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.560367:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.560736:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463040 00000100:00100000:3.0:1746065080.560741:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463040 00010000:00010000:3.0:1746065080.560762:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.560812:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3643 00000100:00100000:3.0:1746065080.560818:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261463040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.560828:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.560833:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.560842:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.560860:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc1462d49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc19 expref: 38 pid: 10219 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.560870:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.560872:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065080.560984:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262650624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.560996:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.561263:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.561272:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.561294:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.561322:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261463040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 503us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.561327:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3643 00000100:00100000:0.0:1746065080.561692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065080.561758:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.561765:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.561788:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.561794:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.561806:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065080.561838:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.561843:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.561849:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.561851:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.561858:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.561867:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.561872:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1462ee6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.561884:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.561885:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.561886:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.561960:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+75:3762:x1830881262649472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5109us (5225us total) trans 21474839857 rc 0/0 00000100:00100000:1.0:1746065080.561968:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8659 00000100:00100000:0.0:1746065080.562177:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.562200:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:2.0:1746065080.562208:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0e00/2, rc 0, transno 21474839857 00000100:00100000:2.0:1746065080.562212:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262649472:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.562278:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463168 00000100:00100000:1.0:1746065080.562278:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463296 00000100:00100000:3.0:1746065080.562281:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463168 00000100:00100000:1.0:1746065080.562281:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463296 00000100:00100000:1.0:1746065080.562301:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4228 00010000:00010000:3.0:1746065080.562304:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 48 pid: 9550 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.562306:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27923:x1830881261463296:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065080.562318:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3644 00000100:00100000:3.0:1746065080.562322:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261463168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.562329:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.562332:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 48 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.562339:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 48 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.562349:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1462d57 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc27 expref: 48 pid: 9550 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.562358:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.562359:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.562361:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562370:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.562383:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27923:x1830881261463296:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.562389:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4228 00000100:00100000:1.0:1746065080.562402:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463424 00000100:00100000:1.0:1746065080.562404:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463424 00000100:00100000:1.0:1746065080.562416:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8667 00000100:00100000:1.0:1746065080.562420:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+48:26180:x1830881261463424:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065080.562428:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.562436:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cca5 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.562449:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 49 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.562454:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.562455:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.562457:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 49 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562508:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.562530:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.562536:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.562547:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.562561:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.562575:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065080.562594:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261463168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 271us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.562601:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3644 00000100:00100000:2.0:1746065080.562839:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+108:3761:x1830881262650112:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4726us (4812us total) trans 17179872577 rc 0/0 00000100:00100000:2.0:1746065080.562845:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8664 00010000:00010000:3.0:1746065080.562882:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.562887:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562893:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0bbc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.562895:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562901:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562910:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562915:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc1462efb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.562926:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.562927:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.562929:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065080.563414:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065080.563425:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746065080.563439:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cfea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262650752:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.563963:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00000004:00080000:1.0:1746065080.563993:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2680/2, rc 0, transno 17179872577 00000100:00100000:1.0:1746065080.563997:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262650112:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.567589:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.567662:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cfea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262650752:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.567687:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.567703:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:1.0:1746065080.567746:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+48:26180:x1830881261463424:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5323us (5544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.567753:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8667 00000100:00100000:2.0:1746065080.567949:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463552 00000100:00100000:2.0:1746065080.567954:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463552 00010000:00010000:2.0:1746065080.567976:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746065080.568006:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3645 00000100:00100000:2.0:1746065080.568013:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261463552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.568025:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.568029:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.568039:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.568057:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462e53 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc74 expref: 48 pid: 9550 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.568072:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.568074:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.568079:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.568086:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.568109:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.568119:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881262650880:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065080.568166:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.571076:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.571189:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.571210:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463680 00000100:00100000:2.0:1746065080.571216:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463680 00000100:00100000:2.0:1746065080.571246:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8668 00000100:00100000:2.0:1746065080.571252:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:26180:x1830881261463680:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.571265:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.571279:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccac expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.571295:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.571311:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.571312:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.571318:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.571329:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.571336:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf800, rc 0) 00000100:00100000:2.0:1746065080.571367:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:26180:x1830881261463680:12345-192.168.202.27@tcp:101:bash.0 Request processed in 115us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.571372:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8668 00000100:00100000:3.0:1746065080.571526:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881262650880:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065080.571541:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.571582:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261463552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3569us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.571590:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3645 00000100:00100000:3.0:1746065080.571919:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261463936 00000100:00100000:3.0:1746065080.571923:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261463936 00000100:00100000:3.0:1746065080.571947:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12282 00000100:00100000:3.0:1746065080.571951:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27924:x1830881261463936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.571960:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.571969:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1462f10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccb3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.572022:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.572030:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572037:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572045:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.572049:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572053:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572133:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.572139:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572144:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065080.572150:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 2 00010000:00010000:3.0:1746065080.572201:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572206:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572210:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572215:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572219:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.572222:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572226:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572234:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561d00) 00010000:00010000:3.0:1746065080.572236:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.572239:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572245:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f17 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572257:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572261:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572265:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572268:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.572270:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572274:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572278:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561a00) 00010000:00010000:3.0:1746065080.572280:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.572281:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572285:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.572323:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1462f10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.572333:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.572342:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.572344:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.572345:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3800, rc 0) 00000100:00100000:3.0:1746065080.572366:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27924:x1830881261463936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 415us (1298us total) trans 4294975628 rc 0/0 00000100:00100000:3.0:1746065080.572371:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12282 00000100:00100000:1.0:1746065080.574586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.574951:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.575010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.575161:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261464448 00000100:00100000:0.0:1746065080.575168:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261464448 00000100:00100000:2.0:1746065080.575204:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261464064 00000100:00100000:0.0:1746065080.575206:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4229 00000100:00100000:2.0:1746065080.575208:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261464064 00000100:00100000:0.0:1746065080.575212:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27924:x1830881261464448:12345-192.168.202.27@tcp:35:lfs.0 00002000:00010000:2.0:1746065080.575227:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/877 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.575230:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfed80 with x1830881261464064 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.575238:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cfed80. 00000100:00100000:2.0:1746065080.575250:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261464192 00000100:00100000:2.0:1746065080.575251:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261464192 00002000:00010000:2.0:1746065080.575259:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/876 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.575261:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfd500 with x1830881261464192 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.575265:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfd500. 00000100:00100000:2.0:1746065080.575274:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1275 00000100:00100000:2.0:1746065080.575278:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881261464064:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:0.0:1746065080.575340:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27924:x1830881261464448:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 128us (330us total) trans 4294975629 rc 0/0 00000100:00100000:0.0:1746065080.575345:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4229 00000100:00100000:0.0:1746065080.575365:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1276 00000100:00100000:0.0:1746065080.575370:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261464192:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065080.575386:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.575389:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.575391:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.575392:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.575394:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.575411:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261464064:12345-192.168.202.27@tcp:10:bash.0 Request processed in 132us (831us total) trans 17179872578 rc 0/0 00000100:00100000:2.0:1746065080.575416:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1275 00002000:00010000:2.0:1746065080.575419:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/877 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.575420:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfed80 with x1830881261464064 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.575423:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cfed80. 00002000:00010000:0.0:1746065080.575434:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065080.575436:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:0.0:1746065080.575438:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065080.575439:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:0.0:1746065080.575441:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065080.575664:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261464192:12345-192.168.202.27@tcp:10:bash.0 Request processed in 292us (713us total) trans 21474839858 rc 0/0 00000100:00100000:0.0:1746065080.575669:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1276 00002000:00010000:0.0:1746065080.575672:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/876 (0->18446744073709551615) 00002000:00100000:0.0:1746065080.575673:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfd500 with x1830881261464192 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065080.575677:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfd500. 00000100:00100000:0.0:1746065080.579081:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.579201:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.579656:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261464960 00000100:00100000:0.0:1746065080.579663:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261464960 00000100:00100000:0.0:1746065080.579715:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12283 00000100:00100000:0.0:1746065080.579722:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27924:x1830881261464960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.579740:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.579756:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462f33 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccba expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.580861:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,1 mode: --/CW res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.580877:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.580884:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 4/0,1 mode: --/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065080.580900:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261464704 00000100:00100000:2.0:1746065080.580905:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261464704 00010000:00010000:0.0:1746065080.580909:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.580919:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 287 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.580931:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098672300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262651008:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.580932:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4230 00000100:00100000:2.0:1746065080.580937:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261464704:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:0.0:1746065080.580999:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.581087:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261464704:12345-192.168.202.27@tcp:35:bash.0 Request processed in 149us (2012us total) trans 4294975630 rc 0/0 00000100:00100000:2.0:1746065080.581093:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4230 00000100:00100000:0.0:1746065080.585046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.585405:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098672300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262651008:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.585496:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261465088 00000100:00100000:3.0:1746065080.585502:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261465088 00010000:00010000:3.0:1746065080.585530:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 288 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.585563:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3646 00000100:00100000:3.0:1746065080.585570:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+288:2004:x1830881261465088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.585581:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.585586:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 288 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.585595:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 288 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.585612:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1462f25 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccb3 expref: 288 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.585634:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.585639:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,1 mode: --/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.585650:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.585656:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.585669:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.585821:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.585840:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.585845:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.585866:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 2 00010000:00010000:2.0:1746065080.585963:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462f33 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.585978:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.586329:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+288:2004:x1830881261465088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 758us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.586336:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3646 00010000:00010000:2.0:1746065080.586415:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.586417:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065080.586420:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054c00, rc 0) 00000100:00100000:2.0:1746065080.586463:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27924:x1830881261464960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6741us (7263us total) trans 4294975631 rc 0/0 00000100:00100000:2.0:1746065080.586469:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12283 00000100:00100000:1.0:1746065080.590076:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.590129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.590174:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261465216 00000100:00100000:2.0:1746065080.590183:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261465216 00000100:00100000:3.0:1746065080.590191:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261465344 00000100:00100000:3.0:1746065080.590194:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261465344 00000100:00100000:3.0:1746065080.590218:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12284 00000100:00100000:3.0:1746065080.590225:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27925:x1830881261465344:12345-192.168.202.27@tcp:101:rm.0 00000100:00100000:2.0:1746065080.590231:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12285 00000100:00100000:2.0:1746065080.590236:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27924:x1830881261465216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.590243:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.590243:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.590256:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1462f4f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccc8 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.590256:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462f48 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccc1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.590299:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.590308:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.590316:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.590317:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.590324:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.590325:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.590329:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.590331:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 4/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.590334:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.590354:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.590362:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 290 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.590376:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065080.590376:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262651136:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.590381:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.590385:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065080.590746:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.595557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.596025:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262651136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.596045:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065080.596827:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261465472 00000100:00100000:3.0:1746065080.596834:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261465472 00010000:00010000:3.0:1746065080.596863:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 291 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.596889:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3647 00000100:00100000:3.0:1746065080.596895:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+291:2004:x1830881261465472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.596906:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.596910:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 291 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.596918:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 291 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.596935:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462f3a lrc: 0/0,0 mode: --/CW res: [0x240000403:0x347:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccba expref: 291 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.596948:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.596952:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.596959:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.596965:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.596969:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.596974:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.596977:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.597005:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.597037:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+290:2004:x1830881261465472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 142us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.597043:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3647 00010000:00010000:3.0:1746065080.597068:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.597073:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065080.597109:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 5 00000004:00200000:3.0:1746065080.597113:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.597123:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.597147:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462f48 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccc1 expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.597158:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccc1 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.597163:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.597165:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.597167:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:3.0:1746065080.597189:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27924:x1830881261465216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6953us (7120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.597194:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12285 00010000:00010000:2.0:1746065080.597384:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597389:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.597407:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 5 00000004:00200000:2.0:1746065080.597410:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.597417:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597425:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597434:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597439:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597444:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597449:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597457:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.597460:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597466:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597472:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561600) 00010000:00010000:2.0:1746065080.597474:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.597477:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597482:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2600/0xad6b7ddc1462f56 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597492:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597496:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597499:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597503:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.597504:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597508:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597513:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561500) 00010000:00010000:2.0:1746065080.597515:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.597517:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597520:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1462f64 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.597542:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1462f4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccc8 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.597563:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccc8 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.597567:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.597569:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.597570:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:2.0:1746065080.597594:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27925:x1830881261465344:12345-192.168.202.27@tcp:101:rm.0 Request processed in 7370us (7465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.597599:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12284 00000100:00100000:0.0:1746065080.599537:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.599623:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261465600 00000100:00100000:1.0:1746065080.599629:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261465600 00000100:00100000:1.0:1746065080.599675:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 558 00000100:00100000:1.0:1746065080.599682:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+288:2005:x1830881261465600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.599693:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.599709:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3200/0xad6b7ddc1462f6b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccc8 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.599741:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.599744:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.599799:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+287:2005:x1830881261465600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.599805:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 558 00000100:00100000:0.0:1746065080.600127:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.600166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.600179:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261465856 00000100:00100000:0.0:1746065080.600182:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261465856 00000100:00100000:2.0:1746065080.600195:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466112 00000100:00100000:2.0:1746065080.600198:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466112 00000100:00100000:0.0:1746065080.601153:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12286 00000100:00100000:0.0:1746065080.601161:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27924:x1830881261465856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.601175:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.601188:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462f72 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cccf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.601258:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462f79 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.601268:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462f79 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.601275:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462f79 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065080.601283:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 5 00010000:00010000:0.0:1746065080.601354:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46400/0xad6b7ddc1462f72 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cccf expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.601599:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12287 00000100:00100000:2.0:1746065080.601606:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27925:x1830881261466112:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065080.602803:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065080.602821:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1462ebc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc97 expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.602839:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1462f5d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccc1 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.602847:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46e00/0xad6b7ddc1462e84 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cc82 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.602855:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.602858:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.602873:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.602881:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.602886:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.602895:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.602900:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.602904:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.602958:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.602964:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.602969:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065080.603111:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x347:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1746065080.603161:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603170:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603175:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603180:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.603183:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603188:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603195:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.603197:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065080.603200:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603204:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462f95 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603214:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603218:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603222:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603226:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603230:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.603232:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603236:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603242:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.603243:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.603245:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603249:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462f87 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065080.603259:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098359f80 reply state ffff88009a900000 transno 4294975633 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603266:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.603271:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4a14700) 00010000:00010000:2.0:1746065080.603273:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065080.603275:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065080.603515:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462f79 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cccf expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.603522:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:0.0:1746065080.603524:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065080.603526:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:0.0:1746065080.604460:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27924:x1830881261465856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3297us (4330us total) trans 4294975632 rc 0/0 00000100:00100000:0.0:1746065080.604468:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12286 00000100:00100000:2.0:1746065080.604801:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27925:x1830881261466112:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3195us (4633us total) trans 4294975633 rc 0/0 00000100:00100000:2.0:1746065080.604807:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12287 00000100:00100000:0.0:1746065080.610457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.610864:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466240 00000100:00100000:2.0:1746065080.610872:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466240 00000100:00100000:2.0:1746065080.610913:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12288 00000100:00100000:2.0:1746065080.610920:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27924:x1830881261466240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.610941:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.610958:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462f9c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccd6 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.611002:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462f9c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccd6 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.611013:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462f9c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccd6 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.611025:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.611028:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.611030:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:2.0:1746065080.613435:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27924:x1830881261466240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2505us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.613444:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12288 00000100:00100000:0.0:1746065080.615663:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.615717:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466368 00000100:00100000:2.0:1746065080.615724:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466368 00000100:00100000:0.0:1746065080.615751:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.615789:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12289 00000100:00100000:2.0:1746065080.615796:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27926:x1830881261466368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.615817:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.615837:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462fa3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccdd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.615889:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.615898:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615906:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615917:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.615922:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615926:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615955:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615960:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615965:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615970:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615975:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.615978:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615983:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.615991:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009a4b5d00) 00010000:00010000:2.0:1746065080.615993:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.615996:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616001:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1462faa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616011:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616015:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616019:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616022:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131054800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.616024:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616028:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616034:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4a14700) 00010000:00010000:2.0:1746065080.616036:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.616037:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616042:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc1462fb1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.616063:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462fa3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccdd expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.616069:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538400/0xad6b7ddc1462fa3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccdd expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.616079:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00000100:00100000:3.0:1746065080.616119:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466496 00000100:00100000:2.0:1746065080.616120:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27926:x1830881261466368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 324us (463us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.616123:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466496 00000100:00100000:2.0:1746065080.616126:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12289 00000100:00100000:3.0:1746065080.616149:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8669 00000100:00100000:3.0:1746065080.616155:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261466496:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065080.616176:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.616189:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.616195:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.616197:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.616199:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.616233:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.616245:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 48 pid: 12258 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.616255:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262651264:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.616324:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.618595:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.618642:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.618749:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466624 00000100:00100000:2.0:1746065080.618756:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466624 00000100:00100000:2.0:1746065080.618819:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12290 00000100:00100000:2.0:1746065080.618826:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27926:x1830881261466624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.618840:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.618855:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1462fbf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cce4 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.618898:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.618907:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.618915:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.618923:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.618928:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.618931:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466752 00010000:00010000:2.0:1746065080.618932:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.618935:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466752 00010000:00010000:2.0:1746065080.618958:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00002000:00100000:0.0:1746065080.618960:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x36d:0x0] (0->4) req@ffff880098673100 x1830881261466752/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/0 e 0 to 0 dl 1746065091 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00010000:00010000:2.0:1746065080.618962:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00002000:00100000:0.0:1746065080.618968:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098673100 with x1830881261466752 ext(0->4) 00010000:00010000:2.0:1746065080.618971:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.618975:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 49 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.618976:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.618980:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.618983:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.618988:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.618993:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 49 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.618996:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009af4d900) 00010000:00010000:2.0:1746065080.618998:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1746065080.618999:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098673100 00010000:00010000:2.0:1746065080.619001:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619005:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fc6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.619011:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 219 00010000:00010000:2.0:1746065080.619013:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.619016:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261466752:12345-192.168.202.27@tcp:4:bash.0 00010000:00010000:2.0:1746065080.619017:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619022:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619026:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.619028:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619036:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619041:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4a14700) 00010000:00010000:2.0:1746065080.619042:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.619044:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619048:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1462fcd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.619064:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1462fbf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cce4 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.619070:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055800/0xad6b7ddc1462fbf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cce4 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.619081:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055800, rc 0) 00000100:00100000:2.0:1746065080.619112:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27926:x1830881261466624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 286us (522us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065080.619117:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12290 00000100:00100000:3.0:1746065080.619368:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262651264:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.619384:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.620868:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261466752:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1848us (2221us total) trans 17179872579 rc 0/0 00000100:00100000:0.0:1746065080.620876:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 219 00002000:00100000:0.0:1746065080.620883:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x36d:0x0] (0->4) req@ffff880098673100 x1830881261466752/t17179872579(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:751/0 lens 496/448 e 0 to 0 dl 1746065091 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1746065080.620890:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098673100 with x1830881261466752 ext(0->4) 00010000:00010000:0.0:1746065080.620896:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 51 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.620907:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 51 pid: 12258 timeout: 776 lvb_type: 0 00002000:00010000:0.0:1746065080.620912:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098673100 00000100:00100000:0.0:1746065080.626094:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.626275:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.626386:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261466880 00000100:00100000:2.0:1746065080.626394:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261466880 00000100:00100000:2.0:1746065080.626432:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12291 00000100:00100000:2.0:1746065080.626438:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27926:x1830881261466880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.626454:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.626469:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fd4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cceb expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.626519:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1462fdb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.626529:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1462fdb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.626538:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1462fdb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.626579:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065080.626583:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065080.626605:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fd4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cceb expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.626643:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1462fdb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cceb expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.626649:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:2.0:1746065080.626652:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065080.626654:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be400, rc 0) 00000100:00100000:2.0:1746065080.626694:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27926:x1830881261466880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 256us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.626701:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12291 00000100:00100000:1.0:1746065080.626765:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261467008 00000100:00100000:1.0:1746065080.626769:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261467008 00010000:00010000:1.0:1746065080.626806:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 51 pid: 12258 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.626823:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3648 00000100:00100000:1.0:1746065080.626828:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881261467008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.626836:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065080.626846:0:7190:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065080.626848:0:7190:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065080.626851:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 51 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.626861:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 51 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.626874:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1462f02 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cca5 expref: 51 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.626886:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.626888:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.626891:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.626897:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.626912:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.626930:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261467008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.626935:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3648 00010000:00010000:3.0:1746065080.628084:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628095:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628114:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628120:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628126:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628132:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.628136:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628143:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628153:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.628158:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc1462fb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.628204:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261466496:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 12047us (12451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.628212:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8669 00000100:00100000:0.0:1746065080.630371:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.631396:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261467264 00000100:00100000:2.0:1746065080.631404:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261467264 00000100:00100000:2.0:1746065080.631457:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12292 00000100:00100000:2.0:1746065080.631464:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27924:x1830881261467264:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065080.631507:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.631528:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf600/0xad6b7ddc1462f9c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccd6 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.631547:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.631561:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.631583:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.631594:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.631602:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065080.631767:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2451, 88 off202928 00000004:00080000:2.0:1746065080.631787:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676650012813ns, next at 676590632635ns, rc = 0 00000040:00080000:2.0:1746065080.631817:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2447, 88 off202496 00000004:00080000:2.0:1746065080.631820:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676650046461ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.631855:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2448, 88 off202584 00000004:00080000:2.0:1746065080.631858:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676650084432ns, next at 676590652783ns, rc = 0 00000040:00080000:2.0:1746065080.631878:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2452, 88 off203016 00000004:00080000:2.0:1746065080.631882:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676650108243ns, next at 676590632635ns, rc = 0 00000100:00100000:0.0:1746065080.633874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.633917:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261467392 00000100:00100000:3.0:1746065080.633924:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261467392 00000100:00100000:3.0:1746065080.633954:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12293 00000100:00100000:3.0:1746065080.633961:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27926:x1830881261467392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.633975:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.633988:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c600/0xad6b7ddc1462fe9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccf2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.634033:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.634043:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634053:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634059:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.634064:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634069:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634091:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634096:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634100:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634105:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634110:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835ce00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.634113:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634118:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634126:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:3.0:1746065080.634129:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.634132:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634136:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1462ff0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634145:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634150:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634154:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634158:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.634159:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634163:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634167:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4a14700) 00010000:00010000:3.0:1746065080.634169:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.634170:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634174:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1462ff7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.634192:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c600/0xad6b7ddc1462fe9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf2 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.634198:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c600/0xad6b7ddc1462fe9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf2 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.634204:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c600, rc 0) 00000100:00100000:3.0:1746065080.634247:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27926:x1830881261467392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 286us (378us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.634252:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12293 00000001:00080000:1.0:1746065080.640515:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975634 is committed 00000004:00080000:1.0:1746065080.640527:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1655 committed 00000004:00080000:1.0:1746065080.640537:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1645 committed 00000004:00080000:1.0:1746065080.640544:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1644 committed 00000004:00080000:1.0:1746065080.640546:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1654 committed 00010000:00010000:3.0:1746065080.640616:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.640625:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.640631:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.640636:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.640640:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065080.640644:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1746065080.640646:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.640658:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b4a14700) 00000100:00100000:1.0:1746065080.640658:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262651392:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.640660:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.640663:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.640667:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bea00/0xad6b7ddc1462f8e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065080.640689:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262651520:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.640707:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.640717:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.640735:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262651392 00000100:00100000:3.0:1746065080.640741:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262651392 00000100:00100000:3.0:1746065080.640765:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262651520 00000100:00100000:3.0:1746065080.640767:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262651520 00000100:00100000:0.0:1746065080.640949:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8670 00000100:00100000:0.0:1746065080.640956:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+76:3761:x1830881262651392:12345-0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065080.641048:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098672300 reply state ffff88008f125000 transno 4294975634 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00002000:00010000:0.0:1746065080.641049:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065080.641051:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.641053:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065080.641055:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:0.0:1746065080.641057:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065080.641059:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641064:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.641066:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065080.641069:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065080.641084:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+77:3761:x1830881262651392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 129us (376us total) trans 21474839859 rc 0/0 00000100:00100000:1.0:1746065080.641086:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8671 00000100:00100000:0.0:1746065080.641090:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8670 00000100:00100000:1.0:1746065080.641092:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+77:3759:x1830881262651520:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.641150:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+77:3759:x1830881262651520:12345-0@lo:2:osp-syn-0-1.0 Request processed in 58us (430us total) trans 21474839860 rc 0/0 00000100:00100000:1.0:1746065080.641155:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8671 00000100:00100000:1.0:1746065080.641168:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262651776:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.641182:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065080.641208:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6df800/2, rc 0, transno 21474839859 00000100:00100000:1.0:1746065080.641212:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262651392:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.641221:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262651776 00000100:00100000:1.0:1746065080.641223:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262651776 00000100:00100000:1.0:1746065080.641234:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8672 00000100:00100000:1.0:1746065080.641238:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+108:3761:x1830881262651776:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.641295:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+109:3761:x1830881262651776:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (112us total) trans 17179872580 rc 0/0 00000100:00100000:1.0:1746065080.641299:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8672 00000004:00080000:1.0:1746065080.641314:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf3800/2, rc 0, transno 17179872580 00000100:00100000:1.0:1746065080.641317:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262651776:0@lo:2:osp-syn-1-1.0 00010000:00080000:1.0:1746065080.641361:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065080.641369:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27924:x1830881261467264:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 9905us (11004us total) trans 4294975634 rc 0/0 00000100:00100000:1.0:1746065080.641375:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12292 00000100:00100000:1.0:1746065080.641429:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.641469:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261467648 00000100:00100000:1.0:1746065080.641471:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261467648 00000100:00100000:1.0:1746065080.641487:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12294 00000100:00100000:1.0:1746065080.641491:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+282:27926:x1830881261467648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.641502:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.641505:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065080.641518:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1462fdb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cceb expref: 282 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.641531:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b4a14500) 00010000:00010000:1.0:1746065080.641536:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.641561:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc1462ffe lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ccf9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.641620:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.641629:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641636:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641643:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.641648:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641652:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641927:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.641935:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641944:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065080.641950:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x349:0x0]: returning size 0 00010000:00010000:1.0:1746065080.641971:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.641975:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641975:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.641980:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641980:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.641985:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641985:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.641988:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.641988:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.641991:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641991:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.641995:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.642002:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd800) 00010000:00010000:1.0:1746065080.642003:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.642006:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.642010:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1463005 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065080.642016:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5f3b80 reply state ffff8800940c6000 transno 4294975635 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.642025:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.642029:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbdb00) 00010000:00010000:1.0:1746065080.642031:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.642032:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065080.642049:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc1462ffe lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 284 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.642060:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 283 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.642065:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88012edbd200) 00010000:00010000:1.0:1746065080.642066:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065080.642067:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04a000, rc 0) 00000100:00100000:1.0:1746065080.642090:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+284:27926:x1830881261467648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 598us (660us total) trans 4294975635 rc 0/0 00000100:00100000:1.0:1746065080.642095:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12294 00010000:00010000:2.0:1746065080.642121:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.642130:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.642132:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.642134:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.642137:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc1462fe2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065080.642620:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262651648:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.642646:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.643096:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262651648 00000100:00100000:3.0:1746065080.643101:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262651648 00000100:00100000:0.0:1746065080.643197:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8673 00000100:00100000:0.0:1746065080.643205:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+109:3760:x1830881262651648:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.643293:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+110:3760:x1830881262651648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 90us (646us total) trans 17179872581 rc 0/0 00000100:00100000:0.0:1746065080.643298:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8673 00000004:00080000:2.0:1746065080.643478:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf1180/2, rc 0, transno 17179872581 00000100:00100000:2.0:1746065080.643482:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262651648:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065080.644006:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e37ed80/2, rc 0, transno 21474839860 00000100:00100000:3.0:1746065080.644010:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262651520:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.648234:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.648263:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.648467:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261467776 00000100:00100000:1.0:1746065080.648475:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261467776 00000100:00100000:1.0:1746065080.648508:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468032 00000100:00100000:1.0:1746065080.648510:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468032 00000100:00100000:1.0:1746065080.648534:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12295 00000100:00100000:1.0:1746065080.648541:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27924:x1830881261467776:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065080.648559:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12296 00000100:00100000:0.0:1746065080.648565:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27926:x1830881261468032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.648567:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.648570:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.648581:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd00 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.648581:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463028 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd07 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.648625:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.648634:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.648647:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.648649:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065080.648652:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be400, rc 0) 00010000:00010000:0.0:1746065080.648655:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065080.648662:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.648667:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 4/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065080.648683:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27924:x1830881261467776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 142us (456us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065080.648687:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 286 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.648688:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12295 00010000:00010000:0.0:1746065080.648696:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 285 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.648706:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262651904:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.648739:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.652192:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.652401:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468160 00000100:00100000:2.0:1746065080.652407:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468160 00000100:00100000:2.0:1746065080.652601:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12297 00000100:00100000:2.0:1746065080.652609:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27924:x1830881261468160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.652627:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.652642:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463036 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd0e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.652650:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262651904:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.652668:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.652694:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc146303d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.652704:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc146303d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.652713:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc146303d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.652747:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x347:0x0]: returning size 5 00000004:00200000:2.0:1746065080.652751:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.652763:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc146303d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.652803:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463036 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd0e expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.652820:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc146303d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd0e expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.652827:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.652829:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065080.652831:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054800, rc 0) 00000100:00100000:2.0:1746065080.652875:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27924:x1830881261468160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 267us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.652881:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12297 00000100:00100000:0.0:1746065080.655028:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.655208:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.655310:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468288 00000100:00100000:3.0:1746065080.655316:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468288 00010000:00010000:3.0:1746065080.655342:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 287 pid: 7205 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.655369:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3649 00000100:00100000:3.0:1746065080.655375:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+287:2004:x1830881261468288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.655385:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.655389:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 287 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.655399:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 287 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.655414:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463013 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccf9 expref: 287 pid: 7205 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.655427:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065080.655431:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.655438:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.655444:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.655460:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.655488:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+286:2004:x1830881261468288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 113us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.655494:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3649 00010000:00010000:1.0:1746065080.655632:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.655638:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065080.655655:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x349:0x0]: returning size 0 00000004:00080000:1.0:1746065080.655765:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x36e:0x0], index 0: 0 00000004:00080000:1.0:1746065080.655769:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x36f:0x0], index 1: 0 00000004:00080000:1.0:1746065080.655792:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x370:0x0], index 1: 0 00000004:00080000:1.0:1746065080.655796:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x36f:0x0], index 0: 0 00000100:00100000:2.0:1746065080.656036:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468416 00000100:00100000:2.0:1746065080.656041:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468416 00000100:00100000:2.0:1746065080.656068:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8674 00000100:00100000:2.0:1746065080.656072:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261468416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.656083:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.656096:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd15 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.656116:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36d:0x0] initial LVB size: 5, mtime: 0x6812d6b8, atime: 0x0, ctime: 0x6812d6b8, blocks: 0x8 00010000:00010000:2.0:1746065080.656127:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.656129:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.656135:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 50 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.656146:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 50 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.656153:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055600, rc 0) 00000100:00100000:2.0:1746065080.656176:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261468416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 104us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.656181:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8674 00010000:00010000:1.0:1746065080.656603:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656611:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656617:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656621:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.656624:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656628:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656637:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88012edbd200) 00010000:00010000:1.0:1746065080.656639:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065080.656641:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656645:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2800/0xad6b7ddc146302f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.656682:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463028 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd07 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.656688:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463028 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd07 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.656700:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112800, rc 0) 00000100:00100000:1.0:1746065080.657427:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27926:x1830881261468032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8860us (9160us total) trans 4294975636 rc 301/301 00000100:00100000:1.0:1746065080.657433:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12296 00000100:00100000:0.0:1746065080.659643:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.660295:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468544 00000100:00100000:2.0:1746065080.660302:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468544 00000100:00100000:2.0:1746065080.660336:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8675 00000100:00100000:2.0:1746065080.660341:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261468544:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065080.660415:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261468544:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 73us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.660421:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8675 00000100:00100000:0.0:1746065080.661072:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.661151:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468800 00000100:00100000:3.0:1746065080.661156:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468800 00000100:00100000:3.0:1746065080.661200:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4231 00000100:00100000:3.0:1746065080.661211:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27926:x1830881261468800:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.661401:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27926:x1830881261468800:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 195us (330us total) trans 4294975637 rc 0/0 00000100:00100000:3.0:1746065080.661407:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4231 00000100:00100000:0.0:1746065080.664457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.665125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.665198:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261468928 00000100:00100000:2.0:1746065080.665205:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261468928 00000100:00100000:2.0:1746065080.665247:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8676 00000100:00100000:2.0:1746065080.665254:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261468928:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065080.665337:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261469184 00000100:00100000:1.0:1746065080.665341:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261469184 00000100:00100000:1.0:1746065080.665373:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4232 00000100:00100000:1.0:1746065080.665378:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27926:x1830881261469184:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.665531:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27926:x1830881261469184:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 151us (406us total) trans 4294975638 rc 0/0 00000100:00100000:1.0:1746065080.665537:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4232 00000100:00100000:2.0:1746065080.665665:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261468928:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 411us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.665671:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8676 00000100:00100000:0.0:1746065080.670085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.670164:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.670733:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261469696 00000100:00100000:1.0:1746065080.670742:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261469696 00000100:00100000:2.0:1746065080.670805:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261469440 00000100:00100000:2.0:1746065080.670810:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261469440 00000100:00100000:1.0:1746065080.670810:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12298 00000100:00100000:1.0:1746065080.670819:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27924:x1830881261469696:12345-192.168.202.27@tcp:36:lfs.0 00000100:00100000:2.0:1746065080.670833:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12299 00000100:00100000:2.0:1746065080.670838:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261469440:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.670847:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.670861:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.670863:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1463052 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd1c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.670880:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054800/0xad6b7ddc146303d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x347:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd0e expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.670893:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.670897:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.670915:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.670925:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.670932:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.670950:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.670957:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.670963:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.670971:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.670976:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.670981:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065080.671008:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cf3480 reply state ffff8800997f2000 transno 4294975639 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.671015:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146306e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.671016:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.671020:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146306e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.671021:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.671023:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.671025:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065080.671028:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146306e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.671034:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x349:0x0]: returning size 0 00010000:00010000:2.0:1746065080.671068:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671074:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671079:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065080.671079:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27924:x1830881261469696:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 262us (1003us total) trans 4294975639 rc 0/0 00010000:00010000:2.0:1746065080.671084:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065080.671085:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12298 00010000:00010000:2.0:1746065080.671088:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.671091:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671096:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671103:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec47900) 00010000:00010000:2.0:1746065080.671105:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.671108:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671111:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055200/0xad6b7ddc1463060 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671119:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671126:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671129:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671133:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.671134:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671139:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671143:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbdb00) 00010000:00010000:2.0:1746065080.671145:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.671147:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671150:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf000/0xad6b7ddc1463067 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.671171:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc1463052 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd1c expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.671181:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146306e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd1c expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.671187:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065080.671188:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.671190:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfe00, rc 0) 00000100:00100000:2.0:1746065080.671225:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261469440:12345-192.168.202.27@tcp:101:bash.0 Request processed in 386us (1061us total) trans 4294975640 rc 0/0 00000100:00100000:2.0:1746065080.671230:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12299 00000100:00100000:0.0:1746065080.674411:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.674496:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.674592:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261469824 00000100:00100000:3.0:1746065080.674599:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261469824 00000100:00100000:1.0:1746065080.674720:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261469952 00000100:00100000:1.0:1746065080.674723:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261469952 00000100:00100000:1.0:1746065080.674766:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12300 00000100:00100000:1.0:1746065080.674789:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261469952:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:3.0:1746065080.674985:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8677 00000100:00100000:3.0:1746065080.674991:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261469824:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065080.675234:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065080.675237:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.675239:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb atime from disk: 0 -> 1746065080 00002000:00010000:3.0:1746065080.675240:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.675242:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065080.675277:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261469824:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 285us (872us total) trans 17179872582 rc 0/0 00000100:00100000:3.0:1746065080.675282:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8677 00010000:00010000:1.0:1746065080.675323:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.675336:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc146307c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd23 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.675359:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc1463083 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.675368:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc1463083 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.675377:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc1463083 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.675438:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a800/0xad6b7ddc146307c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd23 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.675449:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc1463083 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd23 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.675459:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065080.675462:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065080.675464:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ac00, rc 0) 00000100:00100000:1.0:1746065080.675492:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261469952:12345-192.168.202.27@tcp:101:bash.0 Request processed in 721us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.675497:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12300 00000100:00100000:0.0:1746065080.678881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.678924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.678998:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261470208 00000100:00100000:1.0:1746065080.679005:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261470208 00000100:00100000:2.0:1746065080.679089:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261470464 00000100:00100000:2.0:1746065080.679093:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261470464 00000100:00100000:1.0:1746065080.679098:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12301 00000100:00100000:1.0:1746065080.679105:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261470208:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065080.679142:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.679161:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146306e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd1c expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.679176:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065080.679179:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.679306:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4233 00000100:00100000:2.0:1746065080.679313:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27924:x1830881261470464:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065080.679338:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x347:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462f79 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cccf expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.679361:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:2.0:1746065080.679371:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.679376:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 4/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065080.679380:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065080.679389:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.679396:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.679399:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.679408:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 292 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.679418:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262652032:192.168.202.27@tcp:104: 00000001:00080000:1.0:1746065080.679426:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975641 00000004:00010000:1.0:1746065080.679443:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cf2d80 reply state ffff8800997f5000 transno 4294975642 ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.679455:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.679460:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:1.0:1746065080.679463:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.679465:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065080.679495:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.679716:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261470208:12345-192.168.202.27@tcp:36:bash.0 Request processed in 611us (840us total) trans 4294975642 rc 0/0 00000100:00100000:1.0:1746065080.679721:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12301 00000020:00080000:1.0:1746065080.679725:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746065080.683732:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262652032:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.683753:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000100:00100000:2.0:1746065080.683817:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.684014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.684027:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261470592 00000100:00100000:1.0:1746065080.684033:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261470592 00000100:00100000:0.0:1746065080.684063:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261470720 00000100:00100000:0.0:1746065080.684066:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261470720 00000100:00100000:1.0:1746065080.684068:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12302 00000100:00100000:1.0:1746065080.684074:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261470592:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.684086:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 295 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.684090:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.684102:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463098 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd2a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.684104:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3650 00000100:00100000:0.0:1746065080.684108:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261470720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.684118:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.684123:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 296 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.684131:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 296 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.684145:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1463021 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd00 expref: 296 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.684150:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463098 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd2a expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.684157:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:1.0:1746065080.684159:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463098 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd2a expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.684161:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.684166:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065080.684169:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:0.0:1746065080.684170:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065080.684172:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065080.684174:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00010000:00010000:0.0:1746065080.684182:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.684206:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261470592:12345-192.168.202.27@tcp:101:bash.0 Request processed in 133us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.684208:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261470720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.684213:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12302 00000100:00100000:0.0:1746065080.684213:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3650 00010000:00010000:3.0:1746065080.684315:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.684320:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000040:00080000:3.0:1746065080.684494:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2453, 88 off203104 00000004:00080000:3.0:1746065080.684498:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676702724094ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.684527:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2449, 88 off202672 00000004:00080000:3.0:1746065080.684530:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676702756724ns, next at 676590652783ns, rc = 0 00000040:00080000:3.0:1746065080.684540:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2450, 88 off202760 00000004:00080000:3.0:1746065080.684543:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676702769124ns, next at 676590652783ns, rc = 0 00000040:00080000:3.0:1746065080.684559:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2454, 88 off203192 00000004:00080000:3.0:1746065080.684562:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676702788658ns, next at 676590632635ns, rc = 0 00000001:00080000:1.0:1746065080.687741:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975643 is committed 00000004:00080000:1.0:1746065080.687751:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1657 committed 00000004:00080000:1.0:1746065080.687800:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1647 committed 00000004:00080000:1.0:1746065080.687805:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1646 committed 00000004:00080000:1.0:1746065080.687807:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1656 committed 00010000:00010000:3.0:1746065080.688585:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688595:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688601:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688606:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.688610:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688615:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688628:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbdb00) 00010000:00010000:3.0:1746065080.688630:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.688633:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688637:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc146300c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.688657:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688661:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688665:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688668:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.688670:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688675:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688681:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:3.0:1746065080.688683:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.688684:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688688:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0200/0xad6b7ddc1463059 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.688697:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.688701:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.688705:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.688709:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.688711:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.688715:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.688720:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065080.688722:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.688724:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.688728:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683be00/0xad6b7ddc1463091 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065080.688861:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065080.688873:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262652160:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.688918:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.688944:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262652416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.688958:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262652288:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.688964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.688973:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065080.688978:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065080.688981:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262652544:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.688992:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652160 00000100:00100000:3.0:1746065080.688994:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.688998:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652160 00000100:00100000:3.0:1746065080.689009:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652416 00000100:00100000:3.0:1746065080.689011:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652416 00000100:00100000:1.0:1746065080.689021:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652288 00000100:00100000:3.0:1746065080.689023:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652544 00000100:00100000:1.0:1746065080.689023:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652288 00000100:00100000:3.0:1746065080.689024:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652544 00000100:00100000:3.0:1746065080.689038:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8678 00000100:00100000:1.0:1746065080.689044:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8679 00000100:00100000:3.0:1746065080.689045:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+111:3761:x1830881262652160:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.689048:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+78:3759:x1830881262652416:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065080.689136:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065080.689138:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.689140:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb atime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.689142:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.689144:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065080.689151:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+79:3759:x1830881262652416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 102us (186us total) trans 21474839861 rc 0/0 00000100:00100000:1.0:1746065080.689157:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8679 00000100:00100000:3.0:1746065080.689158:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+112:3761:x1830881262652160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (241us total) trans 17179872583 rc 0/0 00000100:00100000:3.0:1746065080.689162:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8678 00000100:00100000:1.0:1746065080.689169:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8680 00000100:00100000:1.0:1746065080.689173:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+111:3759:x1830881262652544:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.689224:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+112:3759:x1830881262652544:12345-0@lo:2:osp-syn-1-1.0 Request processed in 51us (229us total) trans 17179872584 rc 0/0 00000100:00100000:3.0:1746065080.689340:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8681 00000100:00100000:1.0:1746065080.689343:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8680 00000100:00100000:3.0:1746065080.689345:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+78:3761:x1830881262652288:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065080.689371:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858e680/2, rc 0, transno 17179872584 00000100:00100000:1.0:1746065080.689377:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262652544:0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065080.689381:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.689382:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb mtime from disk: 1746065080 -> 1746065080 00002000:00010000:3.0:1746065080.689384:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:1.0:1746065080.689384:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0380/2, rc 0, transno 21474839861 00002000:00010000:3.0:1746065080.689386:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb ctime from disk: 1746065080 -> 1746065080 00000100:00100000:1.0:1746065080.689387:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262652416:0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065080.689388:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x36c:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1746065080.689399:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858f800/2, rc 0, transno 17179872583 00000100:00100000:1.0:1746065080.689402:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262652160:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.689404:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+79:3761:x1830881262652288:12345-0@lo:2:osp-syn-0-1.0 Request processed in 59us (429us total) trans 21474839862 rc 0/0 00000004:00080000:1.0:1746065080.689408:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2300/2, rc 0, transno 21474839862 00000100:00100000:3.0:1746065080.689409:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8681 00000100:00100000:1.0:1746065080.689410:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262652288:0@lo:2:osp-syn-0-1.0 00000004:00010000:2.0:1746065080.689506:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009858fb80 reply state ffff88009a919000 transno 4294975643 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065080.689518:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065080.689524:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.689525:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065080.689528:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065080.689532:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.689534:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065080.689538:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1462f79 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cccf expref: 282 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.689563:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.689606:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261470976 00000100:00100000:3.0:1746065080.689610:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261470976 00010000:00080000:2.0:1746065080.689612:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065080.689619:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27924:x1830881261470464:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 10307us (10694us total) trans 4294975643 rc 0/0 00000100:00100000:2.0:1746065080.689625:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4233 00000100:00100000:3.0:1746065080.689628:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12303 00000100:00100000:3.0:1746065080.689632:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+282:26180:x1830881261470976:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.689640:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.689641:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.689643:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.689645:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065080.689649:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.689653:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463098 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd2a expref: 282 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.689653:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.689655:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065080.689660:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.689661:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065080.689663:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.689669:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146309f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd31 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.689669:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff880134bac600) 00010000:00010000:2.0:1746065080.689671:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.689672:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065080.689676:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc146308a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.689695:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14630a6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.689703:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14630a6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.689709:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14630a6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:3.0:1746065080.689845:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2451, 88 off202848 00000004:00080000:3.0:1746065080.689850:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676708075997ns, next at 676590652783ns, rc = 0 00000040:00080000:3.0:1746065080.689868:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2455, 88 off203280 00000004:00080000:3.0:1746065080.689871:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676708097176ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.689880:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2456, 88 off203368 00000004:00080000:3.0:1746065080.689883:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676708109401ns, next at 676590632635ns, rc = 0 00000040:00080000:3.0:1746065080.689890:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2452, 88 off202936 00000004:00080000:3.0:1746065080.689893:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676708119406ns, next at 676590652783ns, rc = 0 00000100:00100000:0.0:1746065080.691385:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.691919:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261471104 00000100:00100000:2.0:1746065080.691924:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261471104 00000100:00100000:2.0:1746065080.691966:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12304 00000100:00100000:2.0:1746065080.691973:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27924:x1830881261471104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.692018:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.692033:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14630ad lrc: 2/0,0 mode: --/CR res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd38 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.692076:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14630ad lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd38 expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.692087:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880131054c00/0xad6b7ddc14630ad lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x347:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd38 expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.692169:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff88008ec47600) 00010000:00010000:2.0:1746065080.692172:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065080.692175:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131054c00, rc 0) 00000100:00100000:2.0:1746065080.692216:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27924:x1830881261471104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 243us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.692221:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12304 00000100:00100000:2.0:1746065080.697815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.697874:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261471360 00000100:00100000:3.0:1746065080.697881:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261471360 00000100:00100000:3.0:1746065080.697917:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4234 00000100:00100000:3.0:1746065080.697924:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27924:x1830881261471360:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065080.699276:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x347:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065080.699329:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2457, 64 off203432 00000004:00080000:3.0:1746065080.699335:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676717560784ns, next at 677717559249ns, rc = 0 00000040:00080000:3.0:1746065080.699349:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2453, 64 off203000 00000004:00080000:3.0:1746065080.699352:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676717578842ns, next at 677717578181ns, rc = 0 00000040:00080000:3.0:1746065080.699360:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2454, 64 off203064 00000040:00080000:3.0:1746065080.699367:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2458, 64 off203496 00010000:00010000:3.0:1746065080.699935:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:3.0:1746065080.699947:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.699956:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.699962:0:7206:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.699966:0:7206:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.699970:0:7206:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.699986:0:7206:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065080.700148:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27924:x1830881261471360:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2221us (2338us total) trans 4294975645 rc 0/0 00010000:00010000:0.0:1746065080.700154:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1746065080.700155:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4234 00010000:00010000:0.0:1746065080.700159:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.700164:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.700167:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.700173:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.700183:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x347:0x0].0x0 (ffff88008ec47600) 00010000:00010000:0.0:1746065080.700185:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065080.700188:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.700192:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc14630b4 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.700203:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.700204:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.700205:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746065080.700816:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975644 is committed 00000004:00080000:1.0:1746065080.700823:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1649 committed 00000004:00080000:1.0:1746065080.701802:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1659 committed 00000004:00080000:1.0:1746065080.701812:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1658 committed 00000004:00080000:1.0:1746065080.701814:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1648 committed 00010000:00010000:3.0:1746065080.702016:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14630a6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd31 expref: 284 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.702024:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065080.702026:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.702037:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146309f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd31 expref: 284 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065080.702049:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14630a6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd31 expref: 283 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.702068:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065080.702070:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.702072:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00000100:00100000:3.0:1746065080.702105:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261470976:12345-192.168.202.27@tcp:101:bash.0 Request processed in 12472us (12542us total) trans 4294975644 rc 0/0 00000100:00100000:3.0:1746065080.702111:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12303 00000100:00100000:3.0:1746065080.702203:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262652800:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.702238:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.702263:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652800 00000100:00100000:0.0:1746065080.702268:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652800 00000100:00100000:3.0:1746065080.702272:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065080.702276:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262652672:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.702290:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.702293:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8682 00000100:00100000:0.0:1746065080.702298:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+112:3762:x1830881262652800:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.702307:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652672 00000100:00100000:3.0:1746065080.702309:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652672 00000100:00100000:3.0:1746065080.702321:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8683 00000100:00100000:3.0:1746065080.702324:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+113:3762:x1830881262652672:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.702402:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+115:3762:x1830881262652672:12345-0@lo:2:osp-syn-1-1.0 Request processed in 76us (110us total) trans 17179872585 rc 0/0 00000100:00100000:0.0:1746065080.702409:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+115:3762:x1830881262652800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 112us (171us total) trans 17179872586 rc 0/0 00000100:00100000:2.0:1746065080.702582:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262653056:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.702602:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.702615:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065080.702619:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262652928:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.702631:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.702648:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262653056 00000100:00100000:2.0:1746065080.702650:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262653056 00000100:00100000:3.0:1746065080.702884:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8683 00000100:00100000:3.0:1746065080.702895:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652928 00000100:00100000:3.0:1746065080.702897:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652928 00000100:00100000:0.0:1746065080.703004:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8682 00000100:00100000:2.0:1746065080.703049:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8684 00000100:00100000:2.0:1746065080.703055:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+80:3760:x1830881262653056:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.703136:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+81:3760:x1830881262653056:12345-0@lo:2:osp-syn-0-1.0 Request processed in 81us (533us total) trans 21474839863 rc 0/0 00000100:00100000:2.0:1746065080.703140:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8684 00000100:00100000:3.0:1746065080.703300:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8685 00000100:00100000:3.0:1746065080.703305:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+81:3760:x1830881262652928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.703363:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+82:3760:x1830881262652928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 58us (730us total) trans 21474839864 rc 0/0 00000100:00100000:3.0:1746065080.703367:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8685 00000004:00080000:2.0:1746065080.703636:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dea00/2, rc 0, transno 21474839864 00000100:00100000:2.0:1746065080.703644:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262652928:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065080.703650:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dc000/2, rc 0, transno 21474839863 00000100:00100000:2.0:1746065080.703652:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262653056:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065080.704136:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858f480/2, rc 0, transno 17179872585 00000100:00100000:3.0:1746065080.704148:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262652672:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065080.704157:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858df80/2, rc 0, transno 17179872586 00000100:00100000:3.0:1746065080.704160:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262652800:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.707056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.708053:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261471488 00000100:00100000:1.0:1746065080.708062:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261471488 00000100:00100000:3.0:1746065080.708860:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8686 00000100:00100000:3.0:1746065080.708871:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:26180:x1830881261471488:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.708884:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.708900:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd3f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065080.708917:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.708932:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.708934:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.708940:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.708951:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.708960:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be400, rc 0) 00000100:00100000:3.0:1746065080.709512:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+40:26180:x1830881261471488:12345-192.168.202.27@tcp:101:bash.0 Request processed in 642us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.709521:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8686 00000100:00100000:3.0:1746065080.721836:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.721836:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.721971:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261471616 00000100:00100000:2.0:1746065080.721978:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261471616 00000100:00100000:2.0:1746065080.722010:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8687 00000100:00100000:2.0:1746065080.722017:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+51:26180:x1830881261471616:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.722032:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.722049:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd46 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.722068:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.722090:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.722091:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.722098:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 52 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.722109:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 52 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.722116:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0bbc00, rc 0) 00000100:00100000:2.0:1746065080.722153:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+52:26180:x1830881261471616:12345-192.168.202.27@tcp:101:bash.0 Request processed in 135us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.722158:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8687 00000100:00100000:2.0:1746065080.722175:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261471872 00000100:00100000:2.0:1746065080.722178:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261471872 00000100:00100000:2.0:1746065080.722212:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12305 00000100:00100000:2.0:1746065080.722217:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+283:27927:x1830881261471872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.722228:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.722244:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc14630c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd4d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.722364:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.722372:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722380:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722389:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.722394:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722398:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722465:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc14630de lrc: 3/1,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.722470:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc14630de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722475:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc14630de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.722481:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x349:0x0]: returning size 2 00010000:00010000:2.0:1746065080.722529:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722534:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722704:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722711:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722716:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.722718:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722724:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722737:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:2.0:1746065080.722739:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.722742:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722746:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722768:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722792:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722795:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722799:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.722801:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722805:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722810:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893000) 00010000:00010000:2.0:1746065080.722812:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.722814:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722818:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.722848:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055e00/0xad6b7ddc14630c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd4d expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.722860:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc14630de lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd4d expref: 285 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.722865:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065080.722867:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.722869:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07000, rc 0) 00000100:00100000:2.0:1746065080.722895:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27927:x1830881261471872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 677us (1065us total) trans 4294975646 rc 0/0 00000100:00100000:2.0:1746065080.722900:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12305 00000100:00100000:0.0:1746065080.725729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.725888:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261472256 00000100:00100000:3.0:1746065080.725895:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261472256 00000100:00100000:3.0:1746065080.725946:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4235 00000100:00100000:3.0:1746065080.725953:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27927:x1830881261472256:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.726153:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27927:x1830881261472256:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 199us (429us total) trans 4294975647 rc 0/0 00000100:00100000:3.0:1746065080.726159:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4235 00000100:00100000:0.0:1746065080.729971:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.730062:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.730250:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261472000 00000100:00100000:2.0:1746065080.730257:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261472000 00002000:00010000:2.0:1746065080.730287:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/878 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.730291:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009858c700 with x1830881261472000 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.730299:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009858c700. 00000100:00100000:2.0:1746065080.730313:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261472384 00000100:00100000:2.0:1746065080.730316:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261472384 00002000:00010000:2.0:1746065080.730324:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/879 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.730326:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009858f100 with x1830881261472384 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.730331:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009858f100. 00000100:00100000:2.0:1746065080.730891:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1277 00000100:00100000:2.0:1746065080.730899:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261472000:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065080.731032:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x36e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.731034:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x36e:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.731037:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x36e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.731038:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x36e:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.731040:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x36e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.731077:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261472000:12345-192.168.202.27@tcp:10:bash.0 Request processed in 179us (1111us total) trans 21474839865 rc 0/0 00000100:00100000:2.0:1746065080.731082:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1277 00002000:00010000:2.0:1746065080.731085:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/878 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.731087:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009858c700 with x1830881261472000 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.731090:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009858c700. 00000100:00100000:2.0:1746065080.731101:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1278 00000100:00100000:2.0:1746065080.731105:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261472384:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065080.731170:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x36f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.731173:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x36f:0x0] updating lvb mtime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.731174:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x36f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.731176:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x36f:0x0] updating lvb ctime from disk: 0 -> 1746065080 00002000:00010000:2.0:1746065080.731177:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x36f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.731192:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261472384:12345-192.168.202.27@tcp:10:bash.0 Request processed in 86us (1130us total) trans 17179872587 rc 0/0 00000100:00100000:2.0:1746065080.731197:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1278 00002000:00010000:2.0:1746065080.731198:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/879 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.731200:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009858f100 with x1830881261472384 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.731203:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009858f100. 00010000:00010000:2.0:1746065080.736037:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.737897:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.738044:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261472640 00000100:00100000:3.0:1746065080.738052:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261472640 00000100:00100000:3.0:1746065080.738087:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4236 00000100:00100000:3.0:1746065080.738095:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261472640:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:3.0:1746065080.739944:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261472640:12345-192.168.202.27@tcp:35:bash.0 Request processed in 1844us (2047us total) trans 4294975648 rc 0/0 00000100:00100000:3.0:1746065080.739952:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4236 00000100:00100000:0.0:1746065080.744918:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.745067:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261472896 00000100:00100000:2.0:1746065080.745075:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261472896 00000100:00100000:2.0:1746065080.745122:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12306 00000100:00100000:2.0:1746065080.745153:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27928:x1830881261472896:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.745172:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.745188:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630ec lrc: 2/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd54 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.745339:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.745350:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.745358:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.745367:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x349:0x0]: returning size 5 00010000:00010000:2.0:1746065080.745444:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14630ec lrc: 0/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.747478:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.747488:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065080.747491:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065080.747493:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:2.0:1746065080.748163:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27928:x1830881261472896:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3032us (3270us total) trans 4294975649 rc 0/0 00000100:00100000:2.0:1746065080.748171:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12306 00000100:00100000:2.0:1746065080.748445:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.749639:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261473152 00000100:00100000:3.0:1746065080.749647:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261473152 00000100:00100000:3.0:1746065080.749686:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12307 00000100:00100000:3.0:1746065080.749691:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27929:x1830881261473152:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065080.749726:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065080.749744:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14630a6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd31 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.749767:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc14630de lrc: 0/0,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd4d expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.749793:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ac00/0xad6b7ddc1463083 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd23 expref: 287 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.749800:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065080.749803:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.749820:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.749828:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.749834:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.749842:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.749845:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.749849:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.749909:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.749916:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.749920:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 4/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.749946:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.749955:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 286 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.749966:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262653184:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.750031:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.758051:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.758137:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261473280 00000100:00100000:2.0:1746065080.758145:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261473280 00010000:00010000:2.0:1746065080.758175:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 287 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.758201:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3651 00000100:00100000:2.0:1746065080.758208:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+287:2005:x1830881261473280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.758220:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.758225:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 287 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.758235:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 287 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.758251:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:2.0:1746065080.758256:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.758263:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.758268:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.758280:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.758324:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+287:2005:x1830881261473280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.758329:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3651 00010000:00010000:3.0:1746065080.758409:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14630f3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd54 expref: 286 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.758425:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262653184:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.758439:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758446:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758450:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065080.758869:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x349:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1746065080.758928:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758935:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758939:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758947:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.758950:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758955:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758963:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff88008ec47500) 00010000:00010000:3.0:1746065080.758965:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065080.758967:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758971:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc146310f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x349:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758986:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758990:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758994:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.758998:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.759001:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130112800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.759003:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.759007:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.759015:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561500) 00010000:00010000:3.0:1746065080.759017:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.759019:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.759022:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc1463101 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065080.759032:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a5dd500 reply state ffff880099707000 transno 4294975650 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.759039:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.759044:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.759045:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.759047:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065080.759080:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27929:x1830881261473152:12345-192.168.202.27@tcp:36:rm.0 Request processed in 9388us (10635us total) trans 4294975650 rc 0/0 00000100:00100000:3.0:1746065080.759086:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12307 00000100:00100000:0.0:1746065080.765627:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.766798:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261473408 00000100:00100000:3.0:1746065080.766807:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261473408 00000100:00100000:3.0:1746065080.766847:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12308 00000100:00100000:3.0:1746065080.766853:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27928:x1830881261473408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.766874:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.766890:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1463116 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd5b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.766946:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c800/0xad6b7ddc146311d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.766957:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c800/0xad6b7ddc146311d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.766966:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c800/0xad6b7ddc146311d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.766995:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x349:0x0]: returning size 5 00000004:00200000:3.0:1746065080.766999:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.767009:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c800/0xad6b7ddc146311d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.767025:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc1463116 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x349:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd5b expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.767037:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c800/0xad6b7ddc146311d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x349:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd5b expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.767043:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff880095561200) 00010000:00010000:3.0:1746065080.767045:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065080.767048:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c800, rc 0) 00000100:00100000:3.0:1746065080.767979:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27928:x1830881261473408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1121us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.767987:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12308 00000100:00100000:2.0:1746065080.776182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.776232:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.776321:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261473536 00000100:00100000:3.0:1746065080.776329:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261473536 00000100:00100000:0.0:1746065080.776467:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261473792 00000100:00100000:0.0:1746065080.776472:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261473792 00000100:00100000:0.0:1746065080.776499:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4237 00000100:00100000:0.0:1746065080.776506:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27928:x1830881261473792:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065080.776688:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x349:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065080.776790:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2455, 64 off203128 00000040:00080000:0.0:1746065080.776809:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2459, 64 off203560 00000040:00080000:0.0:1746065080.776816:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2460, 64 off203624 00000040:00080000:0.0:1746065080.776823:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2456, 64 off203192 00010000:00010000:0.0:1746065080.776860:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x349:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065080.776871:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.776885:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.776892:0:7206:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.776900:0:7206:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.776904:0:7206:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:0.0:1746065080.776916:0:7206:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065080.777049:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27928:x1830881261473792:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 542us (815us total) trans 4294975651 rc 0/0 00000100:00100000:0.0:1746065080.777055:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4237 00000100:00100000:3.0:1746065080.777256:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12309 00000100:00100000:3.0:1746065080.777263:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27930:x1830881261473536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.777272:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.777283:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc146312b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd62 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.777318:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.777325:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777332:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777339:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.777344:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777348:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777369:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777373:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.777375:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.777377:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777381:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.777381:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.777385:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.777388:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.777390:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.777393:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.777397:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.777398:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.777406:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561c00) 00010000:00010000:2.0:1746065080.777406:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x349:0x0].0x0 (ffff880095561200) 00010000:00010000:3.0:1746065080.777408:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.777408:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746065080.777411:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.777411:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065080.777415:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc1463132 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.777415:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463124 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x349:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065080.777434:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.777435:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.777436:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.777569:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777575:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777580:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777584:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.777586:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777590:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777597:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.777599:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.777601:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777605:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1463139 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.777624:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc146312b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd62 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.777630:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc146312b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd62 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.777640:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00000100:00100000:3.0:1746065080.778030:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27930:x1830881261473536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 767us (1854us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.778036:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12309 00000100:00100000:0.0:1746065080.782345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.782408:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261473920 00000100:00100000:3.0:1746065080.782416:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261473920 00000100:00100000:3.0:1746065080.782562:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12310 00000100:00100000:3.0:1746065080.782570:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27930:x1830881261473920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.782586:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.782602:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c600/0xad6b7ddc1463140 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd69 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.782648:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.782657:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782666:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782674:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.782682:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782687:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782716:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782721:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782726:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782732:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782736:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.782739:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782744:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782753:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065080.782755:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.782759:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782763:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463147 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782799:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782804:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782808:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782811:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.782813:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782817:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782822:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.782824:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.782826:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782829:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc146314e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.782848:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c600/0xad6b7ddc1463140 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd69 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.782854:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835c600/0xad6b7ddc1463140 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd69 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.782863:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c600, rc 0) 00000100:00100000:3.0:1746065080.784862:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27930:x1830881261473920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2286us (2517us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065080.784871:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12310 00000100:00100000:0.0:1746065080.788027:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.789674:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261474048 00000100:00100000:2.0:1746065080.789684:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261474048 00000100:00100000:2.0:1746065080.789728:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12311 00000100:00100000:2.0:1746065080.789735:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27928:x1830881261474048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.789759:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.789797:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06600/0xad6b7ddc1463155 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd70 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.789852:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.789862:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789870:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789878:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.789883:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789887:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789916:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789921:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789925:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789930:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789934:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.789936:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789941:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789949:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893000) 00010000:00010000:2.0:1746065080.789952:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.789955:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789959:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07000/0xad6b7ddc146315c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789985:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789990:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789994:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.789998:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.790000:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.790004:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.790009:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:2.0:1746065080.790011:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.790013:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.790016:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463163 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.790035:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06600/0xad6b7ddc1463155 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd70 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.790041:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06600/0xad6b7ddc1463155 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd70 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.790050:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06600, rc 0) 00000100:00100000:2.0:1746065080.790094:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27928:x1830881261474048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 359us (2074us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065080.790100:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12311 00000100:00100000:1.0:1746065080.790755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.792064:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261474176 00000100:00100000:2.0:1746065080.792071:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261474176 00000100:00100000:2.0:1746065080.792115:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12312 00000100:00100000:2.0:1746065080.792122:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27930:x1830881261474176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.792137:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.792152:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146316a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd77 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.792194:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1463171 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.792203:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1463171 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.792211:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1463171 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.792249:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065080.792254:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065080.792277:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146316a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd77 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.792287:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1463171 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd77 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.792297:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:2.0:1746065080.792299:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065080.792300:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8600, rc 0) 00000100:00100000:2.0:1746065080.792339:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27930:x1830881261474176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 217us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.792344:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12312 00000100:00100000:2.0:1746065080.795152:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.795217:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261474304 00000100:00100000:0.0:1746065080.795224:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261474304 00000100:00100000:0.0:1746065080.795259:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12313 00000100:00100000:0.0:1746065080.795266:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27930:x1830881261474304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.795280:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.795294:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1463178 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd7e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.795350:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.795363:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795371:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795379:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065080.795385:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795390:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795423:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795428:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795432:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795437:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795442:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.795445:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795450:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795459:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:0.0:1746065080.795462:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.795465:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795469:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc146317f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795480:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795486:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795490:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795494:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.795496:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795500:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795506:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:0.0:1746065080.795507:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.795509:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795513:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463186 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.795534:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1463178 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd7e expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.795541:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1463178 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd7e expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.795558:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:0.0:1746065080.795605:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27930:x1830881261474304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 339us (459us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065080.795612:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12313 00000100:00100000:0.0:1746065080.805431:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.806308:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261474560 00000100:00100000:2.0:1746065080.806316:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261474560 00000100:00100000:2.0:1746065080.806357:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12314 00000100:00100000:2.0:1746065080.806364:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27930:x1830881261474560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.806383:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.806385:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.806408:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1463171 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd77 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.807083:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:2.0:1746065080.807094:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.807104:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc146318d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd85 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.807175:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.807183:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807188:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807194:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.807197:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807200:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807412:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.807417:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807420:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.807425:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 0 00010000:00010000:2.0:1746065080.807438:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807441:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807445:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807448:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807451:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.807452:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807459:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807463:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008f379800) 00010000:00010000:2.0:1746065080.807464:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.807466:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807469:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1463194 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065080.807474:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009858fb80 reply state ffff88012f18a000 transno 4294975652 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807479:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.807481:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:2.0:1746065080.807482:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065080.807484:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065080.807496:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc146318d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.807506:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.807509:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893000) 00010000:00010000:2.0:1746065080.807510:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.807512:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:2.0:1746065080.807568:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27930:x1830881261474560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1203us (2143us total) trans 4294975652 rc 0/0 00000100:00100000:2.0:1746065080.807652:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12314 00000100:00100000:0.0:1746065080.810637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.810683:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.810765:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261474816 00000100:00100000:1.0:1746065080.810794:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261474816 00000100:00100000:1.0:1746065080.810826:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475072 00000100:00100000:1.0:1746065080.810828:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475072 00000100:00100000:1.0:1746065080.810846:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12315 00000100:00100000:1.0:1746065080.810852:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27930:x1830881261474816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.810869:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065080.810923:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12316 00000100:00100000:3.0:1746065080.810930:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27931:x1830881261475072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.810936:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.810947:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14631b0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd93 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.811021:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.811032:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.811040:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065080.811050:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 0 00010000:00010000:3.0:1746065080.811119:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14631b0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.811134:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.811139:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893000) 00010000:00010000:3.0:1746065080.811142:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.811144:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:3.0:1746065080.811175:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27931:x1830881261475072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 246us (492us total) trans 4294975653 rc 0/0 00000100:00100000:3.0:1746065080.811180:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12316 00010000:00010000:1.0:1746065080.811474:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc14631c5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd8c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.811513:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065080.811524:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.811530:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.811535:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 5/0,1 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.811566:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.811576:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 295 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.811586:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262653312:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.811637:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.811645:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 295 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.811652:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262653440:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.811668:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.814239:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.814305:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475200 00000100:00100000:0.0:1746065080.814312:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475200 00010000:00010000:0.0:1746065080.814339:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 296 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.814370:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3652 00000100:00100000:0.0:1746065080.814377:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261475200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.814386:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.814390:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 296 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.814399:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 296 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.814416:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893000) 00010000:00010000:0.0:1746065080.814421:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065080.814427:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065080.814457:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261475200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.814463:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3652 00000100:00100000:0.0:1746065080.817180:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.817368:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475328 00000100:00100000:2.0:1746065080.817375:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475328 00010000:00010000:2.0:1746065080.817400:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 296 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.817425:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3653 00000100:00100000:2.0:1746065080.817430:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2005:x1830881261475328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.817442:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.817447:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 296 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.817456:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 296 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.817473:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893000) 00010000:00010000:2.0:1746065080.817477:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.817483:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.817489:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.817503:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.817546:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2005:x1830881261475328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.817559:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3653 00010000:00010000:1.0:1746065080.817991:0:7205:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880076cf6680 x1830881262653312) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 295 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746065080.818006:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc14631b7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd93 expref: 295 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.818028:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262653312:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.818041:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631a2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd85 expref: 294 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.818050:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262653440:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.818065:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893000) 00010000:00010000:1.0:1746065080.818069:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818076:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818081:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065080.818101:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 0 00000004:00080000:1.0:1746065080.818228:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x371:0x0], index 1: 0 00000004:00080000:1.0:1746065080.818233:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x370:0x0], index 0: 0 00000004:00080000:1.0:1746065080.818236:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x371:0x0], index 0: 0 00000004:00080000:1.0:1746065080.818239:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x372:0x0], index 1: 0 00010000:00010000:1.0:1746065080.818310:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818316:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818322:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818326:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.818329:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818333:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818340:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893000) 00010000:00010000:1.0:1746065080.818342:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065080.818344:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818348:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc14631cc lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065080.818378:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc14631c5 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd8c expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.818383:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc14631c5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd8c expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.818393:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ba00, rc 0) 00000100:00100000:1.0:1746065080.818418:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27930:x1830881261474816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7566us (7787us total) trans 4294975654 rc 301/301 00000100:00100000:1.0:1746065080.818424:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12315 00000100:00100000:2.0:1746065080.818676:0:11456:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:11456:1830881262653568:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1746065080.818708:0:11456:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.818730:0:11456:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.818870:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262653568 00000100:00100000:1.0:1746065080.818873:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262653568 00000100:00100000:1.0:1746065080.820131:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8688 00000100:00100000:1.0:1746065080.820140:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+114:11456:x1830881262653568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1746065080.820173:0:1880:0:(ofd_dev.c:1633:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 898 00000100:00100000:1.0:1746065080.821271:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+115:11456:x1830881262653568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1131us (2559us total) trans 17179872588 rc 0/0 00000100:00100000:1.0:1746065080.821278:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8688 00000100:00100000:3.0:1746065080.821468:0:11456:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:11456:1830881262653568:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1746065080.821480:0:11456:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x372:0x0]-[0x2c0000400:0x3a1:0x0] 00000100:00100000:0.0:1746065080.830194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.830225:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.830296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.830316:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475840 00000100:00100000:0.0:1746065080.830322:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475840 00000100:00100000:0.0:1746065080.830353:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4238 00000100:00100000:0.0:1746065080.830359:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27930:x1830881261475840:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.830542:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27930:x1830881261475840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 182us (244us total) trans 4294975655 rc 0/0 00000100:00100000:0.0:1746065080.830562:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4238 00000100:00100000:0.0:1746065080.830634:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475584 00000100:00100000:0.0:1746065080.830637:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475584 00000100:00080000:0.0:1746065080.830652:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065080.830676:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 887 00000100:00100000:0.0:1746065080.830681:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261475584:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065080.830704:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261475584:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.830709:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 887 00000100:00100000:3.0:1746065080.830824:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475456 00000100:00100000:3.0:1746065080.830828:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475456 00000100:00100000:3.0:1746065080.830854:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 134 00000100:00100000:3.0:1746065080.830863:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+9:2005:x1830881261475456:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065080.830887:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+9:2005:x1830881261475456:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 23us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.830892:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 134 00000100:00100000:0.0:1746065080.836044:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.836619:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261475968 00000100:00100000:2.0:1746065080.836626:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261475968 00000100:00100000:2.0:1746065080.836664:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12317 00000100:00100000:2.0:1746065080.836670:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27931:x1830881261475968:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.836688:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.836705:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631da lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cd9a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.836806:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc14631e1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.836816:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc14631e1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.836824:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc14631e1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.837062:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 0 00000004:00200000:2.0:1746065080.837067:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065080.837079:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc14631e1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.837098:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631da lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd9a expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.838117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.838247:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261476224 00000100:00100000:0.0:1746065080.838252:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261476224 00000100:00100000:0.0:1746065080.838278:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4239 00000100:00100000:0.0:1746065080.838284:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27930:x1830881261476224:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065080.838403:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27930:x1830881261476224:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 118us (288us total) trans 4294975656 rc 0/0 00000100:00100000:0.0:1746065080.838409:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4239 00010000:00010000:2.0:1746065080.838633:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc14631e1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd9a expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.838647:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:2.0:1746065080.838649:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.838652:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9200, rc 0) 00000100:00100000:2.0:1746065080.838684:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27931:x1830881261475968:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2014us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.838689:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12317 00000100:00100000:1.0:1746065080.844007:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.844086:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.844126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.844806:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261476736 00000100:00100000:2.0:1746065080.844814:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261476736 00000100:00100000:2.0:1746065080.845832:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12318 00000100:00100000:2.0:1746065080.845841:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261476736:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.845861:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.845878:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc14631e8 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdaf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.845977:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.845988:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.845996:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846007:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.846012:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846017:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846055:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14631fd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065080.846061:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14631fd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846066:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14631fd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065080.846073:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 0 00010000:00010000:2.0:1746065080.846128:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846133:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846138:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846143:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846147:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.846150:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846155:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846162:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893c00) 00010000:00010000:2.0:1746065080.846164:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.846167:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846175:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14631ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846187:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846191:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846195:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846198:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.846200:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846204:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846208:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:2.0:1746065080.846210:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.846212:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846215:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14631f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065080.846239:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc14631e8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdaf expref: 299 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.846252:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14631fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdaf expref: 298 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.846261:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:2.0:1746065080.846263:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.846265:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:2.0:1746065080.846304:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261476736:12345-192.168.202.27@tcp:101:bash.0 Request processed in 464us (2217us total) trans 4294975657 rc 0/0 00000100:00100000:2.0:1746065080.846309:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12318 00000100:00100000:0.0:1746065080.846874:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261476352 00000100:00100000:0.0:1746065080.846880:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261476352 00000100:00100000:0.0:1746065080.846911:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261476480 00000100:00100000:0.0:1746065080.846914:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261476480 00000100:00100000:0.0:1746065080.846930:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8689 00000100:00100000:0.0:1746065080.846935:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881261476352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.846942:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.846951:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cda1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065080.846966:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065080.846977:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.846979:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.846985:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.846995:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.847002:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:0.0:1746065080.847022:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881261476352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 87us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.847026:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8689 00000100:00100000:0.0:1746065080.847036:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8690 00000100:00100000:0.0:1746065080.847041:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881261476480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.847046:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.847053:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cda8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065080.847063:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065080.847071:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.847072:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.847075:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 54 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.847083:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 54 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.847088:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:0.0:1746065080.847100:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881261476480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 60us (2974us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.847104:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8690 00000100:00100000:0.0:1746065080.848242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.848278:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.848336:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261476992 00000100:00100000:1.0:1746065080.848340:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261476992 00000100:00100000:1.0:1746065080.848374:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12319 00000100:00100000:1.0:1746065080.848379:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261476992:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065080.848391:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.848400:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3400/0xad6b7ddc1463219 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdb6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.848419:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc1463220 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.848428:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc1463220 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.848435:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc1463220 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.848509:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd3400/0xad6b7ddc1463219 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdb6 expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.848527:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc1463220 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdb6 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.848532:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065080.848535:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065080.848537:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2800, rc 0) 00000100:00100000:1.0:1746065080.848574:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:26180:x1830881261476992:12345-192.168.202.27@tcp:101:bash.0 Request processed in 194us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.848578:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12319 00000100:00100000:2.0:1746065080.848886:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261476864 00000100:00100000:2.0:1746065080.848890:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261476864 00000100:00100000:2.0:1746065080.849105:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 559 00000100:00100000:2.0:1746065080.849112:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+299:2004:x1830881261476864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.849120:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.849131:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07e00/0xad6b7ddc14631fd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdaf expref: 299 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.849140:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:2.0:1746065080.849142:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.849379:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+298:2004:x1830881261476864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 266us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.849385:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 559 00000100:00100000:0.0:1746065080.850770:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.850907:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.850948:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261477248 00000100:00100000:3.0:1746065080.850954:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261477248 00000100:00100000:3.0:1746065080.850981:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12320 00000100:00100000:3.0:1746065080.850986:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261477248:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065080.851019:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.851032:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9200/0xad6b7ddc14631e1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd9a expref: 298 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.851046:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065080.851049:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.851112:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261477504 00000100:00100000:1.0:1746065080.851116:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261477504 00000100:00100000:1.0:1746065080.851144:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4240 00000100:00100000:1.0:1746065080.851149:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+298:27931:x1830881261477504:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:3.0:1746065080.851282:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.851292:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.851310:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:3.0:1746065080.851337:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975659 00000004:00010000:3.0:1746065080.851351:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099bd0700 reply state ffff88008d93a000 transno 4294975660 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.851357:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.851362:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065080.851364:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.851366:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.851412:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+302:27931:x1830881261477504:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 261us (503us total) trans 4294975658 rc 0/0 00000100:00100000:1.0:1746065080.851418:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4240 00000100:00100000:3.0:1746065080.851485:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261477248:12345-192.168.202.27@tcp:36:bash.0 Request processed in 498us (716us total) trans 4294975660 rc 0/0 00000100:00100000:3.0:1746065080.851489:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12320 00000020:00080000:3.0:1746065080.851492:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065080.852762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.852801:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.852818:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261477632 00000100:00100000:3.0:1746065080.852856:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261477888 00000100:00100000:3.0:1746065080.852861:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261477888 00000100:00100000:3.0:1746065080.852892:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12321 00000100:00100000:3.0:1746065080.852898:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+301:27931:x1830881261477888:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065080.852918:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261477632 00000100:00100000:0.0:1746065080.852940:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12322 00000100:00100000:0.0:1746065080.852944:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261477632:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.852977:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.852989:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc146322e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdc4 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.853033:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.853040:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853047:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853053:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.853062:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853066:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853124:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880092a1e800/0xad6b7ddc1463243 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.853129:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880092a1e800/0xad6b7ddc1463243 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853133:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880092a1e800/0xad6b7ddc1463243 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065080.853139:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 0 00010000:00010000:3.0:1746065080.853176:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853181:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853186:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853190:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853194:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e4e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.853197:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853201:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853211:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561d00) 00010000:00010000:3.0:1746065080.853214:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.853216:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853220:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463235 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853228:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853232:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853236:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853239:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800907d4400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.853241:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853244:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853248:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.853250:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.853252:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853255:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146323c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.853274:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc146322e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdc4 expref: 305 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.853287:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880092a1e800/0xad6b7ddc1463243 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdc4 expref: 304 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.853291:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065080.853293:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.853295:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a1e800, rc 0) 00010000:00010000:0.0:1746065080.853361:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.853368:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463251 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdbd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.853386:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463251 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdbd expref: 305 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.853396:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463251 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdbd expref: 305 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.853405:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:0.0:1746065080.853407:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065080.853409:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538600, rc 0) 00000100:00100000:3.0:1746065080.853561:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+305:27931:x1830881261477888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 661us (759us total) trans 4294975661 rc 0/0 00000100:00100000:3.0:1746065080.853566:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12321 00000100:00100000:0.0:1746065080.853571:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261477632:12345-192.168.202.27@tcp:101:bash.0 Request processed in 626us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.853575:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12322 00000100:00100000:0.0:1746065080.855938:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.856092:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261478144 00000100:00100000:1.0:1746065080.856099:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261478144 00000100:00100000:1.0:1746065080.856133:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4241 00000100:00100000:1.0:1746065080.856139:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+304:27931:x1830881261478144:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.856290:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+305:27931:x1830881261478144:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 149us (357us total) trans 4294975662 rc 0/0 00000100:00100000:1.0:1746065080.856296:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4241 00000100:00100000:1.0:1746065080.857240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.857300:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261478400 00000100:00100000:0.0:1746065080.857304:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261478400 00000100:00100000:0.0:1746065080.857342:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12323 00000100:00100000:0.0:1746065080.857348:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261478400:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.857360:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.857363:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746065080.857387:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c538600/0xad6b7ddc1463251 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdbd expref: 305 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.857414:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880092a1e800/0xad6b7ddc1463243 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdc4 expref: 304 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.857423:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:0.0:1746065080.857426:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065080.857434:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463258 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdcb expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.857469:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146325f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065080.857478:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146325f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.857486:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146325f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:0.0:1746065080.857636:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2461, 88 off203712 00000004:00080000:0.0:1746065080.857642:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676875867878ns, next at 677717559249ns, rc = 0 00000040:00080000:0.0:1746065080.857675:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2457, 88 off203280 00000004:00080000:0.0:1746065080.857679:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676875905163ns, next at 677717578181ns, rc = 0 00000040:00080000:0.0:1746065080.857690:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2458, 88 off203368 00000004:00080000:0.0:1746065080.857693:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676875919517ns, next at 677717578181ns, rc = 0 00000040:00080000:0.0:1746065080.857701:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2462, 88 off203800 00000004:00080000:0.0:1746065080.857703:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676875929487ns, next at 677717559249ns, rc = 0 00000100:00100000:0.0:1746065080.858666:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.858725:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261478656 00000100:00100000:3.0:1746065080.858729:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261478656 00000100:00100000:3.0:1746065080.858767:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12324 00000100:00100000:3.0:1746065080.858796:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+306:27931:x1830881261478656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.858810:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.858822:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1463266 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdd2 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.858872:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.858880:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.858887:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.858895:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.858904:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.858909:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.858963:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.858968:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.858973:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065080.858979:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 2 00010000:00010000:3.0:1746065080.859015:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859020:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859025:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859029:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.859032:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859037:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859045:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065080.859047:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746065080.859050:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859054:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136166400/0xad6b7ddc146327b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859065:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859069:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859073:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859077:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859080:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa8ea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.859081:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859084:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859089:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561500) 00010000:00010000:3.0:1746065080.859090:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.859092:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859095:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146326d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859100:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859104:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859108:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859111:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.859113:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859117:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859122:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.859129:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.859131:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859135:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc1463274 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.859158:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1463266 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd2 expref: 308 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.859165:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47000/0xad6b7ddc1463266 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd2 expref: 308 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.859176:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:3.0:1746065080.859207:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+307:27931:x1830881261478656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 434us (548us total) trans 4294975664 rc 301/301 00000100:00100000:3.0:1746065080.859212:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12324 00000100:00100000:0.0:1746065080.861994:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.862073:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261478912 00000100:00100000:1.0:1746065080.862080:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261478912 00000100:00100000:1.0:1746065080.862116:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4242 00000100:00100000:1.0:1746065080.862123:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+307:27931:x1830881261478912:12345-192.168.202.27@tcp:35:lfs.0 00000001:00080000:2.0:1746065080.863008:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975663 is committed 00000004:00080000:2.0:1746065080.863015:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1662 committed 00000004:00080000:2.0:1746065080.863022:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1652 committed 00000004:00080000:2.0:1746065080.863027:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1651 committed 00000004:00080000:2.0:1746065080.863028:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1661 committed 00000004:00080000:2.0:1746065080.863052:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1650 committed 00000004:00080000:2.0:1746065080.863054:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1660 committed 00010000:00010000:0.0:1746065080.863136:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146325f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdcb expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.863146:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:0.0:1746065080.863148:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065080.863159:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc1463258 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdcb expref: 290 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065080.863171:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146325f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdcb expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863178:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863186:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863190:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.863192:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:0.0:1746065080.863194:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065080.863195:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.863195:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3800, rc 0) 00010000:00010000:3.0:1746065080.863198:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863203:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065080.863208:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27931:x1830881261478912:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1085us (1219us total) trans 4294975665 rc 0/0 00010000:00010000:3.0:1746065080.863211:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.863213:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.863216:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065080.863216:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4242 00000100:00100000:0.0:1746065080.863216:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261478400:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5868us (5978us total) trans 4294975663 rc 0/0 00010000:00010000:3.0:1746065080.863220:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463108 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.863222:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12323 00010000:00010000:3.0:1746065080.863229:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863233:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863237:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863240:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.863242:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863246:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863251:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561600) 00010000:00010000:3.0:1746065080.863253:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.863255:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863259:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc146319b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.863271:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.863275:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.863279:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.863282:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.863284:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065080.863311:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262653696:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.863341:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.863352:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262653824:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.863373:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262654208:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.863375:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.863390:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.863392:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262654336:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.863404:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.863410:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262653952:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.863422:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262654080:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.863426:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.863435:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065080.863453:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065080.863458:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262653696 00000100:00100000:2.0:1746065080.863461:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262653696 00010000:00010000:3.0:1746065080.863462:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:3.0:1746065080.863463:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.863466:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.863473:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d46a00/0xad6b7ddc1463227 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065080.863492:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262653824 00000100:00100000:2.0:1746065080.863495:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262653824 00000100:00100000:2.0:1746065080.863505:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654208 00000100:00100000:2.0:1746065080.863507:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654208 00000100:00100000:1.0:1746065080.863512:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654336 00000100:00100000:2.0:1746065080.863516:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262653952 00000100:00100000:1.0:1746065080.863516:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654336 00000100:00100000:2.0:1746065080.863518:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262653952 00000100:00100000:2.0:1746065080.863526:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654080 00000100:00100000:2.0:1746065080.863527:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654080 00000100:00100000:1.0:1746065080.863535:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8691 00000100:00100000:1.0:1746065080.863540:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+120:3761:x1830881262653696:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.863543:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8692 00000100:00100000:2.0:1746065080.863556:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+120:3762:x1830881262653824:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.863562:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8693 00002000:00080000:1.0:1746065080.863564:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:877 count 1 00002000:00080000:2.0:1746065080.863566:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:878 count 1 00000100:00100000:3.0:1746065080.863568:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+120:3761:x1830881262654208:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065080.863578:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.863581:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.863586:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.863591:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 53 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.863593:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.863595:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.863596:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.863597:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.863598:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.863599:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.863607:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.863614:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.863616:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 53 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.863620:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.863626:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 53 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.863632:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065080.863634:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262655232:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.863641:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+121:3761:x1830881262654208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 74us (251us total) trans 17179872589 rc 0/0 00000100:00100000:3.0:1746065080.863646:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8693 00000100:00100000:3.0:1746065080.863656:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8694 00000100:00100000:3.0:1746065080.863660:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+120:3759:x1830881262653952:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.863662:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00002000:00080000:3.0:1746065080.863669:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:879 count 1 00000100:00100000:1.0:1746065080.863673:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8695 00000100:00100000:1.0:1746065080.863677:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+121:3762:x1830881262654336:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065080.863678:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863687:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 53 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863692:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.863693:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.863694:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863708:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 53 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863715:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 53 pid: 11461 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746065080.863717:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x372:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.863719:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x372:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.863721:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x372:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.863723:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x372:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.863725:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x372:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.863727:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262655360:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.863745:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.863746:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+122:3762:x1830881262654336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 69us (341us total) trans 17179872591 rc 0/0 00000100:00100000:1.0:1746065080.863752:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8695 00000100:00100000:2.0:1746065080.863753:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+122:3762:x1830881262653824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 204us (376us total) trans 17179872590 rc 0/0 00000100:00100000:3.0:1746065080.863757:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8696 00000100:00100000:2.0:1746065080.863760:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8692 00000100:00100000:3.0:1746065080.863761:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+121:3760:x1830881262654080:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.863767:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262654464:0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065080.863770:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:880 count 1 00002000:00010000:3.0:1746065080.863795:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1746065080.863798:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262654592:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.863799:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.863800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065080.863805:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.863807:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.863809:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.863812:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262654976:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.863816:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863822:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.863824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065080.863828:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863837:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065080.863839:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654464 00000100:00100000:1.0:1746065080.863842:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654464 00000100:00100000:1.0:1746065080.863854:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654976 00000100:00100000:1.0:1746065080.863856:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654976 00000100:00100000:1.0:1746065080.863865:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8697 00000100:00100000:1.0:1746065080.863869:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+82:3759:x1830881262654464:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065080.863878:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:876 count 1 00010000:00010000:1.0:1746065080.863889:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.863898:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 41 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.863903:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065080.863904:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065080.863906:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.863919:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+121:3760:x1830881262654080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 157us (482us total) trans 17179872592 rc 0/0 00010000:00010000:1.0:1746065080.863919:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 41 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.863920:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8698 00000100:00100000:0.0:1746065080.863926:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+82:3759:x1830881262654976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.863927:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8696 00010000:00010000:1.0:1746065080.863927:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 41 pid: 12258 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.863935:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262655488:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.863938:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065080.863942:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863948:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.863950:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.863955:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00010000:00010000:3.0:1746065080.863956:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863965:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863971:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463289 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863982:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.863984:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863989:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.863992:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.863997:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.864004:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.864009:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136167600/0xad6b7ddc146329e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.864017:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.864018:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.864020:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065080.864028:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262654720:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.864984:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+83:3759:x1830881262654976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1053us (1153us total) trans 21474839866 rc 0/0 00000100:00100000:0.0:1746065080.864991:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8698 00010000:00010000:0.0:1746065080.865009:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065080.865761:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065080.865797:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654720 00000100:00100000:0.0:1746065080.865803:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654720 00000004:00080000:3.0:1746065080.865816:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d17b80/2, rc 0, transno 17179872589 00000100:00100000:3.0:1746065080.865821:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262654208:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.865828:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8699 00000100:00100000:3.0:1746065080.865830:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065080.865833:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+83:3761:x1830881262654720:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.865836:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262654848:0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065080.865850:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:878 count 1 00000100:00100000:3.0:1746065080.865855:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065080.865864:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.865877:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.865883:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065080.865884:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065080.865886:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.865907:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.865916:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 41 pid: 11461 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.865924:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262655616:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.866466:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.866477:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654848 00000100:00100000:0.0:1746065080.866480:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654848 00000100:00100000:0.0:1746065080.866497:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8700 00000004:00080000:1.0:1746065080.866574:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf3b80/2, rc 0, transno 21474839866 00000100:00100000:1.0:1746065080.866579:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262654976:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.866587:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.866609:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654592 00000100:00100000:1.0:1746065080.866613:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654592 00000100:00100000:2.0:1746065080.866617:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262655104:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.866641:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065080.866671:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8700/2, rc 0, transno 17179872592 00000100:00100000:2.0:1746065080.866674:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262654080:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065080.866696:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8701 00000100:00100000:1.0:1746065080.866696:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262655104 00000100:00100000:1.0:1746065080.866698:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262655104 00000100:00100000:0.0:1746065080.866698:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+85:3761:x1830881262654848:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065080.866702:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+86:3760:x1830881262654592:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.866706:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8702 00000100:00100000:1.0:1746065080.866710:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+86:3760:x1830881262655104:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:0.0:1746065080.866710:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:879 count 1 00002000:00080000:3.0:1746065080.866712:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:877 count 1 00002000:00010000:3.0:1746065080.866725:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1746065080.866726:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065080.866730:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.866730:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866737:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.866737:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.866738:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.866738:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.866742:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.866742:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866751:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.866751:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866757:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.866757:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866762:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.866764:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866787:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1746065080.866792:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1746065080.866809:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x371:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.866812:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x371:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.866813:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x371:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.866815:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x371:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.866816:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x371:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065080.866837:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+89:3760:x1830881262655104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 126us (197us total) trans 21474839867 rc 0/0 00000100:00100000:1.0:1746065080.866842:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8702 00000100:00100000:3.0:1746065080.866903:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+88:3760:x1830881262654592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 201us (315us total) trans 21474839868 rc 0/0 00000100:00100000:3.0:1746065080.866907:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8701 00010000:00010000:3.0:1746065080.866918:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065080.866922:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866927:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.866930:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866937:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866948:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866954:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc14632ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.866957:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+87:3761:x1830881262654848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 260us (1100us total) trans 21474839869 rc 0/0 00000100:00100000:0.0:1746065080.866963:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8700 00010000:00010000:3.0:1746065080.866964:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.866966:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866971:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.866973:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866979:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866986:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866991:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14632b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.866999:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.867000:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.867002:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.867006:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065080.867020:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf0380/2, rc 0, transno 21474839869 00000100:00100000:3.0:1746065080.867024:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262654848:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.867034:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.867042:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262655360:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.867050:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479040 00000100:00100000:0.0:1746065080.867053:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479040 00010000:00010000:3.0:1746065080.867054:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867068:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 54 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746065080.867085:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3654 00000100:00100000:0.0:1746065080.867090:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261479040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.867097:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.867101:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 54 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746065080.867109:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 54 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746065080.867121:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867122:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867125:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867135:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867144:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065080.867163:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261479040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.867168:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3654 00000100:00100000:0.0:1746065080.867191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.867199:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479168 00000100:00100000:0.0:1746065080.867202:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479168 00010000:00010000:0.0:1746065080.867211:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 54 pid: 11461 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.867238:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3655 00000100:00100000:0.0:1746065080.867243:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261479168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.867251:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.867255:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 54 pid: 11461 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.867263:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 54 pid: 11461 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.867273:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f0bbc00/0xad6b7ddc14630c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd46 expref: 54 pid: 11461 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.867281:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867283:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867285:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867291:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867301:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065080.867315:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261479168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.867319:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3655 00000100:00100000:0.0:1746065080.867351:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.867362:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479296 00000100:00100000:0.0:1746065080.867364:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479296 00010000:00010000:0.0:1746065080.867374:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 42 pid: 12258 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.867385:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3656 00000100:00100000:0.0:1746065080.867389:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261479296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065080.867394:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065080.867396:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 42 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.867403:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 42 pid: 12258 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746065080.867412:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867413:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867416:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867421:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867429:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065080.867442:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261479296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.867447:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3656 00000100:00100000:0.0:1746065080.867475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.867485:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479424 00010000:00010000:1.0:1746065080.867488:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc1462f09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ccac expref: 41 pid: 12258 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.867488:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479424 00000100:00100000:1.0:1746065080.867499:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262655488:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.867500:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8703 00000100:00100000:0.0:1746065080.867504:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+53:26180:x1830881261479424:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065080.867508:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867513:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.867514:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867520:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867521:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdd9 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867525:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867531:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065080.867533:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065080.867541:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.867543:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.867555:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065080.867562:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 54 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867570:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 54 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867577:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00010000:00010000:0.0:1746065080.867585:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065080.867588:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867593:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065080.867596:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867602:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867610:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867615:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc14632a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.867627:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.867628:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065080.867630:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.867643:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+87:3759:x1830881262654464:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3773us (3841us total) trans 21474839870 rc 0/0 00000100:00100000:0.0:1746065080.867645:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+54:26180:x1830881261479424:12345-192.168.202.27@tcp:101:bash.0 Request processed in 139us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.867649:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8697 00010000:00010000:1.0:1746065080.867672:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc1463044 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd15 expref: 54 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746065080.867679:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262655232:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.867688:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867693:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867698:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867704:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867708:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.867721:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065080.867876:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+121:3761:x1830881262653696:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4336us (4534us total) trans 17179872593 rc 0/0 00000004:00080000:2.0:1746065080.867985:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f57480/2, rc 0, transno 21474839868 00000100:00100000:2.0:1746065080.867989:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262654592:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065080.867996:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf1880/2, rc 0, transno 21474839867 00000100:00100000:2.0:1746065080.867998:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262655104:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065080.868021:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aeca680/2, rc 0, transno 17179872590 00000100:00100000:2.0:1746065080.868023:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262653824:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.868030:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d17100/2, rc 0, transno 17179872591 00000100:00100000:2.0:1746065080.868032:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262654336:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065080.868536:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.868544:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.868559:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.868565:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.868626:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065080.868636:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8703 00000100:00100000:0.0:1746065080.868693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.868710:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479552 00000100:00100000:3.0:1746065080.868712:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+122:3759:x1830881262653952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5050us (5284us total) trans 17179872594 rc 0/0 00000100:00100000:0.0:1746065080.868714:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479552 00000100:00100000:3.0:1746065080.868718:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8694 00000100:00100000:0.0:1746065080.868733:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4243 00000100:00100000:0.0:1746065080.868738:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27931:x1830881261479552:12345-192.168.202.27@tcp:33:lfs.0 00000004:00080000:3.0:1746065080.868743:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf5f80/2, rc 0, transno 17179872593 00000100:00100000:3.0:1746065080.868746:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262653696:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065080.868797:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1746065080.868801:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868806:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ba00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.868809:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868815:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868824:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868829:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc1463290 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.868840:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27931:x1830881261479552:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 102us (147us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065080.868841:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.868844:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.868845:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4243 00010000:00010000:2.0:1746065080.868848:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.868851:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868855:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868866:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868871:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136167200/0xad6b7ddc1463297 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.868879:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.868880:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.868882:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.869561:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8691 00010000:00010000:1.0:1746065080.869577:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065080.869597:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f56300/2, rc 0, transno 21474839870 00000100:00100000:1.0:1746065080.869600:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262654464:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065080.869608:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecb100/2, rc 0, transno 17179872594 00000100:00100000:1.0:1746065080.869611:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262653952:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.871479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.871486:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262655616:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065080.871503:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.871554:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.871577:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479680 00000100:00100000:3.0:1746065080.871583:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479680 00000100:00100000:1.0:1746065080.871591:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479808 00000100:00100000:1.0:1746065080.871595:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479808 00010000:00010000:3.0:1746065080.871606:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 42 pid: 11461 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.871617:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8704 00000100:00100000:1.0:1746065080.871623:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:26180:x1830881261479808:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065080.871634:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.871646:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cde0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065080.871662:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065080.871677:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.871679:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.871684:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.871696:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.871707:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:1.0:1746065080.871733:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+43:26180:x1830881261479808:12345-192.168.202.27@tcp:101:bash.0 Request processed in 109us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.871738:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8704 00000100:00100000:3.0:1746065080.871810:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3657 00000100:00100000:3.0:1746065080.871815:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261479680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.871822:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.871826:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 42 pid: 11461 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.871835:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 42 pid: 11461 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.871847:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996be400/0xad6b7ddc14630bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cd3f expref: 42 pid: 11461 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.871856:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.871858:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.871988:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.871997:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.872021:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.872040:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261479680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 224us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.872045:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3657 00010000:00010000:1.0:1746065080.872217:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.872224:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.872232:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.872238:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.872257:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065080.872277:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.872282:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.872287:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.872294:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.872300:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.872308:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.872313:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14632ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.872330:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.872331:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.872332:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.872404:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+87:3761:x1830881262654720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6570us (6643us total) trans 21474839871 rc 0/0 00000100:00100000:1.0:1746065080.872410:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8699 00000004:00080000:3.0:1746065080.872660:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54000/2, rc 0, transno 21474839871 00000100:00100000:3.0:1746065080.872665:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262654720:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.874727:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.874844:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.874900:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261479936 00000100:00100000:2.0:1746065080.874908:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261479936 00002000:00010000:2.0:1746065080.874936:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/881 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.874939:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd1880 with x1830881261479936 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.874948:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd1880. 00000100:00100000:2.0:1746065080.874961:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261480064 00000100:00100000:2.0:1746065080.874963:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261480064 00002000:00010000:2.0:1746065080.874970:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/880 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.874972:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131898380 with x1830881261480064 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.874976:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131898380. 00000100:00100000:2.0:1746065080.874985:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1279 00000100:00100000:2.0:1746065080.874991:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261479936:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:3.0:1746065080.875097:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1280 00000100:00100000:3.0:1746065080.875105:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261480064:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065080.875120:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x371:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.875122:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x371:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065080.875124:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x371:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.875126:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x371:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065080.875128:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x371:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.875161:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261479936:12345-192.168.202.27@tcp:10:bash.0 Request processed in 169us (439us total) trans 17179872595 rc 0/0 00000100:00100000:2.0:1746065080.875167:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1279 00002000:00010000:2.0:1746065080.875169:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/881 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.875171:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd1880 with x1830881261479936 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.875175:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd1880. 00002000:00010000:3.0:1746065080.875183:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x370:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065080.875185:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x370:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065080.875187:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x370:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065080.875188:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x370:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065080.875190:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x370:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065080.875208:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881261480064:12345-192.168.202.27@tcp:10:bash.0 Request processed in 105us (365us total) trans 21474839872 rc 0/0 00000100:00100000:3.0:1746065080.875214:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1280 00002000:00010000:3.0:1746065080.875216:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/880 (0->18446744073709551615) 00002000:00100000:3.0:1746065080.875218:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131898380 with x1830881261480064 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065080.875222:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131898380. 00000100:00100000:0.0:1746065080.879992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.880046:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261480320 00000100:00100000:2.0:1746065080.880054:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261480320 00000100:00100000:2.0:1746065080.880101:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4244 00000100:00100000:2.0:1746065080.880107:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261480320:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065080.880305:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261480320:12345-192.168.202.27@tcp:35:bash.0 Request processed in 196us (318us total) trans 4294975666 rc 0/0 00000100:00100000:2.0:1746065080.880311:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4244 00000100:00100000:0.0:1746065080.889644:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.889708:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261480576 00000100:00100000:2.0:1746065080.889716:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261480576 00000100:00100000:2.0:1746065080.889771:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12325 00000100:00100000:2.0:1746065080.889797:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27932:x1830881261480576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.889817:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.889833:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc800/0xad6b7ddc14632cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cde7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.889894:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.889904:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.889913:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.889923:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.889928:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.889937:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890007:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14632e4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.890014:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14632e4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890019:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14632e4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.890027:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34b:0x0]: returning size 5 00010000:00010000:2.0:1746065080.890079:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890084:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890089:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890094:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890098:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.890102:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890107:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890115:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f893000) 00010000:00010000:2.0:1746065080.890117:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.890121:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890126:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14632d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890151:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890156:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890160:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890163:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dda00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.890165:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890168:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890173:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f893c00) 00010000:00010000:2.0:1746065080.890176:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.890177:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890181:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14632dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.890211:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc800/0xad6b7ddc14632cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde7 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.890222:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14632e4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde7 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.890228:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:2.0:1746065080.890229:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065080.890231:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dca00, rc 0) 00000100:00100000:2.0:1746065080.890283:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27932:x1830881261480576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 486us (646us total) trans 4294975667 rc 0/0 00000100:00100000:2.0:1746065080.890289:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12325 00000100:00100000:0.0:1746065080.896264:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.896972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.897001:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261481088 00000100:00100000:1.0:1746065080.897011:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261481088 00000100:00100000:2.0:1746065080.897036:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261480832 00000100:00100000:2.0:1746065080.897040:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261480832 00000100:00100000:2.0:1746065080.897061:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4245 00000100:00100000:1.0:1746065080.897062:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12326 00000100:00100000:2.0:1746065080.897067:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27932:x1830881261480832:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065080.897068:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27933:x1830881261481088:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:1.0:1746065080.897108:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065080.897129:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146325f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdcb expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.897152:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14632e4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde7 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.897163:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc1463220 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdb6 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.897171:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff88012f893e00) 00010000:00010000:1.0:1746065080.897179:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.897195:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.897204:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897212:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897220:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.897226:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897230:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065080.897239:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27932:x1830881261480832:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 171us (981us total) trans 4294975668 rc 0/0 00000100:00100000:2.0:1746065080.897245:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4245 00010000:00010000:1.0:1746065080.897289:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.897295:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897300:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:1.0:1746065080.897556:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2463, 64 off203864 00000040:00080000:1.0:1746065080.897579:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2459, 64 off203432 00000040:00080000:1.0:1746065080.897588:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2460, 64 off203496 00000040:00080000:1.0:1746065080.897596:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2464, 64 off203928 00010000:00010000:1.0:1746065080.897623:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.897630:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897636:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897641:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897646:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897651:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897662:0:7231:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065080.897673:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897678:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897684:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897692:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.897695:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897701:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897708:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:1.0:1746065080.897711:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746065080.897713:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897717:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463300 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897814:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897819:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897823:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897827:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897831:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.897833:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897837:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897847:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b7e52600) 00010000:00010000:1.0:1746065080.897848:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.897850:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897854:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14632f2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065080.897863:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880131899880 reply state ffff8800997f4000 transno 4294975669 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897870:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.897874:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:1.0:1746065080.897876:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.897878:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.897907:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27933:x1830881261481088:12345-192.168.202.27@tcp:36:rm.0 Request processed in 839us (936us total) trans 4294975669 rc 0/0 00000100:00100000:1.0:1746065080.897913:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12326 00010000:00010000:2.0:1746065080.898627:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.898632:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.898637:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.898640:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.898645:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.898653:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34b:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:2.0:1746065080.898655:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065080.898658:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.898662:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463307 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x34b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.898674:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.898675:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.898677:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065080.902808:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.902995:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261481216 00000100:00100000:1.0:1746065080.903003:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261481216 00000100:00100000:1.0:1746065080.903040:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12327 00000100:00100000:1.0:1746065080.903046:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27932:x1830881261481216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.903063:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.903080:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc146330e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdee expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.903126:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.903139:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903147:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903154:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.903159:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903163:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903195:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903199:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903203:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903208:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903212:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.903215:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903220:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903228:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4e2800) 00010000:00010000:1.0:1746065080.903231:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.903233:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903238:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131046800/0xad6b7ddc1463315 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903245:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903249:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903254:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903257:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f70be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.903259:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903262:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903267:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:1.0:1746065080.903269:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.903270:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903274:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146331c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.903293:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc146330e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdee expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.903303:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489800/0xad6b7ddc146330e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdee expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.903313:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:1.0:1746065080.903354:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27932:x1830881261481216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 308us (588us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.903359:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12327 00000100:00100000:0.0:1746065080.908504:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.908613:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261481344 00000100:00100000:1.0:1746065080.908622:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261481344 00000100:00100000:1.0:1746065080.908907:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12328 00000100:00100000:1.0:1746065080.908915:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27934:x1830881261481344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.908932:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.908947:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463323 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdf5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.908997:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.909007:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909016:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909024:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.909029:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909038:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909066:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909071:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909076:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909081:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909085:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.909088:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909093:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909102:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4e2900) 00010000:00010000:1.0:1746065080.909104:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.909107:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909112:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc146332a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909393:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909397:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909402:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909406:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.909408:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909412:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909418:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:1.0:1746065080.909421:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.909423:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909427:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488200/0xad6b7ddc1463331 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.909448:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463323 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdf5 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.909455:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463323 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdf5 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.909465:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488e00, rc 0) 00000100:00100000:1.0:1746065080.909562:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27934:x1830881261481344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 647us (1064us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.909568:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12328 00000100:00100000:0.0:1746065080.912277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.912339:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261481472 00000100:00100000:1.0:1746065080.912345:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261481472 00000100:00100000:1.0:1746065080.912382:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12329 00000100:00100000:1.0:1746065080.912389:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27934:x1830881261481472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.912403:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.912418:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463338 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cdfc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.912459:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.912467:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912475:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912482:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.912486:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912491:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912513:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912518:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912522:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912527:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912532:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.912535:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912540:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912556:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:1.0:1746065080.912559:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.912562:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912566:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683ba00/0xad6b7ddc146333f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912574:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912579:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912583:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912586:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.912588:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912592:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912597:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:1.0:1746065080.912599:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.912601:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912605:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013683a400/0xad6b7ddc1463346 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.912621:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463338 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdfc expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.912627:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463338 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdfc expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.912637:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489600, rc 0) 00000100:00100000:1.0:1746065080.912667:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27934:x1830881261481472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 279us (394us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.912673:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12329 00000100:00100000:0.0:1746065080.914172:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.914250:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261481600 00000100:00100000:1.0:1746065080.914255:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261481600 00000100:00100000:1.0:1746065080.914287:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12330 00000100:00100000:1.0:1746065080.914293:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27934:x1830881261481600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.914560:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.914573:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146334d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce03 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.914609:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463354 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.914618:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.914625:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463354 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065080.914659:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065080.914662:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065080.914683:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146334d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce03 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.914695:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463354 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce03 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.914702:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b48d2700) 00010000:00010000:1.0:1746065080.914705:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065080.914707:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:1.0:1746065080.914745:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27934:x1830881261481600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 453us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.914751:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12330 00000100:00100000:0.0:1746065080.915487:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.915521:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261481856 00000100:00100000:1.0:1746065080.915525:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261481856 00000100:00100000:1.0:1746065080.915666:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12331 00000100:00100000:1.0:1746065080.915672:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27935:x1830881261481856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.915680:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.915689:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc146335b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce0a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.915724:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.915731:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915737:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915744:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.915750:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915755:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915806:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915812:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915816:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915821:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915825:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552f000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.915828:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915833:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915840:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b48d2700) 00010000:00010000:1.0:1746065080.915842:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.915845:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915849:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f000/0xad6b7ddc1463362 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915859:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915863:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915867:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915871:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552ee00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.915873:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915877:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915881:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:1.0:1746065080.915883:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065080.915885:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915888:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ee00/0xad6b7ddc1463369 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.915904:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc146335b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce0a expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.915910:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc146335b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce0a expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.915916:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f600, rc 0) 00000100:00100000:1.0:1746065080.915942:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27935:x1830881261481856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 270us (456us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065080.915948:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12331 00000100:00100000:0.0:1746065080.919235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.919406:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261482112 00000100:00100000:3.0:1746065080.919414:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261482112 00000100:00100000:3.0:1746065080.919462:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12332 00000100:00100000:3.0:1746065080.919469:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27934:x1830881261482112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.919486:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.919489:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065080.919508:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb0400/0xad6b7ddc1463354 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce03 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.919532:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b48d2700) 00010000:00010000:3.0:1746065080.919542:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.919559:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc1463370 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce11 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.919633:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.919642:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919648:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919654:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.919659:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919664:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919916:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065080.919922:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919927:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065080.919933:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 0 00010000:00010000:3.0:1746065080.919951:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919956:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919965:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919970:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919975:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.919978:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919983:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919989:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561100) 00010000:00010000:3.0:1746065080.919991:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.919993:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.919998:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167600/0xad6b7ddc1463377 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065080.920005:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098663100 reply state ffff880091170000 transno 4294975670 ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.920011:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.920016:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:3.0:1746065080.920018:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065080.920020:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065080.920034:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167c00/0xad6b7ddc1463370 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.920049:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.920055:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561600) 00010000:00010000:3.0:1746065080.920056:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065080.920058:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa8ea00, rc 0) 00000100:00100000:3.0:1746065080.920097:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27934:x1830881261482112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 629us (869us total) trans 4294975670 rc 0/0 00000100:00100000:3.0:1746065080.920103:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12332 00000100:00100000:0.0:1746065080.922667:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.922897:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261482368 00000100:00100000:1.0:1746065080.922903:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261482368 00000100:00100000:1.0:1746065080.922940:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12333 00000100:00100000:1.0:1746065080.922946:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27934:x1830881261482368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065080.922963:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.922975:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc1463393 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce18 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.923041:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.923051:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.923057:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 4/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.923080:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.923089:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 292 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746065080.923098:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262655744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065080.923323:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.924519:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262655744:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065080.924534:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.925089:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.925132:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261482496 00000100:00100000:3.0:1746065080.925137:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261482496 00010000:00010000:3.0:1746065080.925160:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 293 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.925517:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3658 00000100:00100000:3.0:1746065080.925524:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+293:2004:x1830881261482496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.925534:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.925538:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 293 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.925558:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 293 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.925574:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463385 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce11 expref: 293 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.925584:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561600) 00010000:00010000:3.0:1746065080.925589:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.925596:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.925601:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.925620:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065080.925650:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+292:2004:x1830881261482496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 127us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.925655:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3658 00010000:00010000:1.0:1746065080.925699:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.925705:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065080.925720:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 0 00000100:00100000:1.0:1746065080.925826:0:10212:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d16d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262655872:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1746065080.925852:0:10212:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.925866:0:10212:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065080.925875:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262655872 00000100:00100000:1.0:1746065080.925878:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262655872 00000100:00100000:1.0:1746065080.925895:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8705 00000100:00100000:1.0:1746065080.925900:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+87:10212:x1830881262655872:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1746065080.925924:0:12260:0:(ofd_dev.c:1633:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 898 00000100:00100000:1.0:1746065080.926872:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+88:10212:x1830881262655872:12345-0@lo:5:osp-pre-0-1.0 Request processed in 971us (1018us total) trans 21474839873 rc 0/0 00000100:00100000:1.0:1746065080.926878:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8705 00000100:00100000:1.0:1746065080.926906:0:10212:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d16d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:10212:1830881262655872:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1746065080.926913:0:10212:0:(osp_precreate.c:704:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x371:0x0]-[0x280000400:0x3a1:0x0] 00000004:00080000:1.0:1746065080.926962:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x372:0x0], index 0: 0 00000004:00080000:1.0:1746065080.926965:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x373:0x0], index 1: 0 00000004:00080000:1.0:1746065080.926969:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x374:0x0], index 1: 0 00000004:00080000:1.0:1746065080.926972:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x373:0x0], index 0: 0 00010000:00010000:1.0:1746065080.927025:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927035:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927041:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927045:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065080.927048:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927053:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927061:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561600) 00010000:00010000:1.0:1746065080.927063:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065080.927065:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927069:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146339a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.927102:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc1463393 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce18 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.927109:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc1463393 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce18 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.927119:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552ea00, rc 0) 00000100:00100000:1.0:1746065080.927142:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27934:x1830881261482368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4195us (4481us total) trans 4294975671 rc 301/301 00000100:00100000:1.0:1746065080.927147:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12333 00000100:00100000:0.0:1746065080.928933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.928983:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261482752 00000100:00100000:2.0:1746065080.928989:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261482752 00000100:00100000:2.0:1746065080.930354:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4246 00000100:00100000:2.0:1746065080.930364:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27934:x1830881261482752:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065080.932249:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27934:x1830881261482752:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1881us (3312us total) trans 4294975672 rc 0/0 00000100:00100000:2.0:1746065080.932257:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4246 00000100:00100000:2.0:1746065080.936118:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.936158:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.936263:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261483264 00000100:00100000:0.0:1746065080.936270:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261483264 00000100:00100000:0.0:1746065080.936308:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12334 00000100:00100000:0.0:1746065080.936314:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27935:x1830881261483264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.936336:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.936351:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc14633a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce1f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.936413:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.936425:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936433:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936441:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.936447:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936452:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936525:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc14633bd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065080.936530:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc14633bd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936535:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc14633bd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065080.936542:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 0 00010000:00010000:0.0:1746065080.936603:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936612:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936617:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936623:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936627:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.936630:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936635:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936643:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:0.0:1746065080.936646:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.936649:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936654:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4600/0xad6b7ddc14633af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936666:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936670:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936675:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936678:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.936681:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936685:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936691:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:0.0:1746065080.936693:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.936695:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936698:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4200/0xad6b7ddc14633b6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065080.936721:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa4c00/0xad6b7ddc14633a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce1f expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.936732:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc14633bd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce1f expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.936737:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:0.0:1746065080.936739:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065080.936741:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5800, rc 0) 00000100:00100000:0.0:1746065080.936791:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27935:x1830881261483264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 458us (613us total) trans 4294975673 rc 0/0 00000100:00100000:0.0:1746065080.936797:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12334 00000100:00100000:3.0:1746065080.937521:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261483008 00000100:00100000:3.0:1746065080.937527:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261483008 00000100:00100000:3.0:1746065080.938156:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4247 00000100:00100000:3.0:1746065080.938164:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27934:x1830881261483008:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.939003:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27934:x1830881261483008:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 838us (2890us total) trans 4294975674 rc 0/0 00000100:00100000:3.0:1746065080.939009:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4247 00000100:00100000:2.0:1746065080.939749:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.939980:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261483392 00000100:00100000:0.0:1746065080.939985:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261483392 00000100:00100000:0.0:1746065080.940012:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8706 00000100:00100000:0.0:1746065080.940017:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261483392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.940031:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.940044:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce26 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065080.940060:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065080.940072:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.940074:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.940081:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 43 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.940093:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 43 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.940101:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:0.0:1746065080.941199:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261483392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1177us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065080.941206:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8706 00000100:00100000:0.0:1746065080.942996:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.943038:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261483648 00000100:00100000:3.0:1746065080.943044:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261483648 00000100:00100000:3.0:1746065080.943648:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4248 00000100:00100000:3.0:1746065080.943655:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27935:x1830881261483648:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.943851:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27935:x1830881261483648:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 196us (859us total) trans 4294975675 rc 0/0 00000100:00100000:3.0:1746065080.943857:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4248 00000100:00100000:0.0:1746065080.946034:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.946071:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.946298:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261483904 00000100:00100000:2.0:1746065080.946304:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261483904 00000100:00100000:2.0:1746065080.946343:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261484160 00000100:00100000:2.0:1746065080.946346:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261484160 00000100:00100000:2.0:1746065080.946360:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12335 00000100:00100000:2.0:1746065080.946366:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261483904:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.946380:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.946383:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065080.946405:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5800/0xad6b7ddc14633bd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce1f expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.946426:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:2.0:1746065080.946435:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.946444:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14633d2 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce2d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.946519:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.946529:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946537:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.946556:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 0 00010000:00010000:2.0:1746065080.946625:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dda00/0xad6b7ddc14633d2 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.946635:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.946640:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065080.946642:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1746065080.946644:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc000, rc 0) 00000100:00100000:2.0:1746065080.946676:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261483904:12345-192.168.202.27@tcp:101:bash.0 Request processed in 310us (646us total) trans 4294975676 rc 0/0 00000100:00100000:2.0:1746065080.946682:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12335 00000100:00100000:2.0:1746065080.946695:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12336 00000100:00100000:2.0:1746065080.946700:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27935:x1830881261484160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.946709:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.946716:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14633e7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce34 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.946744:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.946750:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946755:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946762:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.946766:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946771:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946850:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065080.946858:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946863:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946869:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 3/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946873:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.946876:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 3/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946882:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 4/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946887:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065080.946890:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946894:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc14633fc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065080.946901:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 0 00010000:00010000:2.0:1746065080.946923:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946927:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946932:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946936:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946939:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.946941:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946945:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946950:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd800) 00010000:00010000:2.0:1746065080.946952:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.946954:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946959:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14633ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946964:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946968:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946972:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946976:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065080.946977:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946981:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946986:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:2.0:1746065080.946987:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065080.946989:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.946993:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14633f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065080.947007:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14633e7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce34 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.947013:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14633e7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce34 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.947022:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dca00, rc 0) 00000100:00100000:2.0:1746065080.947036:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27935:x1830881261484160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 337us (965us total) trans 4294975677 rc 301/301 00000100:00100000:2.0:1746065080.947041:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12336 00000100:00100000:0.0:1746065080.948940:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.948973:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.949080:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261484288 00000100:00100000:3.0:1746065080.949086:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261484288 00000100:00100000:3.0:1746065080.949829:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261484416 00000100:00100000:3.0:1746065080.949832:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261484416 00000100:00100000:3.0:1746065080.949855:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12337 00000100:00100000:3.0:1746065080.949861:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+299:27935:x1830881261484288:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.949875:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.949888:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146340a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce3b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.949945:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065080.949954:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.949961:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.949982:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.949991:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 300 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.950000:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262656000:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.950058:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.950077:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12338 00000100:00100000:3.0:1746065080.950082:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261484416:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065080.950091:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.950097:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06600/0xad6b7ddc1463418 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce42 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.950109:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc146341f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065080.950116:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc146341f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.950124:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc146341f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065080.950176:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06600/0xad6b7ddc1463418 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce42 expref: 302 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.950186:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc146341f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce42 expref: 301 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.950192:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065080.950195:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065080.950197:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:3.0:1746065080.950216:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261484416:12345-192.168.202.27@tcp:101:bash.0 Request processed in 134us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.950221:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12338 00000100:00100000:0.0:1746065080.952972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.953040:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.953097:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261484800 00000100:00100000:2.0:1746065080.953102:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261484800 00010000:00010000:2.0:1746065080.953130:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 301 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.953152:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3659 00000100:00100000:2.0:1746065080.953159:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+301:2004:x1830881261484800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.953169:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.953174:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 301 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.953183:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 301 pid: 7203 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.953200:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065080.953204:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.953210:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.953216:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065080.953232:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.953260:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+301:2004:x1830881261484800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.953266:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3659 00000100:00100000:1.0:1746065080.953323:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261484672 00000100:00100000:1.0:1746065080.953327:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261484672 00000100:00100000:1.0:1746065080.953344:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12339 00000100:00100000:1.0:1746065080.953348:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261484672:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:1.0:1746065080.953485:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065080.953492:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.953498:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.953508:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065080.953515:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.954236:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc14633d9 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce2d expref: 302 pid: 7203 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.954249:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262656000:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.954261:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.954271:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.954275:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065080.954295:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 0 00000004:00200000:3.0:1746065080.954298:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065080.954309:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065080.954330:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800907d4400/0xad6b7ddc146340a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.954342:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 301 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.954349:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 301 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.954355:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e4e200, rc 0) 00000100:00100000:3.0:1746065080.955043:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+301:27935:x1830881261484288:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5180us (6105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.955048:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12337 00000100:00100000:0.0:1746065080.956759:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.956814:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.956896:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261484928 00000100:00100000:3.0:1746065080.956902:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261484928 00000100:00100000:3.0:1746065080.956930:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12340 00000100:00100000:3.0:1746065080.956935:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+301:27935:x1830881261484928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065080.956949:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065080.956962:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06e00/0xad6b7ddc146342d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce49 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.956997:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06e00/0xad6b7ddc146342d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce49 expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.957008:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06e00/0xad6b7ddc146342d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce49 expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.957020:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065080.957023:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065080.957025:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06e00, rc 0) 00000100:00100000:3.0:1746065080.957063:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+302:27935:x1830881261484928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065080.957068:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12340 00000100:00100000:2.0:1746065080.957121:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261485056 00000100:00100000:2.0:1746065080.957124:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261485056 00010000:00010000:2.0:1746065080.957139:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 302 pid: 7204 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.957163:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3660 00000100:00100000:2.0:1746065080.957168:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+302:2005:x1830881261485056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.957175:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.957179:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 302 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.957187:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 302 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.957198:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463411 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce3b expref: 302 pid: 7204 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.957208:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065080.957212:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.957220:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.957229:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.957243:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065080.957257:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+301:2005:x1830881261485056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.957262:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3660 00010000:00010000:1.0:1746065080.957471:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.957478:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:1.0:1746065080.957531:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975678 00000004:00010000:1.0:1746065080.957569:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098662d80 reply state ffff8800997f7000 transno 4294975679 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.957577:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.957582:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065080.957585:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065080.957587:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065080.957629:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261484672:12345-192.168.202.27@tcp:36:bash.0 Request processed in 4281us (4664us total) trans 4294975679 rc 0/0 00000100:00100000:1.0:1746065080.957635:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12339 00000020:00080000:1.0:1746065080.957637:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065080.959665:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.959796:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261485312 00000100:00100000:3.0:1746065080.959802:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261485312 00000100:00100000:3.0:1746065080.959837:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4249 00000100:00100000:3.0:1746065080.959843:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+302:27935:x1830881261485312:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065080.959967:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+303:27935:x1830881261485312:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 124us (307us total) trans 4294975680 rc 0/0 00000100:00100000:3.0:1746065080.959973:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4249 00000100:00100000:0.0:1746065080.960430:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.960619:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261485568 00000100:00100000:1.0:1746065080.960623:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261485568 00000100:00100000:1.0:1746065080.960653:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12341 00000100:00100000:1.0:1746065080.960658:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+303:26180:x1830881261485568:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065080.960670:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065080.960672:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065080.960687:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d06e00/0xad6b7ddc146342d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce49 expref: 303 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.960707:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065080.960710:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065080.960718:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e000/0xad6b7ddc1463434 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce50 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.960745:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc146343b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065080.960754:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc146343b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065080.960761:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc146343b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:1.0:1746065080.960902:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2461, 88 off203584 00000004:00080000:1.0:1746065080.960906:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676979132216ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065080.960937:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2465, 88 off204016 00000004:00080000:1.0:1746065080.960940:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676979166809ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065080.960970:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2466, 88 off204104 00000004:00080000:1.0:1746065080.960973:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676979199500ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065080.960983:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2462, 88 off203672 00000004:00080000:1.0:1746065080.960986:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676979211998ns, next at 677717578181ns, rc = 0 00000001:00080000:2.0:1746065080.963187:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975681 is committed 00000004:00080000:2.0:1746065080.963196:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1654 committed 00000004:00080000:2.0:1746065080.963203:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1664 committed 00000004:00080000:2.0:1746065080.963208:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1663 committed 00000004:00080000:2.0:1746065080.963209:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1653 committed 00010000:00010000:3.0:1746065080.963362:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963371:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963377:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963383:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.963387:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963392:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963403:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:3.0:1746065080.963405:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.963407:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963412:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc14632f9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963424:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963429:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963433:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963437:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.963439:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963443:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963448:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800b7e52a00) 00010000:00010000:3.0:1746065080.963450:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.963452:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963456:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880136167e00/0xad6b7ddc146337e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065080.963468:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963473:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963477:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963481:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065080.963483:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963487:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963492:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065080.963494:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065080.963496:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.963500:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc1463426 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065080.963610:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262656384:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.963654:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.963690:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262656896:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.963705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.963718:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065080.963722:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262656512:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065080.963733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065080.963741:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262657024:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065080.963752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065080.963818:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc146343b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce50 expref: 284 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.963825:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065080.963827:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065080.963835:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e000/0xad6b7ddc1463434 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce50 expref: 284 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065080.963845:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc146343b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce50 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.963865:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065080.963867:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065080.963868:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552ea00, rc 0) 00000100:00100000:1.0:1746065080.963901:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:26180:x1830881261485568:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3242us (3471us total) trans 4294975681 rc 0/0 00000100:00100000:1.0:1746065080.963907:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12341 00000100:00100000:0.0:1746065080.964097:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656384 00000100:00100000:0.0:1746065080.964102:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656384 00000100:00100000:0.0:1746065080.964155:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656896 00000100:00100000:0.0:1746065080.964157:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656896 00000100:00100000:0.0:1746065080.964166:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656512 00000100:00100000:0.0:1746065080.964167:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656512 00000100:00100000:0.0:1746065080.964174:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262657024 00000100:00100000:0.0:1746065080.964175:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262657024 00000100:00100000:0.0:1746065080.964184:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8707 00000100:00100000:0.0:1746065080.964189:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+122:3759:x1830881262656384:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.964287:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+123:3759:x1830881262656384:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (633us total) trans 17179872596 rc 0/0 00000100:00100000:0.0:1746065080.964292:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8707 00000100:00100000:0.0:1746065080.964300:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8708 00000100:00100000:0.0:1746065080.964303:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+89:3759:x1830881262656896:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065080.964347:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065080.964350:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065080.964352:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065080.964353:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065080.964355:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065080.964368:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+90:3759:x1830881262656896:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (663us total) trans 21474839874 rc 0/0 00000100:00100000:0.0:1746065080.964372:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8708 00000100:00100000:0.0:1746065080.964379:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8709 00000100:00100000:0.0:1746065080.964382:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+122:3759:x1830881262656512:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065080.964417:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+123:3759:x1830881262656512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 34us (683us total) trans 17179872597 rc 0/0 00000100:00100000:0.0:1746065080.964424:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8709 00000100:00100000:0.0:1746065080.964431:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8710 00000100:00100000:0.0:1746065080.964434:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+89:3759:x1830881262657024:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065080.964467:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+90:3759:x1830881262657024:12345-0@lo:2:osp-syn-0-1.0 Request processed in 32us (715us total) trans 21474839875 rc 0/0 00000100:00100000:0.0:1746065080.964471:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8710 00000100:00100000:0.0:1746065080.964512:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.964721:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656256:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.964742:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.964770:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656768:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.964793:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.964803:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065080.964807:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656128:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065080.964817:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.964829:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656640:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065080.964839:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065080.964856:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656256 00000100:00100000:2.0:1746065080.964858:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656256 00000100:00100000:2.0:1746065080.964871:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656768 00000100:00100000:2.0:1746065080.964873:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656768 00000100:00100000:2.0:1746065080.964879:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656128 00000100:00100000:2.0:1746065080.964881:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656128 00000100:00100000:2.0:1746065080.964885:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656640 00000100:00100000:2.0:1746065080.964887:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656640 00000100:00100000:2.0:1746065080.964893:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8711 00000100:00100000:2.0:1746065080.964897:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+124:3762:x1830881262656256:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065080.964907:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:882 count 1 00010000:00010000:2.0:1746065080.964918:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.964931:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 53 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.964937:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.964939:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.964941:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.964958:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 53 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.964967:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 53 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746065080.964975:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098581c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262657152:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.965003:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.965013:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8712 00000100:00100000:2.0:1746065080.965017:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+91:3762:x1830881262656768:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065080.965025:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:881 count 1 00010000:00010000:2.0:1746065080.965033:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.965042:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.965047:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.965048:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.965050:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.965062:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065080.965068:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 42 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746065080.965076:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262657280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.965092:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.965150:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8713 00000100:00100000:3.0:1746065080.965156:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+124:3762:x1830881262656128:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065080.965166:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:881 count 1 00010000:00010000:3.0:1746065080.965175:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965183:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 53 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965188:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.965189:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.965191:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965204:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 53 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965211:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 53 pid: 1880 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.965218:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262657408:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.965240:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.965253:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8714 00000100:00100000:3.0:1746065080.965257:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+91:3762:x1830881262656640:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065080.965266:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:880 count 1 00010000:00010000:3.0:1746065080.965275:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965283:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965292:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065080.965293:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000004:00080000:1.0:1746065080.965444:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a0e00/2, rc 0, transno 17179872597 00000100:00100000:1.0:1746065080.965450:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262656512:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065080.965459:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137347800/2, rc 0, transno 21474839875 00000100:00100000:1.0:1746065080.965462:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262657024:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065080.965468:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a2300/2, rc 0, transno 17179872596 00000100:00100000:1.0:1746065080.965470:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262656384:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065080.965476:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137345880/2, rc 0, transno 21474839874 00000100:00100000:1.0:1746065080.965478:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262656896:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065080.965511:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965528:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.965535:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 42 pid: 3067 timeout: 776 lvb_type: 0 00000100:00100000:3.0:1746065080.965543:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262657536:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.965568:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065080.966701:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261485824 00000100:00100000:0.0:1746065080.966708:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261485824 00000100:00100000:0.0:1746065080.966746:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12342 00000100:00100000:0.0:1746065080.966751:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+283:27935:x1830881261485824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065080.966764:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.966792:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc146345e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce57 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.966840:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065080.966849:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.966858:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.966866:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065080.966871:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.966879:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.966943:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065080.966949:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.966954:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:0.0:1746065080.966960:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 2 00010000:00010000:0.0:1746065080.967008:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967014:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967019:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967023:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967028:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.967031:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967036:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967043:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a400) 00010000:00010000:0.0:1746065080.967045:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.967048:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967053:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc1463465 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967077:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967082:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967086:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967090:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065080.967092:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967096:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967101:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a500) 00010000:00010000:0.0:1746065080.967102:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065080.967104:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967108:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc146346c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065080.967135:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc146345e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.967145:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 285 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.967150:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:0.0:1746065080.967151:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065080.967153:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488e00, rc 0) 00000100:00100000:0.0:1746065080.967189:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27935:x1830881261485824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 437us (2675us total) trans 4294975682 rc 0/0 00000100:00100000:0.0:1746065080.967195:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12342 00000100:00100000:2.0:1746065080.970468:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.970701:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261485952 00000100:00100000:0.0:1746065080.970706:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261485952 00000100:00100000:0.0:1746065080.970733:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8715 00000100:00100000:0.0:1746065080.970739:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+43:26180:x1830881261485952:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065080.970751:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065080.970762:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce5e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.970794:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 44 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.970800:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.970802:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065080.970804:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 44 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065080.970826:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 44 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065080.970835:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 44 pid: 3067 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746065080.970845:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262657664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065080.970891:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.971159:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262657152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.971174:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.972192:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262657408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.972205:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.972222:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262657536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065080.972234:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.972634:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.972662:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.972675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.972703:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.972718:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.972730:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262657280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.972741:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065080.972753:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262657664:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.972756:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486080 00000100:00100000:2.0:1746065080.972759:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486080 00010000:00010000:0.0:1746065080.972764:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 44 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.972792:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 54 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746065080.972792:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:2.0:1746065080.972812:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486336 00000100:00100000:2.0:1746065080.972814:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486336 00000100:00100000:0.0:1746065080.972816:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:26180:x1830881261485952:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2077us (2354us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065080.972822:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 55 pid: 1880 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746065080.972822:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8715 00000100:00100000:2.0:1746065080.972830:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486208 00000100:00100000:2.0:1746065080.972832:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486208 00010000:00010000:2.0:1746065080.972838:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 44 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:2.0:1746065080.972845:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486464 00000100:00100000:2.0:1746065080.972847:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486464 00010000:00010000:2.0:1746065080.972852:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 45 pid: 3067 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.972861:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3661 00000100:00100000:2.0:1746065080.972866:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+55:2004:x1830881261486080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.972873:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.972877:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 55 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.972885:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 55 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.972900:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2400/0xad6b7ddc1463212 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda8 expref: 55 pid: 1880 timeout: 776 lvb_type: 1 00010000:00010000:2.0:1746065080.972918:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.972920:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.972923:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.972926:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3662 00010000:00010000:2.0:1746065080.972930:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.972932:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261486336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.972939:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.972942:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 54 pid: 1880 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.972948:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.972949:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 54 pid: 1880 timeout: 776 lvb_type: 0 00010000:00010000:3.0:1746065080.972959:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc14632c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cdd9 expref: 54 pid: 1880 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.972964:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261486080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (331us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065080.972968:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065080.972969:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3661 00010000:00010000:3.0:1746065080.972970:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.972972:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.972978:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065080.972978:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3663 00000100:00100000:2.0:1746065080.972982:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881261486208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065080.972987:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.972988:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065080.972991:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 45 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.972999:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881261486336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (337us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065080.972999:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 45 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.973004:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3662 00010000:00010000:2.0:1746065080.973008:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3000/0xad6b7ddc146320b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cda1 expref: 45 pid: 1880 timeout: 776 lvb_type: 1 00000100:00100000:3.0:1746065080.973012:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3664 00000100:00100000:3.0:1746065080.973016:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261486464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065080.973016:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.973017:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.973019:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973022:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065080.973025:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 44 pid: 3067 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.973025:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973032:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 44 pid: 3067 timeout: 776 lvb_type: 0 00010000:00010000:2.0:1746065080.973034:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.973041:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc14632c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cde0 expref: 44 pid: 3067 timeout: 776 lvb_type: 0 00000100:00100000:2.0:1746065080.973045:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261486208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065080.973048:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065080.973049:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065080.973049:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3663 00010000:00010000:3.0:1746065080.973051:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973057:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973063:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973065:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065080.973069:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.973075:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261486464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 59us (373us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065080.973076:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973082:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065080.973085:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3664 00010000:00010000:2.0:1746065080.973093:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065080.973105:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973111:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973119:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973124:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.973131:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065080.973242:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+92:3762:x1830881262656768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8223us (8447us total) trans 21474839876 rc 0/0 00000100:00100000:2.0:1746065080.973252:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8712 00010000:00010000:2.0:1746065080.973264:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1746065080.973269:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973277:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.973280:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.973281:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486720 00000100:00100000:1.0:1746065080.973284:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486720 00010000:00010000:2.0:1746065080.973286:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973294:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973300:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.973303:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4250 00000100:00100000:1.0:1746065080.973307:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27935:x1830881261486720:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:2.0:1746065080.973310:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065080.973312:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973316:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065080.973318:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973323:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973329:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973337:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1463442 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.973344:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.973345:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.973347:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065080.973350:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.973406:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27935:x1830881261486720:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 97us (686us total) trans 4294975683 rc 0/0 00000100:00100000:1.0:1746065080.973411:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4250 00000100:00100000:0.0:1746065080.973644:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.973852:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486848 00000100:00100000:1.0:1746065080.973855:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486848 00010000:00010000:1.0:1746065080.973867:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 42 pid: 3067 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746065080.973887:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3665 00000100:00100000:1.0:1746065080.973891:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261486848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065080.973898:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.973901:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 42 pid: 3067 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746065080.973909:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 42 pid: 3067 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746065080.973919:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14633cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce26 expref: 42 pid: 3067 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746065080.973927:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.973928:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065080.973933:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.973939:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065080.973959:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.973968:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881262657792:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065080.973999:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065080.974058:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+125:3762:x1830881262656256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9159us (9313us total) trans 17179872598 rc 0/0 00000100:00100000:3.0:1746065080.974064:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8711 00010000:00010000:3.0:1746065080.974078:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974085:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974091:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974096:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974106:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065080.974185:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+125:3762:x1830881262656128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9030us (9367us total) trans 17179872599 rc 0/0 00000100:00100000:3.0:1746065080.974191:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8713 00010000:00010000:3.0:1746065080.974206:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974212:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974218:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974223:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974232:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065080.974305:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+92:3762:x1830881262656640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9047us (9464us total) trans 21474839877 rc 0/0 00000100:00100000:3.0:1746065080.974310:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8714 00010000:00010000:3.0:1746065080.974320:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065080.974323:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974328:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.974331:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974337:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974346:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974352:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc1463450 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974363:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065080.974365:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974370:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065080.974372:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974378:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974384:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974390:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc1463457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.974398:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.974399:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065080.974401:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065080.974722:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a1500/2, rc 0, transno 17179872598 00000100:00100000:2.0:1746065080.974727:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656256:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.974737:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137344a80/2, rc 0, transno 21474839876 00000100:00100000:2.0:1746065080.974740:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656768:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065080.974747:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a3b80/2, rc 0, transno 17179872599 00000100:00100000:2.0:1746065080.974750:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656128:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065080.974754:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137345c00/2, rc 0, transno 21474839877 00000100:00100000:2.0:1746065080.974756:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262656640:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065080.974765:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065080.975560:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d14e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881262657792:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065080.975574:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.975598:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261486848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1706us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.975604:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3665 00000100:00100000:0.0:1746065080.975886:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.976094:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261486976 00000100:00100000:1.0:1746065080.976099:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261486976 00000100:00100000:0.0:1746065080.976157:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.976233:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4251 00000100:00100000:1.0:1746065080.976241:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27935:x1830881261486976:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065080.976277:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261487104 00000100:00100000:2.0:1746065080.976281:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261487104 00000100:00100000:2.0:1746065080.976317:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8716 00000100:00100000:2.0:1746065080.976322:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+52:26180:x1830881261487104:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065080.976330:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.976347:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce65 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065080.976361:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065080.976376:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.976378:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065080.976384:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 53 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065080.976524:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27935:x1830881261486976:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 284us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.976529:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4251 00010000:00010000:2.0:1746065080.976530:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 53 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.976538:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dda00, rc 0) 00000100:00100000:2.0:1746065080.976568:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+53:26180:x1830881261487104:12345-192.168.202.27@tcp:101:bash.0 Request processed in 245us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065080.976573:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8716 00000100:00100000:0.0:1746065080.977714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065080.977754:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.978005:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261487232 00000100:00100000:2.0:1746065080.978010:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261487232 00002000:00010000:2.0:1746065080.978030:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/882 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.978034:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53c700 with x1830881261487232 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.978042:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53c700. 00000100:00100000:2.0:1746065080.978266:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261487360 00000100:00100000:2.0:1746065080.978269:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261487360 00002000:00010000:2.0:1746065080.978278:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/883 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.978280:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53f100 with x1830881261487360 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.978285:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53f100. 00000100:00100000:1.0:1746065080.978338:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1281 00000100:00100000:1.0:1746065080.978345:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261487232:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:2.0:1746065080.978444:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1282 00000100:00100000:2.0:1746065080.978450:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881261487360:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065080.978623:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065080.978626:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:1.0:1746065080.978627:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065080.978629:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:1.0:1746065080.978631:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065080.978670:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881261487232:12345-192.168.202.27@tcp:10:bash.0 Request processed in 325us (959us total) trans 21474839878 rc 0/0 00000100:00100000:1.0:1746065080.978675:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1281 00002000:00010000:1.0:1746065080.978678:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/882 (0->18446744073709551615) 00002000:00100000:1.0:1746065080.978680:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53c700 with x1830881261487232 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065080.978684:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53c700. 00002000:00010000:2.0:1746065080.978765:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065080.978767:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065080.978769:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065080.978771:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065080.978796:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065080.978816:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261487360:12345-192.168.202.27@tcp:10:bash.0 Request processed in 366us (1061us total) trans 17179872600 rc 0/0 00000100:00100000:2.0:1746065080.978823:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1282 00002000:00010000:2.0:1746065080.978825:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/883 (0->18446744073709551615) 00002000:00100000:2.0:1746065080.978827:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53f100 with x1830881261487360 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065080.978830:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53f100. 00000100:00100000:0.0:1746065080.981569:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.981651:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261487616 00000100:00100000:1.0:1746065080.981657:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261487616 00000100:00100000:1.0:1746065080.982256:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4252 00000100:00100000:1.0:1746065080.982264:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261487616:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065080.982452:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261487616:12345-192.168.202.27@tcp:35:bash.0 Request processed in 188us (888us total) trans 4294975684 rc 0/0 00000100:00100000:1.0:1746065080.982458:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4252 00000100:00100000:0.0:1746065080.984242:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.984304:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261487872 00000100:00100000:2.0:1746065080.984310:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261487872 00000100:00100000:2.0:1746065080.984678:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12343 00000100:00100000:2.0:1746065080.984686:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27936:x1830881261487872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.984702:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.984717:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146348f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce6c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.984809:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463496 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.984822:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463496 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.984834:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463496 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065080.984843:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 5 00010000:00010000:2.0:1746065080.985601:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146348f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce6c expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.985627:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463496 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce6c expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.985634:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065080.985637:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065080.985639:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc000, rc 0) 00000100:00100000:2.0:1746065080.985681:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27936:x1830881261487872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 996us (1444us total) trans 4294975685 rc 0/0 00000100:00100000:2.0:1746065080.985687:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12343 00000100:00100000:3.0:1746065080.990166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065080.990416:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261488128 00000100:00100000:2.0:1746065080.990424:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261488128 00000100:00100000:2.0:1746065080.990460:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12344 00000100:00100000:2.0:1746065080.990466:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27936:x1830881261488128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065080.990482:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065080.990497:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc14634a4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce73 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.990605:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,1 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065080.990616:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.990622:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 4/0,1 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065080.990646:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065080.990656:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 290 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065080.990672:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262657920:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065080.990746:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065080.992990:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.993052:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261488384 00000100:00100000:3.0:1746065080.993058:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261488384 00000100:00100000:3.0:1746065080.993097:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4253 00000100:00100000:3.0:1746065080.993104:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27937:x1830881261488384:12345-192.168.202.27@tcp:35:rm.0 00000100:00100000:3.0:1746065080.993298:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27937:x1830881261488384:12345-192.168.202.27@tcp:35:rm.0 Request processed in 193us (312us total) trans 4294975686 rc 0/0 00000100:00100000:3.0:1746065080.993305:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4253 00000100:00100000:2.0:1746065080.994497:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262657920:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065080.994516:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,1 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065080.994983:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065080.995032:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261488512 00000100:00100000:1.0:1746065080.995037:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261488512 00010000:00010000:1.0:1746065080.995060:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065080.995092:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3666 00000100:00100000:1.0:1746065080.995099:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27937:x1830881261488512:12345-192.168.202.27@tcp:103:rm.0 00010000:00010000:1.0:1746065080.995110:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065080.995115:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065080.995124:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065080.995143:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463473 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce57 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065080.995155:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065080.995159:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,1 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.995170:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.995176:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065080.995204:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065080.995232:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27937:x1830881261488512:12345-192.168.202.27@tcp:103:rm.0 Request processed in 132us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065080.995238:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3666 00010000:00010000:3.0:1746065080.995324:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.995330:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065080.995348:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 5 00010000:00010000:3.0:1746065080.995446:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc14634a4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.995457:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.995463:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065080.995465:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065080.995467:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dcc00, rc 0) 00000100:00100000:3.0:1746065080.995499:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27936:x1830881261488128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5033us (5341us total) trans 4294975687 rc 0/0 00000100:00100000:3.0:1746065080.995504:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12344 00000100:00100000:0.0:1746065080.997197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065080.997293:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261488768 00000100:00100000:3.0:1746065080.997299:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261488768 00000100:00100000:3.0:1746065080.997345:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12345 00000100:00100000:3.0:1746065080.997352:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27937:x1830881261488768:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065080.997392:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065080.997409:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc000/0xad6b7ddc1463496 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce6c expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.997422:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc146343b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce50 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.997432:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc146341f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce42 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.997439:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065080.997442:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065080.997458:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.997466:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.997473:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.997480:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.997485:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.997489:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.997553:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065080.997561:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.997566:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065080.997587:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065080.997596:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 288 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065080.997607:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262658048:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065080.998469:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.000451:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262658048:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.000470:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065081.000596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.000815:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261488896 00000100:00100000:0.0:1746065081.000820:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261488896 00010000:00010000:0.0:1746065081.000844:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 289 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.001589:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3667 00000100:00100000:1.0:1746065081.001598:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+289:2005:x1830881261488896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.001608:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.001614:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 289 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.001623:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 289 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.001640:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14634ab lrc: 0/0,0 mode: --/CW res: [0x240000403:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce73 expref: 289 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.001651:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:1.0:1746065081.001655:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.001662:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.001671:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.001698:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.001734:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+288:2005:x1830881261488896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 138us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.001741:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3667 00010000:00010000:3.0:1746065081.001841:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.001847:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065081.002077:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x34d:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1746065081.002211:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002217:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002222:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002231:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.002234:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002239:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002251:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065081.002254:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065081.002257:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002260:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14634c7 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002275:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002279:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002283:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002287:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002290:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.002292:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002296:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002304:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561100) 00010000:00010000:3.0:1746065081.002306:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.002308:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002312:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8a00/0xad6b7ddc14634b9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065081.002321:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c53d180 reply state ffff88008d938000 transno 4294975688 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002327:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.002332:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561c00) 00010000:00010000:3.0:1746065081.002333:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.002335:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.002383:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27937:x1830881261488768:12345-192.168.202.27@tcp:36:rm.0 Request processed in 5031us (5190us total) trans 4294975688 rc 0/0 00000100:00100000:3.0:1746065081.002388:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12345 00000100:00100000:0.0:1746065081.003750:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.004033:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489024 00000100:00100000:3.0:1746065081.004040:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489024 00000100:00100000:3.0:1746065081.004073:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12346 00000100:00100000:3.0:1746065081.004079:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27936:x1830881261489024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.004097:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.004112:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8200/0xad6b7ddc14634ce lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce7a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.004165:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14634d5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.004175:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14634d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.004183:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14634d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065081.004207:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 5 00000004:00200000:3.0:1746065081.004210:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065081.004221:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14634d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.004237:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8200/0xad6b7ddc14634ce lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce7a expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.004248:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14634d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce7a expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.004254:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.004256:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065081.004258:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8e00, rc 0) 00000100:00100000:3.0:1746065081.004287:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27936:x1830881261489024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 208us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.004293:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12346 00000100:00100000:0.0:1746065081.007128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.007179:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489280 00000100:00100000:2.0:1746065081.007187:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489280 00000100:00100000:2.0:1746065081.007237:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12347 00000100:00100000:2.0:1746065081.007244:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27936:x1830881261489280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.007260:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.007276:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14634dc lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce81 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.007370:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14634e3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.007383:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14634e3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.007391:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14634e3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.007401:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 5 00010000:00010000:2.0:1746065081.007478:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14634dc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce81 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.007515:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14634e3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce81 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.007522:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:2.0:1746065081.007524:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.007527:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dca00, rc 0) 00000100:00100000:2.0:1746065081.007585:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27936:x1830881261489280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 341us (464us total) trans 4294975689 rc 0/0 00000100:00100000:2.0:1746065081.007591:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12347 00000100:00100000:0.0:1746065081.010715:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.010803:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489408 00000100:00100000:3.0:1746065081.010811:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489408 00000100:00100000:3.0:1746065081.010848:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12348 00000100:00100000:3.0:1746065081.010854:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27938:x1830881261489408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.010871:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.010884:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9800/0xad6b7ddc14634f1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce88 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.010890:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.010932:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.010941:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.010949:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.010957:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.010961:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.010965:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.010992:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.010997:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011001:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011006:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011010:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.011013:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011021:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011028:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880095561600) 00010000:00010000:3.0:1746065081.011030:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.011033:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011037:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc14634f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011045:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011049:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065081.011051:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489536 00010000:00010000:3.0:1746065081.011053:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011056:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8400 already unused, calling callback (ffffffffa0f21690) 00000100:00100000:2.0:1746065081.011056:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489536 00010000:00010000:3.0:1746065081.011058:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011061:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011065:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561c00) 00010000:00010000:3.0:1746065081.011067:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.011068:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.011072:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14634ff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065081.011083:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8717 00000100:00100000:2.0:1746065081.011089:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261489536:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065081.011094:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9800/0xad6b7ddc14634f1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce88 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.011110:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.011113:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9800/0xad6b7ddc14634f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce88 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.011122:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.011127:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b9800, rc 0) 00010000:00010000:2.0:1746065081.011128:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.011130:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.011133:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.011162:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.011180:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 42 pid: 3067 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.011185:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27938:x1830881261489408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 330us (476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.011190:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262658176:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.011191:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12348 00000100:00100000:2.0:1746065081.011246:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.013732:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.013812:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489664 00000100:00100000:3.0:1746065081.013817:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489664 00002000:00100000:3.0:1746065081.013845:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x372:0x0] (0->4) req@ffff88008c53ca80 x1830881261489664/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/0 e 0 to 0 dl 1746065092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065081.013854:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53ca80 with x1830881261489664 ext(0->4) 00010000:00010000:3.0:1746065081.013861:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 43 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.013872:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 43 pid: 3067 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746065081.013878:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c53ca80 00000100:00100000:3.0:1746065081.013903:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 220 00000100:00100000:3.0:1746065081.013908:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881261489664:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:2.0:1746065081.014837:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262658176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.014856:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.015101:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261489664:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1190us (1372us total) trans 21474839879 rc 0/0 00000100:00100000:3.0:1746065081.015108:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 220 00002000:00100000:3.0:1746065081.015116:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x372:0x0] (0->4) req@ffff88008c53ca80 x1830881261489664/t21474839879(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/448 e 0 to 0 dl 1746065092 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065081.015122:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53ca80 with x1830881261489664 ext(0->4) 00010000:00010000:3.0:1746065081.015127:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 45 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.015136:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 45 pid: 3067 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746065081.015141:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c53ca80 00000100:00100000:2.0:1746065081.015629:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.015650:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489792 00000100:00100000:0.0:1746065081.015654:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489792 00000100:00100000:0.0:1746065081.015685:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12349 00000100:00100000:0.0:1746065081.015690:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27938:x1830881261489792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.015701:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.015715:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc146350d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce8f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.015758:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065081.015768:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015795:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015806:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065081.015813:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015821:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015852:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015857:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015861:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015866:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015870:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa8ea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.015874:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015879:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015888:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:0.0:1746065081.015891:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.015893:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015897:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc1463514 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015919:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015924:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015929:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015933:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f70be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.015935:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015939:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015945:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561c00) 00010000:00010000:0.0:1746065081.015947:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.015949:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015953:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f70be00/0xad6b7ddc146351b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.015972:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc146350d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce8f expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.015978:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc146350d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce8f expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.015986:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bd3800, rc 0) 00000100:00100000:0.0:1746065081.016016:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27938:x1830881261489792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 324us (387us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065081.016021:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12349 00000100:00100000:0.0:1746065081.017262:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.017305:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261489920 00000100:00100000:1.0:1746065081.017309:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261489920 00010000:00010000:1.0:1746065081.017324:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 45 pid: 3067 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.017340:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3668 00000100:00100000:1.0:1746065081.017345:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881261489920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.017352:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065081.017362:0:7192:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065081.017365:0:7192:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065081.017368:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 45 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.017376:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 45 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.017389:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc1463481 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce5e expref: 45 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.017409:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.017411:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.017415:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.017425:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017466:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017472:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017484:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017490:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017496:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017505:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.017508:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017513:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017522:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.017527:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1463506 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.017577:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261489536:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 6488us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.017584:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8717 00010000:00010000:1.0:1746065081.017620:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.017637:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261489920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 291us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.017642:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3668 00000100:00100000:0.0:1746065081.017675:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.017855:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261490048 00000100:00100000:1.0:1746065081.017859:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261490048 00000100:00100000:1.0:1746065081.017876:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12350 00000100:00100000:1.0:1746065081.017881:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27938:x1830881261490048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.017890:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.017898:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463522 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce96 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.017924:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463529 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.017931:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463529 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.017937:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463529 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065081.017963:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065081.017967:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065081.017985:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463522 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce96 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.017995:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463529 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce96 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.018000:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:1.0:1746065081.018002:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065081.018004:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488e00, rc 0) 00000100:00100000:1.0:1746065081.018021:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27938:x1830881261490048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 140us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.018025:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12350 00000100:00100000:0.0:1746065081.019907:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.020042:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261490304 00000100:00100000:3.0:1746065081.020047:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261490304 00000100:00100000:3.0:1746065081.020072:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12351 00000100:00100000:3.0:1746065081.020078:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27936:x1830881261490304:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065081.020104:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.020117:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14634d5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce7a expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.020131:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.020134:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.020149:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.020156:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.020166:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:3.0:1746065081.020311:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2463, 88 off203760 00000004:00080000:3.0:1746065081.020318:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677038543966ns, next at 677717578181ns, rc = 0 00000040:00080000:3.0:1746065081.020368:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2467, 88 off204192 00000004:00080000:3.0:1746065081.020373:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677038599173ns, next at 677717559249ns, rc = 0 00000040:00080000:3.0:1746065081.020386:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2468, 88 off204280 00000004:00080000:3.0:1746065081.020388:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677038614486ns, next at 677717559249ns, rc = 0 00000040:00080000:3.0:1746065081.020395:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2464, 88 off203848 00000004:00080000:3.0:1746065081.020397:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677038623405ns, next at 677717578181ns, rc = 0 00000100:00100000:0.0:1746065081.020684:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.020697:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261490432 00000100:00100000:1.0:1746065081.020701:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261490432 00000100:00100000:1.0:1746065081.020721:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12352 00000100:00100000:1.0:1746065081.020726:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27938:x1830881261490432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.020734:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.020741:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1463537 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ce9d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.020793:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.020800:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020806:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020816:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.020824:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020829:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020850:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020855:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020860:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020864:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020868:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.020871:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020875:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020882:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:1.0:1746065081.020884:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.020887:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020891:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488800/0xad6b7ddc146353e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020898:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020903:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020907:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020910:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.020912:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020916:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020921:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561c00) 00010000:00010000:1.0:1746065081.020923:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.020925:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020930:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc1463545 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.020947:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1463537 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce9d expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.020953:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488400/0xad6b7ddc1463537 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce9d expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.020958:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:1.0:1746065081.020983:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27938:x1830881261490432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 257us (300us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065081.020988:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12352 00000001:00080000:2.0:1746065081.022473:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975690 is committed 00000004:00080000:2.0:1746065081.022481:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1656 committed 00000004:00080000:2.0:1746065081.022624:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1666 committed 00010000:00010000:3.0:1746065081.022766:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.022797:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.022802:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.022806:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.022808:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.022813:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.022822:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880095561c00) 00010000:00010000:3.0:1746065081.022824:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.022826:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.022831:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14634c0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065081.022912:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1665 committed 00000004:00080000:2.0:1746065081.022915:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1655 committed 00000100:00100000:2.0:1746065081.022944:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262658304:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.022980:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.023013:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065081.023017:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262658432:0@lo:2:osp-syn-0-1.0 00000004:00010000:3.0:1746065081.023019:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c53d500 reply state ffff88009abb5800 transno 4294975690 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.023027:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065081.023030:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065081.023033:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.023034:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065081.023037:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.023053:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262658304 00000100:00100000:2.0:1746065081.023053:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262658432 00000100:00100000:3.0:1746065081.023057:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262658304 00000100:00100000:2.0:1746065081.023057:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262658432 00000100:00100000:2.0:1746065081.023078:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8718 00000100:00100000:2.0:1746065081.023083:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+93:3761:x1830881262658432:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.023179:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+94:3761:x1830881262658432:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (146us total) trans 21474839880 rc 0/0 00000100:00100000:1.0:1746065081.023260:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262658560:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.023279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.023292:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065081.023296:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262658688:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.023308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.023430:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8719 00000100:00100000:2.0:1746065081.023435:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8718 00000100:00100000:3.0:1746065081.023437:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+94:3761:x1830881262658304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.023446:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262658560 00000100:00100000:2.0:1746065081.023449:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262658560 00000100:00100000:3.0:1746065081.023495:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+94:3761:x1830881262658304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 58us (514us total) trans 21474839881 rc 0/0 00000100:00100000:3.0:1746065081.023500:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8719 00000100:00100000:3.0:1746065081.023508:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262658688 00000100:00100000:3.0:1746065081.023510:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262658688 00000100:00100000:2.0:1746065081.023711:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8720 00000100:00100000:2.0:1746065081.023717:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+126:3759:x1830881262658560:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065081.023768:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.023771:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.023788:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.023790:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.023792:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065081.023843:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8721 00000100:00100000:1.0:1746065081.023849:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+127:3759:x1830881262658688:12345-0@lo:2:osp-syn-1-1.0 00010000:00080000:3.0:1746065081.023899:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065081.023908:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+284:27936:x1830881261490304:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 3829us (4004us total) trans 4294975690 rc 0/0 00000100:00100000:3.0:1746065081.023913:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12351 00000100:00100000:2.0:1746065081.023927:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+128:3759:x1830881262658560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 211us (647us total) trans 17179872601 rc 0/0 00010000:00010000:3.0:1746065081.023929:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065081.023932:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8720 00010000:00010000:3.0:1746065081.023935:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.023943:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.023947:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.023949:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.023954:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065081.023960:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c529500/2, rc 0, transno 21474839880 00010000:00010000:3.0:1746065081.023961:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.023963:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065081.023964:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262658432:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065081.023965:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.023969:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc1463530 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065081.023971:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528000/2, rc 0, transno 21474839881 00000100:00100000:2.0:1746065081.023973:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262658304:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.024017:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+127:3759:x1830881262658688:12345-0@lo:2:osp-syn-1-1.0 Request processed in 169us (708us total) trans 17179872602 rc 0/0 00000100:00100000:1.0:1746065081.024022:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8721 00000004:00080000:1.0:1746065081.024042:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fe300/2, rc 0, transno 17179872602 00000100:00100000:1.0:1746065081.024045:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262658688:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065081.024050:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099d14e00/2, rc 0, transno 17179872601 00000100:00100000:1.0:1746065081.024052:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262658560:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.024695:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.024718:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261490688 00000100:00100000:3.0:1746065081.024722:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261490688 00000100:00100000:3.0:1746065081.024842:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12353 00000100:00100000:3.0:1746065081.024849:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+283:27938:x1830881261490688:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.024860:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.024862:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.024876:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463529 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce96 expref: 283 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.024886:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.024892:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.024899:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146354c lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cea4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.024962:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.024971:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.024978:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.024988:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.024992:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.024997:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025465:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.025472:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025478:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065081.025484:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 0 00010000:00010000:3.0:1746065081.025502:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025507:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025515:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025520:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025523:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.025526:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025530:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025536:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.025539:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.025541:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025557:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463553 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:3.0:1746065081.025567:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c52ad80 reply state ffff880095fd2000 transno 4294975691 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025573:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.025578:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72800) 00010000:00010000:3.0:1746065081.025579:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.025581:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065081.025599:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146354c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.025617:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 284 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.025622:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009074dc00) 00010000:00010000:3.0:1746065081.025623:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.025625:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25800, rc 0) 00000100:00100000:0.0:1746065081.025644:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.025661:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27938:x1830881261490688:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 813us (968us total) trans 4294975691 rc 0/0 00000100:00100000:3.0:1746065081.025667:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12353 00000100:00100000:3.0:1746065081.025677:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261490816 00000100:00100000:3.0:1746065081.025680:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261490816 00000100:00100000:3.0:1746065081.025693:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12354 00000100:00100000:3.0:1746065081.025697:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27936:x1830881261490816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.025705:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.025712:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ceab expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.025731:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.025738:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 286 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.025749:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.025751:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.025753:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25400, rc 0) 00000100:00100000:3.0:1746065081.025769:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27936:x1830881261490816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.025789:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12354 00000100:00100000:1.0:1746065081.033009:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.033045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.033101:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261490944 00000100:00100000:0.0:1746065081.033109:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261490944 00000100:00100000:0.0:1746065081.033150:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261491200 00000100:00100000:0.0:1746065081.033152:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261491200 00000100:00100000:0.0:1746065081.033292:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12355 00000100:00100000:0.0:1746065081.033300:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27936:x1830881261490944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.033315:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.033328:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1463576 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ceb2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.033378:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc146357d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.033389:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc146357d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.033397:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc146357d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065081.033428:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34d:0x0]: returning size 5 00000004:00200000:0.0:1746065081.033431:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065081.033440:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc146357d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.033456:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1463576 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceb2 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.033487:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12356 00000100:00100000:1.0:1746065081.033492:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27938:x1830881261491200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.033501:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.033507:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1463584 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ceb9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.033555:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.033562:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.033569:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 4/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.033591:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.033599:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.033609:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262658816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.033661:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00010000:00010000:0.0:1746065081.033930:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc146357d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceb2 expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.033938:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:0.0:1746065081.033940:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065081.033943:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:0.0:1746065081.033967:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27936:x1830881261490944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 668us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.033973:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12355 00000100:00100000:0.0:1746065081.038799:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.038959:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.039031:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261491328 00000100:00100000:2.0:1746065081.039039:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261491328 00000100:00100000:2.0:1746065081.039074:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8722 00000100:00100000:2.0:1746065081.039081:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261491328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.039096:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.039113:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cec0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.039132:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x372:0x0] initial LVB size: 5, mtime: 0x6812d6b9, atime: 0x0, ctime: 0x6812d6b9, blocks: 0x8 00010000:00010000:2.0:1746065081.039146:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.039148:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.039155:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 44 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.039168:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 44 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.039176:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:1.0:1746065081.039310:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262658816:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.039328:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.041076:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261491456 00000100:00100000:0.0:1746065081.041084:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261491456 00010000:00010000:0.0:1746065081.041114:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.041153:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3669 00000100:00100000:0.0:1746065081.041160:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+289:2005:x1830881261491456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.041171:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.041176:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.041186:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.041202:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463561 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cea4 expref: 289 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.041214:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009074dc00) 00010000:00010000:0.0:1746065081.041218:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.041225:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.041230:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.041244:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065081.041578:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261491328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2494us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.041585:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8722 00000100:00100000:0.0:1746065081.041592:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+288:2005:x1830881261491456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 431us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.041599:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3669 00010000:00010000:2.0:1746065081.042010:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042017:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.042037:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 0 00000004:00080000:2.0:1746065081.042159:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x375:0x0], index 1: 0 00000004:00080000:2.0:1746065081.042164:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x374:0x0], index 0: 0 00000004:00080000:2.0:1746065081.042167:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x375:0x0], index 0: 0 00000004:00080000:2.0:1746065081.042170:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x376:0x0], index 1: 0 00010000:00010000:2.0:1746065081.042262:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042269:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042275:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042280:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.042283:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042289:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042297:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009074dc00) 00010000:00010000:2.0:1746065081.042299:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.042302:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042306:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc146358b lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.042342:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1463584 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceb9 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.042348:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489400/0xad6b7ddc1463584 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceb9 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.042359:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489400, rc 0) 00000100:00100000:2.0:1746065081.042385:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27938:x1830881261491200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8892us (9339us total) trans 4294975692 rc 301/301 00000100:00100000:2.0:1746065081.042394:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12356 00000100:00100000:3.0:1746065081.052559:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.052590:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.052627:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261491840 00000100:00100000:0.0:1746065081.052634:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261491840 00000100:00100000:0.0:1746065081.052676:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4254 00000100:00100000:0.0:1746065081.052682:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27938:x1830881261491840:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065081.052875:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27938:x1830881261491840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 192us (331us total) trans 4294975693 rc 0/0 00000100:00100000:0.0:1746065081.052881:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4254 00000100:00100000:2.0:1746065081.053186:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261491584 00000100:00100000:2.0:1746065081.053190:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261491584 00000100:00100000:2.0:1746065081.053479:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8723 00000100:00100000:2.0:1746065081.053485:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881261491584:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065081.053541:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881261491584:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 56us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.053555:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8723 00000100:00100000:0.0:1746065081.057948:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.059982:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.060322:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261492096 00000100:00100000:0.0:1746065081.060331:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261492096 00000100:00100000:0.0:1746065081.060378:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4255 00000100:00100000:0.0:1746065081.060384:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27938:x1830881261492096:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065081.060531:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27938:x1830881261492096:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 147us (554us total) trans 4294975694 rc 0/0 00000100:00100000:0.0:1746065081.060538:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4255 00000100:00100000:2.0:1746065081.061017:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261492224 00000100:00100000:2.0:1746065081.061022:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261492224 00000100:00100000:3.0:1746065081.062230:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8724 00000100:00100000:3.0:1746065081.062238:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261492224:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065081.062315:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261492224:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 78us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.062321:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8724 00000100:00100000:0.0:1746065081.067930:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.067981:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.068249:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261492480 00000100:00100000:1.0:1746065081.068257:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261492480 00000100:00100000:3.0:1746065081.068269:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261492736 00000100:00100000:3.0:1746065081.068274:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261492736 00000100:00100000:1.0:1746065081.068311:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12357 00000100:00100000:3.0:1746065081.068317:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12358 00000100:00100000:1.0:1746065081.068318:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261492480:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:3.0:1746065081.068322:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27936:x1830881261492736:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065081.068343:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.068360:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc600/0xad6b7ddc14635a0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cec7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.068369:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.068387:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f2400/0xad6b7ddc146357d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceb2 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.068401:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.068405:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.068423:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.068433:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.068443:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.068453:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065081.068461:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068471:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068478:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065081.068483:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068488:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065081.068517:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c528380 reply state ffff880092911000 transno 4294975695 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.068522:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14635bc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.068525:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.068528:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14635bc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.068529:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.068532:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.068533:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14635bc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.068534:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1746065081.068539:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 0 00010000:00010000:1.0:1746065081.068584:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068589:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068593:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068598:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068603:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.068607:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068612:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068618:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:1.0:1746065081.068620:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.068623:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068627:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068639:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068642:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068646:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.068647:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27936:x1830881261492736:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 323us (664us total) trans 4294975695 rc 0/0 00010000:00010000:1.0:1746065081.068649:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dcc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.068652:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.068653:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12358 00010000:00010000:1.0:1746065081.068656:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068660:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72800) 00010000:00010000:1.0:1746065081.068662:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.068664:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068671:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc14635b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.068703:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc600/0xad6b7ddc14635a0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec7 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.068716:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14635bc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec7 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.068721:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:1.0:1746065081.068723:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065081.068724:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd200, rc 0) 00000100:00100000:1.0:1746065081.068747:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261492480:12345-192.168.202.27@tcp:101:bash.0 Request processed in 430us (825us total) trans 4294975696 rc 0/0 00000100:00100000:1.0:1746065081.068753:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12357 00000100:00100000:0.0:1746065081.070938:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.071995:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.072059:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261492992 00000100:00100000:3.0:1746065081.072066:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261492992 00000100:00100000:3.0:1746065081.072101:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12359 00000100:00100000:3.0:1746065081.072107:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261492992:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.072127:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.072141:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14635ca lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cece expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.072167:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14635d1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.072177:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14635d1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.072186:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14635d1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.072260:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8000/0xad6b7ddc14635ca lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cece expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.072275:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14635d1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cece expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.072281:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.072284:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065081.072286:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b9000, rc 0) 00000100:00100000:3.0:1746065081.072337:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261492992:12345-192.168.202.27@tcp:101:bash.0 Request processed in 229us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.072343:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12359 00000100:00100000:2.0:1746065081.072496:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261492864 00000100:00100000:2.0:1746065081.072501:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261492864 00000100:00100000:2.0:1746065081.072523:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8725 00000100:00100000:2.0:1746065081.072528:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261492864:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065081.072624:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065081.072627:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.072629:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb atime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.072630:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.072632:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065081.072652:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881261492864:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 123us (1720us total) trans 21474839882 rc 0/0 00000100:00100000:2.0:1746065081.072658:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8725 00000100:00100000:0.0:1746065081.075525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.075578:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.075639:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261493504 00000100:00100000:1.0:1746065081.075645:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261493504 00000100:00100000:1.0:1746065081.075677:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4256 00000100:00100000:1.0:1746065081.075683:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27936:x1830881261493504:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065081.075722:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x34d:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14634e3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce81 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.075754:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065081.075763:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 293 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.075793:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.075817:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 293 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.075827:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 293 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.075838:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262658944:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.075900:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261493376 00000100:00100000:2.0:1746065081.075904:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261493376 00000100:00100000:2.0:1746065081.075936:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12360 00000100:00100000:2.0:1746065081.075941:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261493376:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065081.075962:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.075973:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dd200/0xad6b7ddc14635bc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec7 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.075986:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065081.075989:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.076108:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.076116:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.076123:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:2.0:1746065081.076153:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975697 00000004:00010000:2.0:1746065081.076169:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c52b800 reply state ffff880099ba9000 transno 4294975698 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.076176:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.076182:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065081.076184:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.076186:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.076234:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261493376:12345-192.168.202.27@tcp:36:bash.0 Request processed in 292us (655us total) trans 4294975698 rc 0/0 00000100:00100000:2.0:1746065081.076240:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12360 00000020:00080000:2.0:1746065081.076244:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065081.076972:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.079276:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.079309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.079365:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261493632 00000100:00100000:3.0:1746065081.079371:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261493632 00000100:00100000:3.0:1746065081.079411:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12361 00000100:00100000:3.0:1746065081.079418:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261493632:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.079437:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.079451:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635e6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ced5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.079490:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635e6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ced5 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.079501:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635e6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ced5 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.079516:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.079519:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.079522:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8e00, rc 0) 00000100:00100000:3.0:1746065081.079566:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261493632:12345-192.168.202.27@tcp:101:bash.0 Request processed in 148us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.079572:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12361 00000100:00100000:1.0:1746065081.079730:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261493760 00000100:00100000:1.0:1746065081.079734:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261493760 00010000:00010000:1.0:1746065081.079749:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 297 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.079763:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3670 00000100:00100000:1.0:1746065081.079768:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+297:2005:x1830881261493760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.079794:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.079798:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 297 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.079807:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 297 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.079818:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:1.0:1746065081.079822:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.079829:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.079834:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.079846:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.079876:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+297:2005:x1830881261493760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.079881:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3670 00010000:00010000:1.0:1746065081.079911:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146356f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceab expref: 296 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.079921:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262658944:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.079934:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.079939:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.079943:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000040:00080000:1.0:1746065081.080094:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2465, 88 off203936 00000004:00080000:1.0:1746065081.080099:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677098325471ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.080126:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2469, 88 off204368 00000004:00080000:1.0:1746065081.080129:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677098355950ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.080164:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2470, 88 off204456 00000004:00080000:1.0:1746065081.080167:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677098393138ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.080180:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2466, 88 off204024 00000004:00080000:1.0:1746065081.080182:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677098409020ns, next at 677717578181ns, rc = 0 00000100:00100000:2.0:1746065081.083220:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.083243:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494016 00000100:00100000:2.0:1746065081.083250:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494016 00000100:00100000:2.0:1746065081.083283:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12362 00000100:00100000:2.0:1746065081.083290:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261494016:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.083306:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.083309:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065081.083328:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635e6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ced5 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.083342:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:2.0:1746065081.083346:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.083354:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc600/0xad6b7ddc14635ed lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cedc expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.083388:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14635f4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.083397:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14635f4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.083405:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14635f4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:2.0:1746065081.083571:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2471, 88 off204544 00000004:00080000:2.0:1746065081.083577:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677101802825ns, next at 677717559249ns, rc = 0 00000040:00080000:2.0:1746065081.083600:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2467, 88 off204112 00000004:00080000:2.0:1746065081.083603:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677101829265ns, next at 677717578181ns, rc = 0 00000040:00080000:2.0:1746065081.083614:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2468, 88 off204200 00000004:00080000:2.0:1746065081.083617:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677101843011ns, next at 677717578181ns, rc = 0 00000040:00080000:2.0:1746065081.083624:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2472, 88 off204632 00000004:00080000:2.0:1746065081.083626:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677101852945ns, next at 677717559249ns, rc = 0 00000001:00080000:2.0:1746065081.085182:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975699 is committed 00000004:00080000:2.0:1746065081.085189:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1658 committed 00000004:00080000:2.0:1746065081.085194:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1668 committed 00010000:00010000:3.0:1746065081.085216:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085225:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00000004:00080000:2.0:1746065081.085227:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1667 committed 00000004:00080000:2.0:1746065081.085229:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1657 committed 00010000:00010000:3.0:1746065081.085231:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085236:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.085239:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085245:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085255:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72800) 00010000:00010000:3.0:1746065081.085257:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.085260:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085265:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9e00/0xad6b7ddc146355a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085286:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085291:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085296:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085300:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4a25c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.085302:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085306:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085312:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.085313:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.085315:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085319:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc14635a7 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.085327:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085332:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065081.085333:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659200:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1746065081.085337:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085341:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.085342:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085347:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085356:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.085358:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.085360:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.085364:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc14635df lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065081.085373:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.085393:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065081.085397:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659072:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.085398:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659200 00000100:00100000:3.0:1746065081.085402:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659200 00000100:00100000:1.0:1746065081.085408:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.085426:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659072 00000100:00100000:3.0:1746065081.085427:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659072 00000100:00100000:1.0:1746065081.085433:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8726 00000100:00100000:1.0:1746065081.085443:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+128:3762:x1830881262659200:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.085451:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8727 00000100:00100000:3.0:1746065081.085457:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+128:3762:x1830881262659072:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065081.085535:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746065081.085535:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+130:3762:x1830881262659200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (162us total) trans 17179872604 rc 0/0 00002000:00010000:3.0:1746065081.085538:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:3.0:1746065081.085540:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746065081.085541:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8726 00002000:00010000:3.0:1746065081.085542:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:3.0:1746065081.085554:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x373:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.085579:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+129:3762:x1830881262659072:12345-0@lo:2:osp-syn-1-1.0 Request processed in 122us (170us total) trans 17179872603 rc 0/0 00000004:00080000:1.0:1746065081.085580:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf3100/2, rc 0, transno 17179872604 00000100:00100000:3.0:1746065081.085585:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8727 00000100:00100000:1.0:1746065081.085586:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659200:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065081.085595:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf2680/2, rc 0, transno 17179872603 00000100:00100000:1.0:1746065081.085597:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659072:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.085700:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262659456:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.085723:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.085738:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065081.085743:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262659328:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.085756:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.085792:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659456 00000100:00100000:0.0:1746065081.085797:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659456 00000100:00100000:3.0:1746065081.085808:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659328 00000100:00100000:3.0:1746065081.085811:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659328 00000100:00100000:0.0:1746065081.086077:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8728 00000100:00100000:0.0:1746065081.086084:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+95:3760:x1830881262659456:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.086174:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+96:3760:x1830881262659456:12345-0@lo:2:osp-syn-0-1.0 Request processed in 91us (449us total) trans 21474839883 rc 0/0 00000100:00100000:0.0:1746065081.086179:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8728 00000100:00100000:0.0:1746065081.086190:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8729 00000100:00100000:0.0:1746065081.086194:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+95:3760:x1830881262659328:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065081.086233:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065081.086235:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.086237:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb atime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.086238:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.086240:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x372:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065081.086256:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+96:3760:x1830881262659328:12345-0@lo:2:osp-syn-0-1.0 Request processed in 62us (499us total) trans 21474839884 rc 0/0 00000100:00100000:0.0:1746065081.086260:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8729 00000004:00080000:2.0:1746065081.086306:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528a80/2, rc 0, transno 21474839884 00000100:00100000:2.0:1746065081.086315:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262659328:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.086321:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528e00/2, rc 0, transno 21474839883 00000100:00100000:2.0:1746065081.086323:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262659456:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065081.086972:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c529f80 reply state ffff8800902c2c00 transno 4294975699 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.086985:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.086991:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:1.0:1746065081.086993:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065081.086995:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.086999:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:1.0:1746065081.087001:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065081.087013:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dca00/0xad6b7ddc14634e3 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce81 expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065081.087077:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065081.087095:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27936:x1830881261493504:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 11411us (11576us total) trans 4294975699 rc 0/0 00000100:00100000:1.0:1746065081.087101:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4256 00010000:00010000:3.0:1746065081.087120:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.087128:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.087133:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.087138:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.087141:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.087146:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.087154:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880095561a00) 00010000:00010000:3.0:1746065081.087156:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.087159:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.087163:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc200/0xad6b7ddc14635d8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00000100:00100000:2.0:1746065081.095558:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065081.095646:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975700 is committed 00000004:00080000:0.0:1746065081.095652:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1670 committed 00000004:00080000:0.0:1746065081.095665:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1660 committed 00000004:00080000:0.0:1746065081.095671:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1659 committed 00000004:00080000:0.0:1746065081.095673:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1669 committed 00000100:00100000:3.0:1746065081.095711:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494144 00000100:00100000:3.0:1746065081.095719:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494144 00000100:00100000:3.0:1746065081.095754:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12363 00000100:00100000:3.0:1746065081.095761:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27936:x1830881261494144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.095765:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14635f4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cedc expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.095790:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.095792:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.095793:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065081.095805:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f3dc600/0xad6b7ddc14635ed lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cedc expref: 285 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065081.095808:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635fb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cee3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.095820:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14635f4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cedc expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.095838:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065081.095840:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065081.095842:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488e00, rc 0) 00010000:00010000:3.0:1746065081.095847:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635fb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cee3 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.095855:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8e00/0xad6b7ddc14635fb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cee3 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.095864:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880098c34700) 00010000:00010000:3.0:1746065081.095866:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.095868:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8e00, rc 0) 00000100:00100000:0.0:1746065081.095876:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:26180:x1830881261494016:12345-192.168.202.27@tcp:101:bash.0 Request processed in 12587us (12664us total) trans 4294975700 rc 0/0 00000100:00100000:0.0:1746065081.095882:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12362 00000100:00100000:3.0:1746065081.095886:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+285:27936:x1830881261494144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 126us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.095892:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12363 00000100:00100000:1.0:1746065081.095947:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659712:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.095980:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.096013:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065081.096017:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659584:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.096037:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.096096:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262659840:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.096104:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009835ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262659968:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.096112:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.096126:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.096144:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659712 00000100:00100000:1.0:1746065081.096147:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659712 00000100:00100000:3.0:1746065081.096152:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659584 00000100:00100000:3.0:1746065081.096155:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659584 00000100:00100000:1.0:1746065081.096166:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659840 00000100:00100000:1.0:1746065081.096168:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659840 00000100:00100000:3.0:1746065081.096171:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659968 00000100:00100000:3.0:1746065081.096173:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659968 00000100:00100000:1.0:1746065081.096182:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8730 00000100:00100000:3.0:1746065081.096186:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8731 00000100:00100000:1.0:1746065081.096188:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+97:3762:x1830881262659712:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.096191:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+97:3762:x1830881262659584:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.096264:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8732 00000100:00100000:3.0:1746065081.096269:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+130:3759:x1830881262659840:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.096293:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+99:3762:x1830881262659712:12345-0@lo:2:osp-syn-0-1.0 Request processed in 105us (311us total) trans 21474839885 rc 0/0 00000100:00100000:1.0:1746065081.096298:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8730 00000100:00100000:1.0:1746065081.096309:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8733 00000100:00100000:1.0:1746065081.096314:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+131:3760:x1830881262659968:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.096337:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+131:3759:x1830881262659840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 68us (223us total) trans 17179872605 rc 0/0 00000100:00100000:3.0:1746065081.096343:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8732 00000100:00100000:1.0:1746065081.096370:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+131:3760:x1830881262659968:12345-0@lo:2:osp-syn-1-1.0 Request processed in 56us (243us total) trans 17179872606 rc 0/0 00000004:00080000:3.0:1746065081.096375:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098359180/2, rc 0, transno 17179872605 00000100:00100000:1.0:1746065081.096378:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8733 00000100:00100000:3.0:1746065081.096380:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262659840:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.096392:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009835ad80/2, rc 0, transno 17179872606 00000100:00100000:3.0:1746065081.096395:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262659968:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065081.096401:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098664a80/2, rc 0, transno 21474839885 00000100:00100000:1.0:1746065081.096405:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659712:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.096436:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+98:3762:x1830881262659584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 246us (398us total) trans 21474839886 rc 0/0 00000100:00100000:1.0:1746065081.096623:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8731 00000004:00080000:1.0:1746065081.096645:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098666a00/2, rc 0, transno 21474839886 00000100:00100000:1.0:1746065081.096648:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262659584:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.099716:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.105019:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.105394:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494400 00000100:00100000:1.0:1746065081.105402:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494400 00000100:00100000:1.0:1746065081.105435:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4257 00000100:00100000:1.0:1746065081.105442:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+284:27936:x1830881261494400:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065081.105627:0:7206:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x34d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065081.105670:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2469, 64 off204264 00000040:00080000:1.0:1746065081.105688:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2473, 64 off204696 00000040:00080000:1.0:1746065081.105695:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2474, 64 off204760 00000040:00080000:1.0:1746065081.105702:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2470, 64 off204328 00010000:00010000:1.0:1746065081.105739:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065081.105752:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.105761:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.105768:0:7206:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.105794:0:7206:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.105799:0:7206:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.105823:0:7206:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065081.105859:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065081.105866:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.105872:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009555b400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065081.105875:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.105882:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.105892:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34d:0x0].0x0 (ffff880098c34700) 00010000:00010000:3.0:1746065081.105894:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1746065081.105896:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494528 00010000:00010000:3.0:1746065081.105897:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00000100:00100000:2.0:1746065081.105900:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494528 00010000:00010000:3.0:1746065081.105902:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc1463602 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x34d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.105912:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065081.105914:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065081.105915:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065081.105921:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8734 00000100:00100000:2.0:1746065081.105925:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+54:26180:x1830881261494528:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.105933:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.105943:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ceea expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.105957:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.105969:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065081.105970:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27936:x1830881261494400:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 528us (6259us total) trans 4294975701 rc 0/0 00010000:00010000:2.0:1746065081.105971:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.105976:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 55 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.105976:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4257 00010000:00010000:2.0:1746065081.105988:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 55 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.105999:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc200, rc 0) 00000100:00100000:2.0:1746065081.106014:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+55:26180:x1830881261494528:12345-192.168.202.27@tcp:101:bash.0 Request processed in 89us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.106019:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8734 00000100:00100000:0.0:1746065081.110221:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.110889:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494656 00000100:00100000:2.0:1746065081.110897:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494656 00000100:00100000:2.0:1746065081.110933:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8735 00000100:00100000:2.0:1746065081.110940:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+45:26180:x1830881261494656:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.110953:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.110970:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cef1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.110988:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.111003:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.111005:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.111011:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 46 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.111024:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 46 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.111032:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc000, rc 0) 00000100:00100000:2.0:1746065081.111074:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881261494656:12345-192.168.202.27@tcp:101:bash.0 Request processed in 133us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.111080:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8735 00000100:00100000:0.0:1746065081.119704:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.119746:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.119762:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261495168 00000100:00100000:3.0:1746065081.119770:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261495168 00000100:00100000:3.0:1746065081.119858:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494784 00000100:00100000:3.0:1746065081.119860:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494784 00000100:00100000:0.0:1746065081.119879:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065081.119883:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/885 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.119886:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098664380 with x1830881261494784 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065081.119895:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098664380. 00000100:00100000:3.0:1746065081.119907:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261494912 00000100:00100000:3.0:1746065081.119908:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261494912 00002000:00010000:3.0:1746065081.119915:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/884 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.119917:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665c00 with x1830881261494912 ext(0->18446744073709551615) 00000100:00100000:0.0:1746065081.119920:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1283 00002000:00010000:3.0:1746065081.119921:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665c00. 00000100:00100000:0.0:1746065081.119929:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881261494784:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:3.0:1746065081.120249:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1284 00000100:00100000:3.0:1746065081.120255:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881261494912:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065081.120302:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.120305:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:0.0:1746065081.120307:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.120309:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:0.0:1746065081.120311:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1746065081.120326:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.120329:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.120330:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.120332:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.120334:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.120349:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881261494784:12345-192.168.202.27@tcp:10:bash.0 Request processed in 422us (602us total) trans 17179872607 rc 0/0 00000100:00100000:3.0:1746065081.120351:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261494912:12345-192.168.202.27@tcp:10:bash.0 Request processed in 96us (472us total) trans 21474839887 rc 0/0 00000100:00100000:0.0:1746065081.120356:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1283 00002000:00010000:0.0:1746065081.120359:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/885 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.120361:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098664380 with x1830881261494784 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.120365:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098664380. 00000100:00100000:3.0:1746065081.120803:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1284 00002000:00010000:3.0:1746065081.120806:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/884 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.120808:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665c00 with x1830881261494912 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065081.120812:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665c00. 00000100:00100000:3.0:1746065081.121126:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12364 00000100:00100000:3.0:1746065081.121132:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+285:27939:x1830881261495168:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.121146:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.121160:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463617 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cef8 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.121215:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.121224:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121233:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121242:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.121247:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121252:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121318:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.121324:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121330:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065081.121337:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 2 00010000:00010000:3.0:1746065081.121378:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121384:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121388:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121393:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121398:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.121401:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121406:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121415:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065081.121417:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.121421:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121425:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc146361e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121440:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121444:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121448:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121451:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.121453:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121457:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121462:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34000) 00010000:00010000:3.0:1746065081.121464:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.121466:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121469:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463625 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.121511:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463617 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 288 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.121521:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.121527:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.121528:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.121530:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25c00, rc 0) 00000100:00100000:3.0:1746065081.121568:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+287:27939:x1830881261495168:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 437us (1872us total) trans 4294975702 rc 0/0 00000100:00100000:3.0:1746065081.121574:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12364 00000100:00100000:2.0:1746065081.123104:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.123296:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261495424 00000100:00100000:1.0:1746065081.123304:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261495424 00000100:00100000:1.0:1746065081.123345:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4258 00000100:00100000:1.0:1746065081.123351:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261495424:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065081.123529:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261495424:12345-192.168.202.27@tcp:35:bash.0 Request processed in 178us (427us total) trans 4294975703 rc 0/0 00000100:00100000:1.0:1746065081.123535:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4258 00000100:00100000:0.0:1746065081.124848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.124892:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261495680 00000100:00100000:2.0:1746065081.124897:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261495680 00000100:00100000:2.0:1746065081.124930:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4259 00000100:00100000:2.0:1746065081.124937:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27939:x1830881261495680:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.125064:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27939:x1830881261495680:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 127us (216us total) trans 4294975704 rc 0/0 00000100:00100000:2.0:1746065081.125070:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4259 00000100:00100000:0.0:1746065081.144095:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.144227:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261495936 00000100:00100000:2.0:1746065081.144235:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261495936 00000100:00100000:2.0:1746065081.144292:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12365 00000100:00100000:2.0:1746065081.144299:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27939:x1830881261495936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.144323:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.144340:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146363a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92ceff expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.144439:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.144451:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.144457:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.144482:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.144496:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 290 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.144508:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098581180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262660096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.144603:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.145972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.146024:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261496192 00000100:00100000:3.0:1746065081.146029:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261496192 00000100:00100000:3.0:1746065081.146072:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12366 00000100:00100000:3.0:1746065081.146078:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27940:x1830881261496192:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065081.146107:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065081.146126:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc14635f4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cedc expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.146141:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 290 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.146152:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9000/0xad6b7ddc14635d1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cece expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.146161:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.146165:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.146171:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.146176:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.146187:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.146202:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.146208:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.146214:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.146222:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.146226:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.146230:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.146288:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.146294:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.146299:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.146307:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.146313:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.150580:0:7205:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880098581180 x1830881262660096) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 1/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 289 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.150597:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc146362c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef8 expref: 289 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.150610:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262660096:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.150625:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.150630:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.150636:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.150641:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.150648:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.150652:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.150672:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 5 00010000:00010000:3.0:1746065081.150764:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146363a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.150792:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.150799:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.150804:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc800, rc 0) 00000100:00100000:3.0:1746065081.150842:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27939:x1830881261495936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6539us (6750us total) trans 4294975705 rc 0/0 00000100:00100000:3.0:1746065081.150849:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12365 00000100:00100000:2.0:1746065081.157184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.157276:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261496320 00000100:00100000:0.0:1746065081.157284:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261496320 00010000:00010000:0.0:1746065081.157314:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.157350:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3671 00000100:00100000:0.0:1746065081.157357:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+289:2006:x1830881261496320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.157367:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.157372:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.157383:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.157399:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463641 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x34e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceff expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.157423:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:0.0:1746065081.157427:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.157435:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.157441:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.157531:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.157615:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157621:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065081.157811:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x34e:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1746065081.157864:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157871:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157876:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157885:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.157888:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157893:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157901:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.157904:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065081.157906:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157911:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b9400/0xad6b7ddc1463656 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157927:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157932:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157937:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157941:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157945:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4a24c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.157947:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157951:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157958:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34000) 00010000:00010000:3.0:1746065081.157960:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.157962:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc1463648 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065081.157976:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098664000 reply state ffff880092910000 transno 4294975706 ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157983:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.157988:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:3.0:1746065081.157990:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.157993:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065081.159564:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+290:2006:x1830881261496320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2200us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.159573:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3671 00000100:00100000:3.0:1746065081.159669:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27940:x1830881261496192:12345-192.168.202.27@tcp:36:rm.0 Request processed in 13590us (13699us total) trans 4294975706 rc 0/0 00000100:00100000:3.0:1746065081.159675:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12366 00000100:00100000:0.0:1746065081.161383:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.163059:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261496448 00000100:00100000:3.0:1746065081.163070:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261496448 00000100:00100000:3.0:1746065081.163129:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12367 00000100:00100000:3.0:1746065081.163137:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27939:x1830881261496448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.163159:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.163176:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463664 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf06 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.163248:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146366b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.163259:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146366b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.163269:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146366b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065081.163301:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 5 00000004:00200000:3.0:1746065081.163304:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065081.163316:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146366b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.163336:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b4a25800/0xad6b7ddc1463664 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf06 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.163348:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146366b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf06 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.163354:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065081.163356:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065081.163359:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c400, rc 0) 00000100:00100000:3.0:1746065081.163400:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27939:x1830881261496448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 265us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.163405:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12367 00000100:00100000:3.0:1746065081.174472:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.174941:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261496832 00000100:00100000:2.0:1746065081.174949:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261496832 00000100:00100000:2.0:1746065081.174986:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12368 00000100:00100000:2.0:1746065081.174992:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27939:x1830881261496832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.175009:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.175025:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc1463672 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf14 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.175115:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc1463679 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.175126:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc1463679 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.175135:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc1463679 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065081.175145:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 5 00010000:00010000:2.0:1746065081.175223:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc1463672 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf14 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.175256:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc1463679 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf14 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.175263:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:2.0:1746065081.175265:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.175268:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccd200, rc 0) 00000100:00100000:2.0:1746065081.175305:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27939:x1830881261496832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 313us (840us total) trans 4294975707 rc 0/0 00000100:00100000:2.0:1746065081.175311:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12368 00000100:00100000:0.0:1746065081.175857:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.175929:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261496576 00000100:00100000:3.0:1746065081.175933:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261496576 00000100:00100000:2.0:1746065081.177048:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12369 00000100:00100000:2.0:1746065081.177059:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27941:x1830881261496576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.177071:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.177082:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1463687 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf0d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.177120:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.177128:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177135:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177142:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.177147:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177152:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177181:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177189:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177194:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177199:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177203:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.177206:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177212:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177219:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065081.177222:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.177224:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177229:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146368e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177236:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177241:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177244:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177248:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.177250:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177254:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177259:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:2.0:1746065081.177261:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.177262:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177266:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c488e00/0xad6b7ddc1463695 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.177284:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1463687 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf0d expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.177290:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1463687 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf0d expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.177300:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cccc00, rc 0) 00000100:00100000:2.0:1746065081.177345:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27941:x1830881261496576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 289us (1489us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.177351:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12369 00000100:00100000:0.0:1746065081.180742:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.181082:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261496960 00000100:00100000:2.0:1746065081.181090:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261496960 00000100:00100000:2.0:1746065081.181562:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8736 00000100:00100000:2.0:1746065081.181570:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2007:x1830881261496960:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065081.181604:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.181625:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 56 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.181632:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.181634:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.181637:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.181660:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 56 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.181671:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 56 pid: 11461 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.181682:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262660224:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.181754:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.182741:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.182833:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261497088 00000100:00100000:3.0:1746065081.182838:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261497088 00000100:00100000:3.0:1746065081.182876:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12370 00000100:00100000:3.0:1746065081.182882:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27941:x1830881261497088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.182896:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.182909:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf1b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.182955:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.182964:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.182972:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.182980:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.182985:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.182990:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183017:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183022:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183027:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183031:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183036:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.183039:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183044:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183053:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34000) 00010000:00010000:3.0:1746065081.183055:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.183058:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183063:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636aa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183076:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183080:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183084:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183087:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.183089:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183092:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183096:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:3.0:1746065081.183098:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.183100:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183107:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636b1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.183126:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636a3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf1b expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.183133:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf1b expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.183144:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c000, rc 0) 00000100:00100000:3.0:1746065081.183173:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27941:x1830881261497088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 291us (434us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.183178:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12370 00000100:00100000:0.0:1746065081.186925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.186996:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261497216 00000100:00100000:3.0:1746065081.187003:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261497216 00002000:00100000:3.0:1746065081.187038:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x375:0x0] (0->4) req@ffff88012f09e680 x1830881261497216/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/0 e 0 to 0 dl 1746065092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065081.187047:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881261497216 ext(0->4) 00010000:00010000:3.0:1746065081.187054:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 57 pid: 11461 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.187066:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 57 pid: 11461 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746065081.187071:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09e680 00000100:00100000:3.0:1746065081.187086:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 221 00000100:00100000:3.0:1746065081.187092:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881261497216:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:2.0:1746065081.187588:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262660224:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.187606:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.187751:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881261497216:12345-192.168.202.27@tcp:4:bash.0 Request processed in 658us (832us total) trans 17179872608 rc 0/0 00000100:00100000:3.0:1746065081.187757:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 221 00002000:00100000:3.0:1746065081.187762:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x375:0x0] (0->4) req@ffff88012f09e680 x1830881261497216/t17179872608(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/448 e 0 to 0 dl 1746065092 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065081.187768:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881261497216 ext(0->4) 00010000:00010000:3.0:1746065081.187794:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 59 pid: 11461 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.187803:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 59 pid: 11461 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746065081.187808:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09e680 00000100:00100000:0.0:1746065081.188578:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.188630:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261497344 00000100:00100000:2.0:1746065081.188633:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261497344 00000100:00100000:2.0:1746065081.188662:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12371 00000100:00100000:2.0:1746065081.188667:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27941:x1830881261497344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.188678:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.188692:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf22 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.188730:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14636bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.188739:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14636bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.188746:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14636bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065081.188796:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1746065081.188800:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065081.188820:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf22 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.188833:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14636bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf22 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.188838:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065081.188841:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065081.188843:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:2.0:1746065081.188872:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27941:x1830881261497344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 204us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.188876:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12371 00000100:00100000:0.0:1746065081.191435:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.191527:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261497472 00000100:00100000:1.0:1746065081.191534:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261497472 00010000:00010000:1.0:1746065081.191594:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 59 pid: 11461 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.191618:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3672 00000100:00100000:1.0:1746065081.191624:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2007:x1830881261497472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.191635:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065081.191649:0:7191:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1746065081.191651:0:7191:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1746065081.191657:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 59 pid: 11461 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.191668:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 59 pid: 11461 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.191686:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ccc200/0xad6b7ddc1463609 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ceea expref: 59 pid: 11461 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.191714:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.191716:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.191721:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.191728:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.191756:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.191810:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2007:x1830881261497472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 185us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.191817:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3672 00010000:00010000:3.0:1746065081.193805:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193818:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193839:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193846:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193853:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193962:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065081.193967:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193974:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193988:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.193994:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146369c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.194058:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881261496960:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 12486us (13319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.194066:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8736 00000100:00100000:2.0:1746065081.194376:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.194583:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261497600 00000100:00100000:3.0:1746065081.194590:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261497600 00000100:00100000:3.0:1746065081.195568:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12372 00000100:00100000:3.0:1746065081.195576:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27941:x1830881261497600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.195591:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.195605:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14636c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf29 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.195655:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.195668:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195676:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195685:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.195690:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195694:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195723:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195729:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195733:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195737:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195741:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.195744:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195748:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195756:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:3.0:1746065081.195759:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.195762:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.195766:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14636cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065081.197887:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.197946:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.197953:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.197959:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.197964:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.197967:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.197971:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.197982:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:3.0:1746065081.197985:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.197988:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.197993:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14636d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.198030:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14636c6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf29 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.198041:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14636c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf29 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.198049:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d600, rc 0) 00000100:00100000:3.0:1746065081.198091:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27941:x1830881261497600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2515us (3714us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.198098:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12372 00000100:00100000:3.0:1746065081.198487:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261497856 00000100:00100000:3.0:1746065081.198494:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261497856 00000100:00100000:3.0:1746065081.198525:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12373 00000100:00100000:3.0:1746065081.198531:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27939:x1830881261497856:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065081.198570:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.198582:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146366b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf06 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.198591:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065081.198594:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.198611:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.198620:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.198626:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:3.0:1746065081.198907:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2476, 88 off204888 00000004:00080000:3.0:1746065081.198913:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677217139035ns, next at 677717559249ns, rc = 0 00000040:00080000:3.0:1746065081.198963:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2471, 88 off204416 00000004:00080000:3.0:1746065081.198966:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677217192833ns, next at 677717578181ns, rc = 0 00000040:00080000:3.0:1746065081.198979:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2472, 88 off204504 00000004:00080000:3.0:1746065081.198982:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677217208082ns, next at 677717578181ns, rc = 0 00000040:00080000:3.0:1746065081.198990:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2477, 88 off204976 00000004:00080000:3.0:1746065081.198992:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677217218943ns, next at 677717559249ns, rc = 0 00000100:00100000:0.0:1746065081.200556:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.200677:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261498112 00000100:00100000:2.0:1746065081.200683:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261498112 00000100:00100000:2.0:1746065081.200726:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12374 00000100:00100000:2.0:1746065081.200733:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27941:x1830881261498112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.200749:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.200752:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065081.200767:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489a00/0xad6b7ddc14636bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf22 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.200804:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065081.200811:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.200820:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc14636e2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf30 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.200886:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.200895:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.200901:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.200907:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.200913:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.200917:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205020:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065081.205035:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205044:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:1.0:1746065081.205054:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x350:0x0]: returning size 0 00010000:00010000:1.0:1746065081.205077:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205082:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205086:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205091:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205095:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccc200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.205098:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205104:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205113:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd700) 00010000:00010000:1.0:1746065081.205115:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.205118:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205122:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14636e9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:1.0:1746065081.205136:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f09d180 reply state ffff88008ec56000 transno 4294975709 ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205144:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.205149:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:1.0:1746065081.205151:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065081.205154:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.205182:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489000/0xad6b7ddc14636e2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.205197:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.205203:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:1.0:1746065081.205205:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065081.205207:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009555b400, rc 0) 00000100:00100000:1.0:1746065081.205259:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27941:x1830881261498112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4526us (4717us total) trans 4294975709 rc 0/0 00000100:00100000:1.0:1746065081.205267:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12374 00000001:00080000:3.0:1746065081.206758:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975708 is committed 00000004:00080000:3.0:1746065081.206767:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1672 committed 00000004:00080000:3.0:1746065081.206802:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1662 committed 00000004:00080000:3.0:1746065081.206807:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1661 committed 00000004:00080000:3.0:1746065081.206809:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1671 committed 00000004:00010000:2.0:1746065081.206893:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f09c380 reply state ffff88009abb4000 transno 4294975708 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.206906:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.206912:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:2.0:1746065081.206915:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065081.206918:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065081.206977:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065081.206982:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009835aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262660480:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.206986:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27939:x1830881261497856:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 8454us (9104us total) trans 4294975708 rc 0/0 00000100:00100000:2.0:1746065081.206992:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12373 00000100:00100000:1.0:1746065081.207022:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.207060:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065081.207065:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262660352:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.207081:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.207103:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262660480 00000100:00100000:1.0:1746065081.207109:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262660480 00000100:00100000:1.0:1746065081.207132:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262660352 00000100:00100000:1.0:1746065081.207134:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262660352 00000100:00100000:1.0:1746065081.207145:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8737 00000100:00100000:1.0:1746065081.207150:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+132:3762:x1830881262660480:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065081.207169:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:884 count 1 00000100:00100000:3.0:1746065081.207233:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262660608:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.207255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.207272:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065081.207276:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262660736:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.207290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065081.207311:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.207317:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.207322:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.207327:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.207329:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.207334:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.207343:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065081.207345:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.207347:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.207351:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14636db lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.210631:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262660608 00000100:00100000:2.0:1746065081.210641:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262660608 00000100:00100000:2.0:1746065081.210686:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262660736 00000100:00100000:2.0:1746065081.210689:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262660736 00000100:00100000:2.0:1746065081.210707:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8738 00000100:00100000:2.0:1746065081.210714:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+134:3762:x1830881262660352:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065081.210739:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:883 count 1 00010000:00010000:2.0:1746065081.210759:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.210804:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 56 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.210812:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.210814:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.210816:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.210844:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 56 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.210855:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 56 pid: 12260 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.210867:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262660864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.210932:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00002000:00010000:1.0:1746065081.211113:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.211120:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211131:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.211132:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.211136:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211145:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211152:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211158:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211171:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.211208:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.211214:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.211222:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.211226:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.211229:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.211233:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.211244:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:0.0:1746065081.211246:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.211249:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.211253:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc146364f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065081.211280:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8739 00000100:00100000:0.0:1746065081.211287:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+135:3759:x1830881262660608:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.211342:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+136:3762:x1830881262660480:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4190us (4318us total) trans 17179872609 rc 0/0 00000100:00100000:1.0:1746065081.211347:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8737 00000100:00100000:0.0:1746065081.211362:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+135:3759:x1830881262660608:12345-0@lo:2:osp-syn-1-1.0 Request processed in 77us (4106us total) trans 17179872610 rc 0/0 00000100:00100000:1.0:1746065081.211363:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8740 00000100:00100000:1.0:1746065081.211367:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+135:3759:x1830881262660736:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.211367:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8739 00000100:00100000:1.0:1746065081.211417:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+135:3759:x1830881262660736:12345-0@lo:2:osp-syn-1-1.0 Request processed in 50us (4126us total) trans 17179872611 rc 0/0 00000100:00100000:1.0:1746065081.211422:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8740 00000100:00100000:0.0:1746065081.211427:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262660992:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.211440:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262661120:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.211447:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.211457:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262660992 00000100:00100000:1.0:1746065081.211460:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262660992 00000100:00100000:1.0:1746065081.211473:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8741 00000100:00100000:1.0:1746065081.211477:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+98:3761:x1830881262660992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065081.211487:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:882 count 1 00010000:00010000:1.0:1746065081.211499:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211509:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 46 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065081.211514:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.211515:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.211517:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211532:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 46 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065081.211539:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 46 pid: 11461 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.211557:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262661504:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.211586:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.211597:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065081.211623:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009835aa00/2, rc 0, transno 17179872609 00000100:00100000:1.0:1746065081.211628:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262660480:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.211643:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262661120 00000100:00100000:1.0:1746065081.211646:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262661120 00000100:00100000:1.0:1746065081.211661:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8742 00000100:00100000:1.0:1746065081.211665:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+99:3762:x1830881262661120:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065081.211675:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:883 count 1 00002000:00010000:1.0:1746065081.211687:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.211691:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211697:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.211698:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.211700:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211709:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211714:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211720:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.211726:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262661376:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065081.211728:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065081.211748:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.211762:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065081.211766:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262661248:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.211795:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.211810:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262661376 00000100:00100000:3.0:1746065081.211813:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262661376 00000100:00100000:3.0:1746065081.211825:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262661248 00000100:00100000:3.0:1746065081.211827:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262661248 00000100:00100000:3.0:1746065081.211836:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8743 00000100:00100000:3.0:1746065081.211840:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+102:3760:x1830881262661376:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.211880:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+103:3762:x1830881262661120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 214us (281us total) trans 21474839888 rc 0/0 00000100:00100000:1.0:1746065081.211885:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8742 00000100:00100000:3.0:1746065081.211890:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+103:3760:x1830881262661376:12345-0@lo:2:osp-syn-0-1.0 Request processed in 49us (141us total) trans 21474839889 rc 0/0 00000100:00100000:3.0:1746065081.211894:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8743 00000100:00100000:1.0:1746065081.211896:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8744 00000100:00100000:1.0:1746065081.211901:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+101:3760:x1830881262661248:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.211915:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f54e00/2, rc 0, transno 17179872611 00000100:00100000:3.0:1746065081.211918:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262660736:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.211925:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095f57b80/2, rc 0, transno 17179872610 00000100:00100000:3.0:1746065081.211927:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262660608:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065081.211936:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065081.211939:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00000004:00080000:3.0:1746065081.211940:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09f480/2, rc 0, transno 21474839889 00002000:00010000:1.0:1746065081.211941:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746065081.211943:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262661376:0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065081.211943:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:1.0:1746065081.211945:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065081.211963:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+102:3760:x1830881262661248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 63us (168us total) trans 21474839890 rc 0/0 00000004:00080000:3.0:1746065081.211965:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09df80/2, rc 0, transno 21474839890 00000100:00100000:3.0:1746065081.211967:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262661248:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.211968:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8744 00010000:00010000:1.0:1746065081.211979:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065081.211983:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211989:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.211992:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.211998:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212008:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212013:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146370c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212025:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065081.212027:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212032:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.212035:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212041:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.212044:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.212048:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212053:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131bef000/0xad6b7ddc146371a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.212060:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.212061:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.212062:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065081.212077:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09c000/2, rc 0, transno 21474839888 00000100:00100000:1.0:1746065081.212080:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262661120:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.212084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.212100:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261498368 00000100:00100000:2.0:1746065081.212103:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261498368 00000100:00100000:2.0:1746065081.212130:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12375 00000100:00100000:2.0:1746065081.212134:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27941:x1830881261498368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.212143:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.212152:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463721 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf37 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.212227:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.212236:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.212241:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.212256:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 287 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.212263:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 287 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.212271:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098583100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262661632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.212301:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.213299:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.213359:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261498496 00000100:00100000:3.0:1746065081.213364:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261498496 00000100:00100000:3.0:1746065081.213388:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12376 00000100:00100000:3.0:1746065081.213394:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27939:x1830881261498496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.213405:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.213413:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf3e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.213440:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.213450:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 289 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.213462:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065081.213465:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.213467:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8400, rc 0) 00000100:00100000:3.0:1746065081.213500:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27939:x1830881261498496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.213505:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12376 00000100:00100000:2.0:1746065081.214072:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.214087:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.214108:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.214171:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098583100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262661632:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.214185:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065081.214186:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881262661504:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.214198:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.214213:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261498752 00000100:00100000:1.0:1746065081.214216:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261498752 00010000:00010000:1.0:1746065081.214229:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 47 pid: 11461 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746065081.214244:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261498624 00000100:00100000:0.0:1746065081.214247:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261498624 00000100:00100000:1.0:1746065081.214257:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261498880 00000100:00100000:1.0:1746065081.214259:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261498880 00010000:00010000:0.0:1746065081.214261:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 57 pid: 12260 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.214268:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.214287:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3673 00000100:00100000:0.0:1746065081.214292:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881261498752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.214302:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.214306:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 47 pid: 11461 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.214313:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 47 pid: 11461 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.214329:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1463592 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cec0 expref: 47 pid: 11461 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.214339:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.214341:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.214343:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214350:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214366:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.214384:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881261498752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.214389:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3673 00000100:00100000:0.0:1746065081.214400:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3674 00000100:00100000:0.0:1746065081.214405:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+57:2006:x1830881261498624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.214411:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.214414:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 57 pid: 12260 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.214420:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 57 pid: 12260 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.214430:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.214432:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.214434:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214438:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214446:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.214458:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+57:2006:x1830881261498624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.214463:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3674 00000100:00100000:0.0:1746065081.214492:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3675 00000100:00100000:0.0:1746065081.214496:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+289:2006:x1830881261498880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.214502:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.214505:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.214513:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.214526:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc14636f7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf30 expref: 289 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.214536:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:0.0:1746065081.214539:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.214554:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.214558:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.214569:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.214584:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+288:2006:x1830881261498880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.214588:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3675 00010000:00010000:1.0:1746065081.214691:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214699:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214707:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214713:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214725:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.214748:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc1463488 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92ce65 expref: 56 pid: 12260 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.214756:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262660864:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065081.214765:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214770:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214792:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214798:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214803:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.214812:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065081.214931:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+102:3761:x1830881262660992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3451us (3482us total) trans 21474839891 rc 0/0 00000100:00100000:0.0:1746065081.214931:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+135:3762:x1830881262660352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4217us (7847us total) trans 17179872612 rc 0/0 00000100:00100000:0.0:1746065081.214938:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8738 00000100:00100000:1.0:1746065081.214949:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8741 00010000:00010000:1.0:1746065081.214963:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065081.214968:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214974:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e4e200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.214977:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.214978:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.214983:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.214984:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214993:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.214998:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e4e200/0xad6b7ddc1463713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746065081.214999:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x350:0x0]: returning size 0 00010000:00010000:1.0:1746065081.215009:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065081.215011:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.215016:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.215017:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.215022:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.215028:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.215032:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7c00/0xad6b7ddc1463705 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.215040:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.215041:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.215043:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065081.215062:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098359880/2, rc 0, transno 17179872612 00000100:00100000:1.0:1746065081.215066:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262660352:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.215110:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x376:0x0], index 0: 0 00000004:00080000:3.0:1746065081.215115:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x377:0x0], index 1: 0 00000004:00080000:3.0:1746065081.215118:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x378:0x0], index 1: 0 00000004:00080000:3.0:1746065081.215121:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x377:0x0], index 0: 0 00010000:00010000:3.0:1746065081.215190:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215196:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215200:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215204:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.215207:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215211:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215218:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:3.0:1746065081.215220:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.215222:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215229:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463728 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.215264:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463721 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x350:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf37 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.215270:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463721 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x350:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf37 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.215279:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6a00, rc 0) 00000100:00100000:3.0:1746065081.215303:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27941:x1830881261498368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3168us (3218us total) trans 4294975710 rc 301/301 00000100:00100000:3.0:1746065081.215308:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12375 00000004:00080000:0.0:1746065081.215675:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09ca80/2, rc 0, transno 21474839891 00000100:00100000:0.0:1746065081.215680:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262660992:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065081.215755:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.217330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.217412:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261499136 00000100:00100000:2.0:1746065081.217418:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261499136 00000100:00100000:2.0:1746065081.217462:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4260 00000100:00100000:2.0:1746065081.217469:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27941:x1830881261499136:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.217669:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27941:x1830881261499136:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 200us (342us total) trans 4294975711 rc 0/0 00000100:00100000:2.0:1746065081.217675:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4260 00000100:00100000:3.0:1746065081.218122:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.218163:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261499264 00000100:00100000:2.0:1746065081.218167:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261499264 00000100:00100000:2.0:1746065081.218202:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12377 00000100:00100000:2.0:1746065081.218210:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27939:x1830881261499264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.218221:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.218235:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146373d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf45 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.218272:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463744 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.218282:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463744 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.218291:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463744 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.218315:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x34e:0x0]: returning size 5 00000004:00200000:2.0:1746065081.218319:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.218328:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463744 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.218346:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc146373d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf45 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.218357:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463744 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf45 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.218363:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:2.0:1746065081.218365:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065081.218368:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7e00, rc 0) 00000100:00100000:2.0:1746065081.218402:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27939:x1830881261499264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 194us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.218407:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12377 00000100:00100000:0.0:1746065081.219499:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.219604:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261499520 00000100:00100000:1.0:1746065081.219608:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261499520 00000100:00100000:1.0:1746065081.219643:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4261 00000100:00100000:1.0:1746065081.219649:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27941:x1830881261499520:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.219763:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27941:x1830881261499520:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 113us (264us total) trans 4294975712 rc 0/0 00000100:00100000:1.0:1746065081.219768:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4261 00000100:00100000:0.0:1746065081.220713:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.220804:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261499648 00000100:00100000:2.0:1746065081.220808:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261499648 00000100:00100000:1.0:1746065081.220980:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8745 00000100:00100000:1.0:1746065081.220987:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881261499648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.220997:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.221011:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf4c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.221027:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x375:0x0] initial LVB size: 5, mtime: 0x6812d6b9, atime: 0x0, ctime: 0x6812d6b9, blocks: 0x8 00010000:00010000:1.0:1746065081.221039:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.221040:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.221047:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 57 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065081.221058:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 57 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065081.221066:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee800, rc 0) 00000100:00100000:1.0:1746065081.221230:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261499648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 242us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.221238:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8745 00000100:00100000:0.0:1746065081.223042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.223192:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261499904 00000100:00100000:1.0:1746065081.223197:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261499904 00000100:00100000:1.0:1746065081.223247:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12378 00000100:00100000:1.0:1746065081.223254:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261499904:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.223272:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.223287:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463752 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf53 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.223404:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.223415:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223423:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223432:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.223438:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223443:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065081.223459:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065081.223480:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463767 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.223486:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463767 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223494:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463767 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065081.223502:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x350:0x0]: returning size 0 00010000:00010000:1.0:1746065081.223572:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223578:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223582:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223587:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223591:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e4e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.223641:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223649:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223658:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065081.223661:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.223664:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223668:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463759 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223677:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223684:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223687:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223691:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.223692:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223696:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223700:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:1.0:1746065081.223701:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.223702:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223704:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463760 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.223726:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463752 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf53 expref: 293 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.223735:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463767 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf53 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.223739:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065081.223740:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065081.223741:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc800, rc 0) 00000100:00100000:1.0:1746065081.223803:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261499904:12345-192.168.202.27@tcp:101:bash.0 Request processed in 549us (766us total) trans 4294975713 rc 0/0 00000100:00100000:1.0:1746065081.223807:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12378 00000100:00100000:1.0:1746065081.223822:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261500032 00000100:00100000:1.0:1746065081.223824:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261500032 00000100:00100000:1.0:1746065081.223840:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8746 00000100:00100000:1.0:1746065081.223843:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881261500032:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065081.223879:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881261500032:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 35us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.223883:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8746 00000100:00100000:0.0:1746065081.227395:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.227442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.227881:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261500288 00000100:00100000:2.0:1746065081.227888:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261500288 00000100:00100000:2.0:1746065081.227931:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12379 00000100:00100000:2.0:1746065081.227943:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261500288:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.227967:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.227985:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc1463775 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf5a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.228016:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc146377c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.228027:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc146377c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.228036:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc146377c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.228116:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc1463775 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf5a expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.228143:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc146377c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf5a expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.228149:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065081.228151:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065081.228154:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6800, rc 0) 00000100:00100000:2.0:1746065081.228199:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:26180:x1830881261500288:12345-192.168.202.27@tcp:101:bash.0 Request processed in 260us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.228205:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12379 00000100:00100000:3.0:1746065081.228267:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261500160 00000100:00100000:3.0:1746065081.228271:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261500160 00000100:00100000:3.0:1746065081.228291:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8747 00000100:00100000:3.0:1746065081.228296:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881261500160:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065081.228350:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881261500160:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 53us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.228355:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8747 00000100:00100000:0.0:1746065081.231195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.231238:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.231249:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261500544 00000100:00100000:2.0:1746065081.231256:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261500544 00000100:00100000:2.0:1746065081.231294:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261500800 00000100:00100000:2.0:1746065081.231296:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261500800 00000100:00100000:2.0:1746065081.231313:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12380 00000100:00100000:2.0:1746065081.231319:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261500544:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:0.0:1746065081.231338:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12381 00000100:00100000:0.0:1746065081.231346:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27939:x1830881261500800:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065081.231352:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.231364:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.231369:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1463767 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf53 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.231375:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463744 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf45 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.231386:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065081.231389:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.231434:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:0.0:1746065081.231438:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.231458:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.231469:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.231476:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.231518:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00000004:00010000:0.0:1746065081.231520:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009abc3800 reply state ffff88009ae64000 transno 4294975715 ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.231525:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.231525:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.231528:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:0.0:1746065081.231530:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.231531:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.231531:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1746065081.231565:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975714 00000004:00010000:2.0:1746065081.231581:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b25450 reply state ffff880099baa000 transno 4294975716 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.231587:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27939:x1830881261500800:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 242us (348us total) trans 4294975715 rc 0/0 00010000:00010000:2.0:1746065081.231589:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.231591:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12381 00010000:00010000:2.0:1746065081.231593:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065081.231595:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.231597:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.231632:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261500544:12345-192.168.202.27@tcp:36:bash.0 Request processed in 313us (443us total) trans 4294975716 rc 0/0 00000100:00100000:2.0:1746065081.231638:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12380 00000020:00080000:2.0:1746065081.231640:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065081.233586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.234422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.234443:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261501056 00000100:00100000:2.0:1746065081.234450:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261501056 00000100:00100000:1.0:1746065081.234481:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261500928 00000100:00100000:1.0:1746065081.234485:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261500928 00000100:00100000:2.0:1746065081.234493:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8748 00000100:00100000:2.0:1746065081.234500:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881261501056:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:1.0:1746065081.234508:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12382 00000100:00100000:1.0:1746065081.234513:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261500928:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.234527:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.234541:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463791 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf61 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.234586:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463791 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf61 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.234597:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463791 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf61 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.234609:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065081.234611:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.234614:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c400, rc 0) 00002000:00010000:2.0:1746065081.234615:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065081.234618:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.234620:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb atime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.234621:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.234623:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1746065081.234723:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261500928:12345-192.168.202.27@tcp:101:bash.0 Request processed in 208us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.234729:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12382 00000100:00100000:2.0:1746065081.234913:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+58:2007:x1830881261501056:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 413us (491us total) trans 17179872613 rc 0/0 00000100:00100000:2.0:1746065081.234919:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8748 00000100:00100000:1.0:1746065081.239255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.239955:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261501312 00000100:00100000:2.0:1746065081.239963:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261501312 00000100:00100000:2.0:1746065081.240005:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12383 00000100:00100000:2.0:1746065081.240012:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261501312:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.240031:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.240034:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065081.240055:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463791 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf61 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.240068:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065081.240072:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.240080:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6200/0xad6b7ddc1463798 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf68 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.240118:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146379f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.240127:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146379f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.240134:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146379f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:2.0:1746065081.240297:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2473, 88 off204592 00000004:00080000:2.0:1746065081.240302:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677258527900ns, next at 677717578181ns, rc = 0 00000040:00080000:2.0:1746065081.240326:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2478, 88 off205064 00000004:00080000:2.0:1746065081.240329:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677258555687ns, next at 677717559249ns, rc = 0 00000040:00080000:2.0:1746065081.240349:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2479, 88 off205152 00000004:00080000:2.0:1746065081.240351:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677258577607ns, next at 677717559249ns, rc = 0 00000040:00080000:2.0:1746065081.240358:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2474, 88 off204680 00000004:00080000:2.0:1746065081.240361:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677258587379ns, next at 677717578181ns, rc = 0 00000100:00100000:1.0:1746065081.240741:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.241252:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261501568 00000100:00100000:1.0:1746065081.241257:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261501568 00000100:00100000:1.0:1746065081.241281:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4262 00000100:00100000:1.0:1746065081.241287:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27939:x1830881261501568:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065081.241321:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x34e:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc1463679 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf14 expref: 299 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.241344:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065081.241352:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.241359:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.241381:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.241391:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 299 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.241401:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262661760:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.242723:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9d80 going to sleep for 11 seconds 00000001:00080000:3.0:1746065081.245239:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975717 is committed 00000004:00080000:3.0:1746065081.245248:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1664 committed 00000004:00080000:3.0:1746065081.245264:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1674 committed 00000004:00080000:3.0:1746065081.245269:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1673 committed 00000004:00080000:3.0:1746065081.245270:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1663 committed 00010000:00010000:0.0:1746065081.245348:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245358:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.245364:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146379f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x350:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf68 expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.245367:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245373:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cccc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.245374:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065081.245376:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.245377:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065081.245381:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.245389:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6200/0xad6b7ddc1463798 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf68 expref: 291 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065081.245390:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34800) 00010000:00010000:0.0:1746065081.245392:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.245395:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245399:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14636f0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.245403:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146379f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x350:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf68 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.245425:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065081.245427:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065081.245430:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7000, rc 0) 00010000:00010000:0.0:1746065081.245433:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245438:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245443:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245447:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.245449:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245453:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245460:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:0.0:1746065081.245462:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.245464:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245468:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc1463783 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.245476:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.245480:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261501312:12345-192.168.202.27@tcp:101:bash.0 Request processed in 5465us (6230us total) trans 4294975717 rc 0/0 00010000:00010000:0.0:1746065081.245480:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.245484:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.245488:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12383 00010000:00010000:0.0:1746065081.245488:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.245489:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.245493:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.245498:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:0.0:1746065081.245500:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.245502:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.245506:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146378a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x350:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065081.245598:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262662016:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.245635:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.245830:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262661888:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.245852:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.245928:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662016 00000100:00100000:3.0:1746065081.245934:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662016 00000100:00100000:3.0:1746065081.245958:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262661888 00000100:00100000:3.0:1746065081.245960:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262661888 00000100:00100000:3.0:1746065081.245971:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8749 00000100:00100000:3.0:1746065081.245977:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+103:3762:x1830881262662016:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.246086:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+104:3762:x1830881262662016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (451us total) trans 21474839892 rc 0/0 00000100:00100000:3.0:1746065081.246092:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8749 00000100:00100000:3.0:1746065081.246103:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8750 00000100:00100000:3.0:1746065081.246107:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+103:3761:x1830881262661888:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.246160:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+104:3761:x1830881262661888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 52us (306us total) trans 21474839893 rc 0/0 00000100:00100000:3.0:1746065081.246165:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8750 00000004:00080000:3.0:1746065081.246192:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf7b80/2, rc 0, transno 21474839893 00000100:00100000:3.0:1746065081.246196:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262661888:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065081.247036:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf5500/2, rc 0, transno 21474839892 00000100:00100000:1.0:1746065081.247041:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262662016:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.247135:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262662144:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.247159:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.247173:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065081.247178:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262662272:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.247191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.247450:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662144 00000100:00100000:0.0:1746065081.247454:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662144 00000100:00100000:0.0:1746065081.247478:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662272 00000100:00100000:0.0:1746065081.247480:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662272 00000100:00100000:0.0:1746065081.247490:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8751 00000100:00100000:0.0:1746065081.247495:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+136:3759:x1830881262662144:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.247583:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+137:3759:x1830881262662144:12345-0@lo:2:osp-syn-1-1.0 Request processed in 87us (422us total) trans 17179872614 rc 0/0 00000100:00100000:0.0:1746065081.247588:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8751 00000100:00100000:0.0:1746065081.247598:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8752 00000100:00100000:0.0:1746065081.247602:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+136:3759:x1830881262662272:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.247645:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+137:3759:x1830881262662272:12345-0@lo:2:osp-syn-1-1.0 Request processed in 44us (453us total) trans 17179872615 rc 0/0 00000004:00080000:3.0:1746065081.247719:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc0e00/2, rc 0, transno 17179872615 00000100:00100000:3.0:1746065081.247723:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262662272:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.247729:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc1880/2, rc 0, transno 17179872614 00000100:00100000:3.0:1746065081.247732:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262662144:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.249036:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:7206:1830881262661760:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.249053:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000100:00100000:0.0:1746065081.250642:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8752 00000100:00100000:1.0:1746065081.250735:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.250797:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261501696 00000100:00100000:2.0:1746065081.250803:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261501696 00010000:00010000:2.0:1746065081.250828:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 287 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.250859:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3676 00000100:00100000:2.0:1746065081.250865:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+287:2004:x1830881261501696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.250874:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.250878:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 287 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.250888:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 287 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.250906:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146372f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf3e expref: 287 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.250917:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:2.0:1746065081.250920:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065081.250928:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065081.250933:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT1 00010000:00010000:2.0:1746065081.250948:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065081.250978:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+286:2004:x1830881261501696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.250984:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3676 00010000:00010000:1.0:1746065081.251180:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.251186:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00000040:00080000:1.0:1746065081.251393:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2480, 88 off205240 00000004:00080000:1.0:1746065081.251399:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677269624587ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.251435:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2475, 88 off204768 00000004:00080000:1.0:1746065081.251439:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677269665195ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.252125:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2477, 88 off204888 00000004:00080000:1.0:1746065081.252130:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677270356719ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.252414:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2481, 88 off205328 00000004:00080000:1.0:1746065081.252418:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677270644803ns, next at 677717559249ns, rc = 0 00000100:00100000:0.0:1746065081.256677:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.256755:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261501824 00000100:00100000:1.0:1746065081.256763:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261501824 00000100:00100000:1.0:1746065081.256905:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8753 00000100:00100000:1.0:1746065081.256914:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+46:26180:x1830881261501824:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.256930:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.256946:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf6f expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.256966:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.256985:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.256986:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.256994:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.257007:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 47 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.257016:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:1.0:1746065081.257388:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+47:26180:x1830881261501824:12345-192.168.202.27@tcp:101:bash.0 Request processed in 474us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.257395:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8753 00000001:00080000:3.0:1746065081.260631:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975718 is committed 00000004:00080000:3.0:1746065081.260641:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1676 committed 00000004:00080000:3.0:1746065081.260655:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1666 committed 00000100:00100000:1.0:1746065081.261254:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262662528:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.261307:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.261346:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065081.261351:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262662400:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.261368:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065081.261420:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1665 committed 00000004:00080000:3.0:1746065081.261423:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1675 committed 00000100:00100000:3.0:1746065081.261741:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262662656:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065081.261850:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880076cf4700 reply state ffff88009af0f000 transno 4294975718 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.261865:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:1.0:1746065081.261873:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:1.0:1746065081.261876:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065081.261879:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.261883:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:1.0:1746065081.261885:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065081.261890:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc1463679 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf14 expref: 285 pid: 7205 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065081.261957:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065081.261966:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+285:27939:x1830881261501568:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 20679us (21225us total) trans 4294975718 rc 0/0 00000100:00100000:1.0:1746065081.261974:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4262 00000100:00100000:1.0:1746065081.262028:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.262218:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.262225:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.262231:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.262236:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.262239:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.262244:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.262252:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065081.262254:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.262256:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00010000:00010000:3.0:1746065081.262260:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d07200/0xad6b7ddc14637a6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT1 00000100:00100000:3.0:1746065081.262284:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262662784:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.262787:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.262951:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662528 00000100:00100000:0.0:1746065081.262957:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662528 00000100:00100000:0.0:1746065081.262980:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662400 00000100:00100000:0.0:1746065081.262982:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662400 00000100:00100000:0.0:1746065081.262989:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261501952 00000100:00100000:0.0:1746065081.262990:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261501952 00000100:00100000:0.0:1746065081.263001:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8754 00000100:00100000:0.0:1746065081.263005:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+138:3762:x1830881262662528:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.263107:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+139:3762:x1830881262662528:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (1801us total) trans 17179872616 rc 0/0 00000100:00100000:0.0:1746065081.263112:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8754 00000100:00100000:0.0:1746065081.263121:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8755 00000100:00100000:0.0:1746065081.263125:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+138:3762:x1830881262662400:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065081.263157:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065081.263159:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.263161:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb atime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.263163:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.263164:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x375:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065081.263178:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+139:3762:x1830881262662400:12345-0@lo:2:osp-syn-1-1.0 Request processed in 53us (1810us total) trans 17179872617 rc 0/0 00000100:00100000:0.0:1746065081.263182:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8755 00000100:00100000:0.0:1746065081.263189:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8756 00000100:00100000:0.0:1746065081.263193:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+58:26180:x1830881261501952:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:0.0:1746065081.263200:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.263211:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf76 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065081.263220:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065081.263231:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.263232:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.263237:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 59 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.263246:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 59 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.263253:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bd3800, rc 0) 00000100:00100000:0.0:1746065081.263269:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+59:26180:x1830881261501952:12345-192.168.202.27@tcp:101:bash.0 Request processed in 75us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.263274:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8756 00000004:00080000:1.0:1746065081.263541:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc3100/2, rc 0, transno 17179872617 00000100:00100000:1.0:1746065081.263556:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262662400:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1746065081.263566:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc1f80/2, rc 0, transno 17179872616 00000100:00100000:1.0:1746065081.263569:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262662528:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.263850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.263899:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662784 00000100:00100000:1.0:1746065081.263903:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662784 00000100:00100000:1.0:1746065081.263919:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262662656 00000100:00100000:1.0:1746065081.263920:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262662656 00000100:00100000:1.0:1746065081.263930:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8757 00000100:00100000:1.0:1746065081.263934:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+105:3760:x1830881262662784:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.264016:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+106:3760:x1830881262662784:12345-0@lo:2:osp-syn-0-1.0 Request processed in 82us (1230us total) trans 21474839894 rc 0/0 00000100:00100000:1.0:1746065081.264022:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8757 00000100:00100000:1.0:1746065081.264033:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8758 00000100:00100000:1.0:1746065081.264037:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+105:3759:x1830881262662656:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065081.264075:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065081.264077:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:1.0:1746065081.264079:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.264081:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:1.0:1746065081.264082:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x374:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065081.264102:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+106:3759:x1830881262662656:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (252us total) trans 21474839895 rc 0/0 00000100:00100000:1.0:1746065081.264107:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8758 00000004:00080000:3.0:1746065081.264459:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098583800/2, rc 0, transno 21474839894 00000100:00100000:3.0:1746065081.264464:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262662784:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.264478:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098582a00/2, rc 0, transno 21474839895 00000100:00100000:3.0:1746065081.264480:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262662656:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.267032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.267296:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.267360:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261502080 00000100:00100000:2.0:1746065081.267367:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261502080 00000100:00100000:0.0:1746065081.267459:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.267474:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261502208 00000100:00100000:0.0:1746065081.267476:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261502208 00002000:00010000:0.0:1746065081.267496:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/886 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.267500:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abc0000 with x1830881261502208 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.267508:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abc0000. 00000100:00100000:0.0:1746065081.267525:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261502336 00000100:00100000:0.0:1746065081.267527:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261502336 00002000:00010000:0.0:1746065081.267536:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/887 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.267538:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abc0700 with x1830881261502336 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.267552:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abc0700. 00000100:00100000:1.0:1746065081.267754:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12384 00000100:00100000:1.0:1746065081.267762:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+284:27939:x1830881261502080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.267802:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.267816:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc14637bb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf7d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.267859:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc14637bb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf7d expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.267870:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad800/0xad6b7ddc14637bb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf7d expref: 285 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.267882:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009554fd00) 00010000:00010000:1.0:1746065081.267885:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.267888:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad800, rc 0) 00000100:00100000:1.0:1746065081.267921:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+285:27939:x1830881261502080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 160us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.267926:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12384 00000100:00100000:0.0:1746065081.268868:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1285 00000100:00100000:0.0:1746065081.268878:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881261502208:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065081.269010:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x376:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.269013:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x376:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:0.0:1746065081.269015:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x376:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.269017:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x376:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:0.0:1746065081.269019:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x376:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.269041:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261502208:12345-192.168.202.27@tcp:10:bash.0 Request processed in 165us (1745us total) trans 21474839896 rc 0/0 00000100:00100000:0.0:1746065081.269046:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1285 00002000:00010000:0.0:1746065081.269049:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/886 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.269051:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abc0000 with x1830881261502208 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.269055:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009abc0000. 00000100:00100000:0.0:1746065081.269067:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1286 00000100:00100000:0.0:1746065081.269072:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881261502336:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065081.269137:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x377:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.269139:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x377:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:0.0:1746065081.269141:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x377:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.269142:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x377:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:0.0:1746065081.269144:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x377:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.269159:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+60:2004:x1830881261502336:12345-192.168.202.27@tcp:10:bash.0 Request processed in 87us (1701us total) trans 17179872618 rc 0/0 00000100:00100000:0.0:1746065081.269164:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1286 00002000:00010000:0.0:1746065081.269166:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/887 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.269168:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009abc0700 with x1830881261502336 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.269172:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009abc0700. 00000100:00100000:0.0:1746065081.271852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.271896:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.273175:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261502592 00000100:00100000:1.0:1746065081.273182:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261502592 00000100:00100000:1.0:1746065081.273940:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261502848 00000100:00100000:1.0:1746065081.273945:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261502848 00000100:00100000:2.0:1746065081.274053:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4263 00000100:00100000:2.0:1746065081.274063:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:27939:x1830881261502592:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:2.0:1746065081.274234:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x34e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1746065081.274280:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2482, 64 off205392 00000040:00080000:2.0:1746065081.274310:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2478, 64 off204952 00000040:00080000:2.0:1746065081.274319:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2479, 64 off205016 00000040:00080000:2.0:1746065081.274327:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2483, 64 off205456 00010000:00010000:2.0:1746065081.274371:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065081.274384:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.274393:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.274399:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.274404:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.274409:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.274422:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.274561:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27939:x1830881261502592:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 499us (2714us total) trans 4294975719 rc 0/0 00000100:00100000:2.0:1746065081.274567:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4263 00000100:00100000:2.0:1746065081.274602:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4264 00000100:00100000:2.0:1746065081.274607:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261502848:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065081.274694:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261502848:12345-192.168.202.27@tcp:35:bash.0 Request processed in 86us (2797us total) trans 4294975720 rc 0/0 00000100:00100000:2.0:1746065081.274699:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4264 00010000:00010000:0.0:1746065081.275381:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.275387:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.275393:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.275396:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.275402:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.275412:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34e:0x0].0x0 (ffff88009554fd00) 00010000:00010000:0.0:1746065081.275414:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065081.275418:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.275421:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637c2 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x34e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.275434:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.275435:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.275437:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.284725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.284963:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261502976 00000100:00100000:2.0:1746065081.284972:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261502976 00000100:00100000:2.0:1746065081.285016:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12385 00000100:00100000:2.0:1746065081.285022:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27942:x1830881261502976:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1746065081.285044:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.285060:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc14637c9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf84 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.285114:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.285125:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285134:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285144:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.285149:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285155:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285211:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 3/1,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.285222:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285227:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.285253:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x350:0x0]: returning size 5 00000004:00200000:2.0:1746065081.285256:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.285268:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285276:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285283:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285288:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285292:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285834:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285839:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.285842:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285847:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285856:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbdc00) 00010000:00010000:2.0:1746065081.285859:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.285862:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285866:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc14637d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285879:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285884:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285888:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285891:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.285892:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285896:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285900:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd200) 00010000:00010000:2.0:1746065081.285902:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.285904:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285907:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc14637d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.285931:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc14637c9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf84 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.285945:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf84 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.285950:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:2.0:1746065081.285952:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.285954:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:3.0:1746065081.286511:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27942:x1830881261502976:12345-192.168.202.27@tcp:101:rm.0 Request processed in 1487us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.286517:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12385 00000100:00100000:0.0:1746065081.289714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.289825:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261503232 00000100:00100000:3.0:1746065081.289833:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261503232 00000100:00100000:3.0:1746065081.289985:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12386 00000100:00100000:3.0:1746065081.289993:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27942:x1830881261503232:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065081.290034:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065081.290056:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc146379f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x350:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf68 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.290324:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc14637de lrc: 0/0,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf84 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.290336:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc146377c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x350:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf5a expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.290345:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88009554f900) 00010000:00010000:3.0:1746065081.290352:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.290369:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.290378:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290389:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290399:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.290404:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290408:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290473:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.290480:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290485:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:3.0:1746065081.290653:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2480, 64 off205080 00000040:00080000:3.0:1746065081.290671:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2484, 64 off205520 00000040:00080000:3.0:1746065081.290677:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2485, 64 off205584 00000040:00080000:3.0:1746065081.290684:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2481, 64 off205144 00010000:00010000:3.0:1746065081.290719:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 3/0,1 mode: --/PW res: [0x240000403:0x350:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.290725:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290731:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290739:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290743:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.290748:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291721:0:7203:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065081.291740:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291746:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291750:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291758:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.291761:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291767:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291785:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88006dc83000) 00010000:00010000:3.0:1746065081.291788:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065081.291790:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291794:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc14637f3 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x350:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291891:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291896:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291900:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291904:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291907:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.291909:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291913:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291918:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec72800) 00010000:00010000:3.0:1746065081.291920:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.291922:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291925:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14637e5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065081.291937:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009abc1180 reply state ffff88009aa01000 transno 4294975721 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291944:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.291948:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.291950:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.291953:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.292024:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27942:x1830881261503232:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2029us (2313us total) trans 4294975721 rc 0/0 00000100:00100000:3.0:1746065081.292031:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12386 00010000:00010000:1.0:1746065081.292097:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065081.292102:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.292107:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.292109:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.292114:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.292120:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x350:0x0].0x0 (ffff88006dc83000) 00010000:00010000:1.0:1746065081.292122:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1746065081.292124:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 1/0,0 mode: --/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.292128:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc14637fa lrc: 0/0,0 mode: --/PW res: [0x240000403:0x350:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.292152:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.292153:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.292155:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.295219:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.295283:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261503488 00000100:00100000:3.0:1746065081.295291:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261503488 00000100:00100000:3.0:1746065081.295334:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12387 00000100:00100000:3.0:1746065081.295340:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27943:x1830881261503488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.295356:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.295371:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463801 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf8b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.295424:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.295433:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295440:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295447:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.295451:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295455:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295482:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295487:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295492:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295496:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295499:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.295502:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295507:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295514:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065081.295516:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.295518:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295522:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131bef400/0xad6b7ddc1463808 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295529:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295532:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295536:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295539:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009555b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.295542:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295554:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295559:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.295561:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.295563:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295566:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009555b400/0xad6b7ddc146380f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.295583:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463801 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf8b expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.295589:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abb3800/0xad6b7ddc1463801 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf8b expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.295599:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3800, rc 0) 00000100:00100000:3.0:1746065081.295639:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27943:x1830881261503488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 299us (425us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.295644:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12387 00000100:00100000:0.0:1746065081.300849:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.300945:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261503616 00000100:00100000:1.0:1746065081.300953:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261503616 00000100:00100000:1.0:1746065081.301511:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12388 00000100:00100000:1.0:1746065081.301519:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27943:x1830881261503616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.301534:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.301560:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc1463816 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf92 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.301607:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.301617:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301626:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301634:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.301639:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301643:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301676:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301681:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301685:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301690:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301695:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.301698:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301704:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301711:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009554f900) 00010000:00010000:1.0:1746065081.301714:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.301717:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301722:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc146381d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301734:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301738:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301743:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301747:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abade00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.301749:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301753:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301757:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:1.0:1746065081.301759:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.301761:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.301765:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abade00/0xad6b7ddc1463824 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.302412:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc1463816 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf92 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.302424:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad000/0xad6b7ddc1463816 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf92 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.302436:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad000, rc 0) 00000100:00100000:1.0:1746065081.302759:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27943:x1830881261503616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1240us (1916us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065081.302766:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12388 00000100:00100000:0.0:1746065081.305878:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.306240:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261503744 00000100:00100000:2.0:1746065081.306247:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261503744 00000100:00100000:2.0:1746065081.306687:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12389 00000100:00100000:2.0:1746065081.306694:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27944:x1830881261503744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.306710:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.306726:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc146382b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cf99 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.306809:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.306819:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306828:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306836:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.306841:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306846:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306976:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306981:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306986:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306991:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.306995:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.306998:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307003:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307012:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd900) 00010000:00010000:2.0:1746065081.307015:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.307017:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307021:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463832 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307042:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307046:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307051:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307055:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.307057:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307060:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307065:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:2.0:1746065081.307067:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.307069:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307072:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30800/0xad6b7ddc1463839 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.307092:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc146382b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf99 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.307099:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc146382b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf99 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.307108:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:2.0:1746065081.307147:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27944:x1830881261503744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 454us (1275us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.307152:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12389 00000100:00100000:0.0:1746065081.309274:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.311865:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261503872 00000100:00100000:2.0:1746065081.311873:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261503872 00000100:00100000:2.0:1746065081.311925:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12390 00000100:00100000:2.0:1746065081.311931:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27944:x1830881261503872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.311949:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.311963:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463840 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfa0 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.312008:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.312017:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312026:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312033:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.312038:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312043:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312070:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312075:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312080:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312085:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312089:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.312093:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312098:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312106:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd600) 00010000:00010000:2.0:1746065081.312109:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.312111:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312115:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463847 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312122:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312127:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312131:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312135:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.312137:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312141:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312146:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:2.0:1746065081.312148:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.312150:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312157:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc146384e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.312176:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463840 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfa0 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.312182:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463840 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfa0 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.312192:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31200, rc 0) 00000100:00100000:2.0:1746065081.312242:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27944:x1830881261503872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 310us (2972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.312247:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12390 00000100:00100000:0.0:1746065081.315748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.315806:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261504000 00000100:00100000:3.0:1746065081.315813:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261504000 00000100:00100000:3.0:1746065081.315847:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12391 00000100:00100000:3.0:1746065081.315853:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27944:x1830881261504000:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065081.315862:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.315869:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065081.315882:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261504256 00010000:00010000:3.0:1746065081.315883:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463855 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfa7 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.315885:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261504256 00000100:00100000:0.0:1746065081.315907:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12392 00000100:00100000:0.0:1746065081.315912:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27945:x1830881261504256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.315920:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.315924:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc146385c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065081.315927:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1463863 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfae expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.315934:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc146385c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.315941:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc146385c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.315964:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.315971:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.315976:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065081.315979:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1746065081.315980:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.315987:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.315991:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.315995:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.315999:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463855 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfa7 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.316015:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc146385c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfa7 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.316019:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.316021:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065081.316024:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065081.316026:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c000, rc 0) 00000100:00100000:3.0:1746065081.316058:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27944:x1830881261504000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 205us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.316064:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12391 00010000:00010000:0.0:1746065081.316171:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316177:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316181:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316186:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.316189:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316194:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316202:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065081.316204:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.316207:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316211:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0000/0xad6b7ddc146386a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316279:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316284:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316289:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316293:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.316294:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316299:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316305:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:0.0:1746065081.316307:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.316308:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316312:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1463871 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.316330:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1463863 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfae expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.316335:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1463863 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfae expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.316342:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:0.0:1746065081.316364:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27945:x1830881261504256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 451us (502us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065081.316368:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12392 00000100:00100000:0.0:1746065081.321473:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.322768:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261504512 00000100:00100000:2.0:1746065081.322790:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261504512 00000100:00100000:2.0:1746065081.322839:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12393 00000100:00100000:2.0:1746065081.322845:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27944:x1830881261504512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.322863:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.322865:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065081.322977:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c000/0xad6b7ddc146385c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfa7 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.323000:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065081.323008:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.323052:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc1463878 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfb5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.323129:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.323138:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323146:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323154:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.323159:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323164:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323448:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.323455:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323461:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.323469:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 0 00010000:00010000:3.0:1746065081.323487:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323492:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323497:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323502:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323506:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.323510:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323516:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323522:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88006dc83300) 00010000:00010000:3.0:1746065081.323525:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.323527:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323532:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146387f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:3.0:1746065081.323564:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099bd4e00 reply state ffff880098342000 transno 4294975722 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323572:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.323577:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.323579:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.323581:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065081.323599:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc1463878 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.323611:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.323617:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88006dc83000) 00010000:00010000:3.0:1746065081.323619:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.323620:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00000100:00100000:3.0:1746065081.323666:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27944:x1830881261504512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 820us (2200us total) trans 4294975722 rc 0/0 00000100:00100000:3.0:1746065081.323673:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12393 00000100:00100000:0.0:1746065081.330021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.330071:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.330093:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261504768 00000100:00100000:3.0:1746065081.330100:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261504768 00000100:00100000:3.0:1746065081.330134:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261505024 00000100:00100000:3.0:1746065081.330136:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261505024 00000100:00100000:3.0:1746065081.330148:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12394 00000100:00100000:3.0:1746065081.330154:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27944:x1830881261504768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.330174:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.330187:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146389b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfbc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.330259:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.330270:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.330277:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.330302:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.330311:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12395 00010000:00010000:3.0:1746065081.330312:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 292 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.330319:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27946:x1830881261505024:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065081.330323:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262662912:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.330330:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.330338:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc14638a9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfc3 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.330376:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065081.330379:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065081.330384:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.330392:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.330401:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 0 00010000:00010000:3.0:1746065081.330471:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330477:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330483:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330488:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.330491:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330496:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330505:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88006dc83000) 00010000:00010000:3.0:1746065081.330508:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065081.330510:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330515:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc14638b0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.330541:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc14638a9 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfc3 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.330558:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30600/0xad6b7ddc14638a9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfc3 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.330565:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065081.330586:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27946:x1830881261505024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 269us (515us total) trans 4294975723 rc 301/301 00000100:00100000:3.0:1746065081.330595:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12395 00000100:00100000:0.0:1746065081.335124:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.335144:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262662912:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.335164:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065081.335178:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261505152 00000100:00100000:1.0:1746065081.335184:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261505152 00010000:00010000:1.0:1746065081.335212:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 293 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.335247:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3677 00000100:00100000:1.0:1746065081.335254:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+293:2005:x1830881261505152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.335265:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.335270:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 293 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.335280:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 293 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.335295:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146388d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfb5 expref: 293 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.335322:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88006dc83000) 00010000:00010000:1.0:1746065081.335327:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.335335:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.335340:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.335363:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.335380:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335386:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065081.335394:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+292:2005:x1830881261505152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.335400:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3677 00000004:00200000:3.0:1746065081.335404:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 0 00000004:00080000:3.0:1746065081.335522:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x379:0x0], index 1: 0 00000004:00080000:3.0:1746065081.335526:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x378:0x0], index 0: 0 00000004:00080000:3.0:1746065081.335530:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x379:0x0], index 0: 0 00000004:00080000:3.0:1746065081.335533:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x37a:0x0], index 1: 0 00010000:00010000:3.0:1746065081.335609:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335615:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335620:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335625:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccdc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.335628:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335633:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335641:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88006dc83000) 00010000:00010000:3.0:1746065081.335644:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.335646:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335650:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638a2 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.335683:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146389b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfbc expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.335689:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146389b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfbc expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.335702:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8600, rc 0) 00000100:00100000:3.0:1746065081.335725:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27944:x1830881261504768:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5572us (5713us total) trans 4294975724 rc 301/301 00000100:00100000:3.0:1746065081.335731:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12394 00000100:00100000:0.0:1746065081.337931:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.337982:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261505408 00000100:00100000:3.0:1746065081.337989:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261505408 00000100:00100000:3.0:1746065081.338029:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4265 00000100:00100000:3.0:1746065081.338035:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27944:x1830881261505408:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065081.338206:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27944:x1830881261505408:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 171us (280us total) trans 4294975725 rc 0/0 00000100:00100000:3.0:1746065081.338212:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4265 00000100:00100000:0.0:1746065081.340209:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.340255:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.340307:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261505792 00000100:00100000:3.0:1746065081.340314:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261505792 00000100:00100000:3.0:1746065081.340348:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12396 00000100:00100000:3.0:1746065081.340355:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27946:x1830881261505792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.340372:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.340388:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14638c5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfca expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.340454:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14638cc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.340465:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14638cc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065081.340468:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261505664 00000100:00100000:2.0:1746065081.340473:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261505664 00010000:00010000:3.0:1746065081.340474:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14638cc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.340493:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 0 00000004:00200000:3.0:1746065081.340498:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1746065081.340502:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4266 00000100:00100000:2.0:1746065081.340507:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27944:x1830881261505664:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:3.0:1746065081.340514:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14638cc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.340534:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14638c5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfca expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.340557:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14638cc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfca expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.340564:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.340567:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.340569:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8400, rc 0) 00000100:00100000:3.0:1746065081.341222:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27946:x1830881261505792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 866us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.341232:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12396 00000100:00100000:2.0:1746065081.341278:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27944:x1830881261505664:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 768us (1073us total) trans 4294975726 rc 0/0 00000100:00100000:2.0:1746065081.341285:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4266 00000100:00100000:1.0:1746065081.346049:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.346123:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261506048 00000100:00100000:0.0:1746065081.346130:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261506048 00000100:00100000:2.0:1746065081.346193:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8759 00000100:00100000:2.0:1746065081.346202:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+60:2005:x1830881261506048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.346216:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.346230:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfd8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.346248:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.346265:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.346267:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.346273:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.346286:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.346294:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:2.0:1746065081.346332:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+61:2005:x1830881261506048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 132us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.346338:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8759 00000100:00100000:1.0:1746065081.348970:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.349001:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261506304 00000100:00100000:3.0:1746065081.349007:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261506304 00000100:00100000:2.0:1746065081.349024:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.349043:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12397 00000100:00100000:3.0:1746065081.349048:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261506304:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.349063:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.349083:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14638da lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfdf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.349127:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261505920 00000100:00100000:0.0:1746065081.349131:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261505920 00000100:00100000:0.0:1746065081.349148:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8760 00000100:00100000:0.0:1746065081.349153:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881261505920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.349160:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.349169:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfd1 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065081.349183:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.349184:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.349193:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.349195:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.349195:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.349200:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 49 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.349203:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349211:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.349214:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 49 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.349216:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349221:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.349221:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524800, rc 0) 00000100:00100000:0.0:1746065081.349248:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261505920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.349252:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8760 00010000:00010000:3.0:1746065081.349259:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14638f6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.349264:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14638f6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349272:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14638f6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.349291:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 0 00010000:00010000:3.0:1746065081.349353:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349359:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349363:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349367:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349372:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccdc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.349375:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349380:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349388:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b7e52700) 00010000:00010000:3.0:1746065081.349391:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.349393:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349398:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccdc00/0xad6b7ddc14638e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349408:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349415:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349423:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349427:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cccc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.349429:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349433:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349438:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.349440:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.349441:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349445:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc14638ef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.349473:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8600/0xad6b7ddc14638da lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfdf expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.349485:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14638f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfdf expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.349490:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.349492:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.349494:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104a00, rc 0) 00000100:00100000:3.0:1746065081.349521:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261506304:12345-192.168.202.27@tcp:101:bash.0 Request processed in 473us (556us total) trans 4294975727 rc 0/0 00000100:00100000:3.0:1746065081.349527:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12397 00000100:00100000:0.0:1746065081.353413:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.354086:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.354129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.354217:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261506560 00000100:00100000:2.0:1746065081.354225:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261506560 00000100:00100000:2.0:1746065081.354265:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 560 00000100:00100000:2.0:1746065081.354271:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2007:x1830881261506560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.354282:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.354302:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104a00/0xad6b7ddc14638f6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfdf expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.354938:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.354943:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.355044:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261506816 00000100:00100000:3.0:1746065081.355048:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261506816 00000100:00100000:3.0:1746065081.355074:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4267 00000100:00100000:3.0:1746065081.355079:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27946:x1830881261506816:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.355092:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2007:x1830881261506560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 820us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.355098:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 560 00000100:00100000:3.0:1746065081.355200:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27946:x1830881261506816:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 120us (1070us total) trans 4294975728 rc 0/0 00000100:00100000:3.0:1746065081.355206:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4267 00000100:00100000:3.0:1746065081.355224:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261506432 00000100:00100000:3.0:1746065081.355227:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261506432 00000100:00100000:3.0:1746065081.355244:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12398 00000100:00100000:3.0:1746065081.355248:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261506432:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.355255:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.355265:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6200/0xad6b7ddc1463904 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfe6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.355287:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.355296:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.355303:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.355359:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6200/0xad6b7ddc1463904 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 298 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.355374:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.355380:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.355382:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065081.355384:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6a00, rc 0) 00000100:00100000:3.0:1746065081.355417:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261506432:12345-192.168.202.27@tcp:101:bash.0 Request processed in 166us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.355422:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12398 00000100:00100000:1.0:1746065081.357407:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.357441:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.357511:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261507328 00000100:00100000:3.0:1746065081.357516:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261507328 00000100:00100000:3.0:1746065081.357560:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261507072 00000100:00100000:3.0:1746065081.357563:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261507072 00000100:00100000:3.0:1746065081.357588:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12399 00000100:00100000:3.0:1746065081.357594:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261507328:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:2.0:1746065081.357610:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12400 00000100:00100000:2.0:1746065081.357617:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:27946:x1830881261507072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.357623:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.357628:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.357634:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463912 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cfed expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.357641:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc14638cc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfca expref: 299 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.357650:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.357654:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.357683:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463919 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.357691:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463919 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.357697:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463919 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.357704:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 0 00010000:00010000:3.0:1746065081.357768:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.357789:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463912 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfed expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.357793:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.357798:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.357800:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463919 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfed expref: 300 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.357805:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.357807:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065081.357809:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31200, rc 0) 00000001:00080000:3.0:1746065081.357826:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975729 00000004:00010000:3.0:1746065081.357841:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009858d180 reply state ffff88009aa02000 transno 4294975731 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.357848:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.357851:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+301:27946:x1830881261507072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 235us (410us total) trans 4294975730 rc 0/0 00010000:00010000:3.0:1746065081.357853:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.357855:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.357857:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.357857:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12400 00000100:00100000:3.0:1746065081.358292:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261507328:12345-192.168.202.27@tcp:36:bash.0 Request processed in 296us (487us total) trans 4294975731 rc 0/0 00000100:00100000:3.0:1746065081.358564:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12399 00000020:00080000:3.0:1746065081.358567:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065081.359867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.359912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.359987:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261507584 00000100:00100000:2.0:1746065081.359992:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261507584 00000100:00100000:2.0:1746065081.360017:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261507712 00000100:00100000:2.0:1746065081.360019:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261507712 00000100:00100000:2.0:1746065081.360032:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12401 00000100:00100000:2.0:1746065081.360037:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261507584:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.360053:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.360055:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065081.360070:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463919 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfed expref: 302 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.360080:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.360083:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.360091:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146392e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cff4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.360124:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.360132:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.360139:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:2.0:1746065081.360283:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2486, 88 off205672 00000004:00080000:2.0:1746065081.360287:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677378513409ns, next at 677717559249ns, rc = 0 00000040:00080000:2.0:1746065081.360327:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2482, 88 off205232 00000004:00080000:2.0:1746065081.360331:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677378557459ns, next at 677717578181ns, rc = 0 00000040:00080000:2.0:1746065081.360360:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2483, 88 off205320 00000004:00080000:2.0:1746065081.360363:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677378589190ns, next at 677717578181ns, rc = 0 00000040:00080000:2.0:1746065081.360375:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2487, 88 off205760 00000004:00080000:2.0:1746065081.360378:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677378604348ns, next at 677717559249ns, rc = 0 00000100:00100000:2.0:1746065081.360412:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12402 00000100:00100000:2.0:1746065081.360417:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+303:27946:x1830881261507712:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.360423:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.360429:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc146393c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92cffb expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.360466:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.360473:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.360477:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.360489:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.360496:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:0.0:1746065081.362236:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975732 is committed 00000004:00080000:0.0:1746065081.362244:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1678 committed 00000004:00080000:0.0:1746065081.362502:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1668 committed 00000004:00080000:0.0:1746065081.362518:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1667 committed 00000004:00080000:0.0:1746065081.362520:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1677 committed 00010000:00010000:3.0:1746065081.362590:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362598:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362604:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362609:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.362612:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362618:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362630:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.362633:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.362636:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362641:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14637ec lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362655:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362659:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362663:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362666:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.362667:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362671:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362676:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72500) 00010000:00010000:3.0:1746065081.362678:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.362679:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362683:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc1463886 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.362696:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362700:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362704:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362708:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.362709:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362713:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362718:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.362720:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.362722:0:3745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.362728:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.362732:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc1463927 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.362910:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.362917:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.362918:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065081.362920:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.362925:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.362934:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.362954:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc146392e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 288 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065081.362964:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.362986:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489600, rc 0) 00000100:00100000:0.0:1746065081.363067:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.363107:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.363146:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663680:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.363159:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.363172:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065081.363176:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663040:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.363187:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.363196:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663552:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.363208:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.363243:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262663296:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.363265:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262663424:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.363371:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262664064:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.363649:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261507584:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3610us (3782us total) trans 4294975732 rc 0/0 00000100:00100000:2.0:1746065081.363657:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12401 00000100:00100000:0.0:1746065081.364131:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262664192:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.364149:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.364368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.364738:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663168 00000100:00100000:2.0:1746065081.364745:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663168 00000100:00100000:2.0:1746065081.364785:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663680 00000100:00100000:2.0:1746065081.364787:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663680 00000100:00100000:2.0:1746065081.364799:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663040 00000100:00100000:2.0:1746065081.364801:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663040 00000100:00100000:2.0:1746065081.364811:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663552 00000100:00100000:2.0:1746065081.364813:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663552 00000100:00100000:2.0:1746065081.364821:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664192 00000100:00100000:2.0:1746065081.364823:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664192 00000100:00100000:2.0:1746065081.364836:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8761 00000100:00100000:2.0:1746065081.364841:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+109:3762:x1830881262663168:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065081.364864:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:885 count 1 00002000:00010000:2.0:1746065081.364894:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.364899:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.364960:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8762 00000100:00100000:0.0:1746065081.364964:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8763 00000100:00100000:1.0:1746065081.364967:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+109:3762:x1830881262663680:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.364970:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+109:3762:x1830881262663040:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1746065081.364978:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:884 count 1 00010000:00010000:0.0:1746065081.364988:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.365001:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 48 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.365006:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065081.365008:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065081.365010:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.365030:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 48 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.365039:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 48 pid: 3067 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.365048:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262664576:192.168.202.27@tcp:104: 00002000:00010000:1.0:1746065081.365050:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x379:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065081.365052:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x379:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.365054:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x379:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.365055:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x379:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.365057:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x379:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.365089:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30df00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065081.365523:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.365524:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.365528:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.365537:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.365553:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.365560:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.365572:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065081.365719:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+111:3762:x1830881262663680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 752us (2557us total) trans 21474839897 rc 0/0 00000100:00100000:1.0:1746065081.365724:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8762 00000100:00100000:1.0:1746065081.365736:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663296 00000100:00100000:1.0:1746065081.365738:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663296 00000100:00100000:1.0:1746065081.365749:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8764 00000100:00100000:1.0:1746065081.365754:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+111:3762:x1830881262663552:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.365820:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+112:3762:x1830881262663552:12345-0@lo:2:osp-syn-0-1.0 Request processed in 66us (2611us total) trans 21474839899 rc 0/0 00000100:00100000:1.0:1746065081.365825:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8764 00000100:00100000:1.0:1746065081.365834:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8765 00000100:00100000:1.0:1746065081.365838:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+139:3762:x1830881262664192:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065081.365847:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:888 count 1 00002000:00010000:1.0:1746065081.365861:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.365865:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.365871:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.365872:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.365874:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.365881:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.365886:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.365890:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.365899:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065081.365994:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+140:3762:x1830881262664192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 155us (1843us total) trans 17179872619 rc 0/0 00000100:00100000:1.0:1746065081.366001:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8765 00000100:00100000:1.0:1746065081.366009:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8766 00000100:00100000:1.0:1746065081.366013:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+111:3759:x1830881262663296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065081.366021:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:886 count 1 00010000:00010000:1.0:1746065081.366028:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366037:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366043:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.366044:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.366046:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366059:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366066:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 48 pid: 12258 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.366073:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262664704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.366092:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.366116:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.366137:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664064 00000100:00100000:1.0:1746065081.366140:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664064 00000100:00100000:1.0:1746065081.366153:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8767 00000100:00100000:1.0:1746065081.366157:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+140:3761:x1830881262664064:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065081.366165:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:887 count 1 00010000:00010000:1.0:1746065081.366172:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366181:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 60 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366185:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.366187:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.366188:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366201:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 60 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.366208:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 60 pid: 12258 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.366215:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262664832:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.366232:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.366473:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262663808:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1746065081.366480:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dce00/2, rc 0, transno 17179872619 00000100:00100000:0.0:1746065081.366486:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262664192:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.366494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065081.366494:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098582300/2, rc 0, transno 21474839899 00000100:00100000:0.0:1746065081.366497:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663552:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.366504:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262664320:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065081.366504:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098582680/2, rc 0, transno 21474839897 00000100:00100000:0.0:1746065081.366506:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663680:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1746065081.366515:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1746065081.366516:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065081.366521:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366526:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:0.0:1746065081.366527:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9eb7000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.366530:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366531:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262663936:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065081.366537:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065081.366560:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366562:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262664448:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065081.366566:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146394a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065081.366581:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.366584:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366587:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663808 00010000:00010000:0.0:1746065081.366589:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4000 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:3.0:1746065081.366590:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663808 00010000:00010000:0.0:1746065081.366591:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.366597:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366600:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664320 00000100:00100000:3.0:1746065081.366602:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664320 00010000:00010000:0.0:1746065081.366604:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366607:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663936 00000100:00100000:3.0:1746065081.366608:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663936 00010000:00010000:0.0:1746065081.366610:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc1463958 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.366614:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664448 00000100:00100000:3.0:1746065081.366615:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664448 00010000:00010000:0.0:1746065081.366620:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065081.366621:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8768 00010000:00010000:0.0:1746065081.366621:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.366622:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065081.366625:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+144:3759:x1830881262663808:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065081.366633:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:885 count 1 00010000:00010000:3.0:1746065081.366642:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366650:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 60 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.366654:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.366656:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.366658:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366670:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 60 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.366677:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 60 pid: 1880 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746065081.366685:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131898000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262664960:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.366707:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.366720:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8769 00000100:00100000:3.0:1746065081.366724:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+144:3759:x1830881262664320:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.366802:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+145:3759:x1830881262664320:12345-0@lo:2:osp-syn-1-1.0 Request processed in 76us (283us total) trans 17179872620 rc 0/0 00000100:00100000:3.0:1746065081.366807:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8769 00000100:00100000:3.0:1746065081.366817:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8770 00000100:00100000:3.0:1746065081.366821:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+144:3759:x1830881262663936:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065081.366830:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:886 count 1 00002000:00010000:3.0:1746065081.366840:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.366843:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366849:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.366850:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.366853:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366860:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366866:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366875:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.366884:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.366894:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.366898:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.366903:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.366906:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.366911:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.366920:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.366929:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463974 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.366938:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.366939:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.366940:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065081.366951:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+145:3759:x1830881262663936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 130us (407us total) trans 17179872621 rc 0/0 00000100:00100000:3.0:1746065081.366955:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8770 00000100:00100000:3.0:1746065081.366963:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8771 00000100:00100000:3.0:1746065081.366966:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+144:3759:x1830881262664448:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065081.366996:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.366998:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.367000:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.367001:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.367003:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.367016:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+145:3759:x1830881262664448:12345-0@lo:2:osp-syn-1-1.0 Request processed in 49us (442us total) trans 17179872622 rc 0/0 00000100:00100000:3.0:1746065081.367020:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8771 00000100:00100000:3.0:1746065081.367031:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.367046:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663424 00000100:00100000:3.0:1746065081.367048:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663424 00000100:00100000:3.0:1746065081.367056:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8772 00000100:00100000:3.0:1746065081.367059:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+112:3760:x1830881262663424:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065081.367065:0:12260:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:887 count 1 00002000:00010000:3.0:1746065081.367075:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.367079:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.367084:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.367085:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.367087:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.367093:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.367098:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.367103:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.367110:0:12260:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.367120:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.367123:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.367128:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.367130:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.367135:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.367143:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.367148:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc146397b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.367157:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.367158:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.367159:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065081.367177:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+113:3760:x1830881262663424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 117us (145us total) trans 21474839900 rc 0/0 00000100:00100000:3.0:1746065081.367181:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8772 00000004:00080000:3.0:1746065081.367196:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098580a80/2, rc 0, transno 21474839900 00000100:00100000:3.0:1746065081.367199:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262663424:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.367208:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858fb80/2, rc 0, transno 17179872621 00000100:00100000:3.0:1746065081.367210:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262663936:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.367216:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5df800/2, rc 0, transno 17179872622 00000100:00100000:3.0:1746065081.367217:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262664448:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.367222:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dd500/2, rc 0, transno 17179872620 00010000:00010000:2.0:1746065081.368171:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065081.368204:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+112:3762:x1830881262663168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3360us (5094us total) trans 21474839898 rc 0/0 00000100:00100000:2.0:1746065081.368209:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8761 00010000:00010000:2.0:1746065081.368235:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.368241:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.368276:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 2 00000004:00200000:2.0:1746065081.368280:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.368292:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.368323:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4c00/0xad6b7ddc146393c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cffb expref: 287 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.368335:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cffb expref: 286 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.368341:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.368343:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065081.368345:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4200, rc 0) 00000100:00100000:2.0:1746065081.368374:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+286:27946:x1830881261507712:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7957us (8462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.368380:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12402 00000100:00100000:3.0:1746065081.368634:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262664320:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065081.368990:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098580000/2, rc 0, transno 21474839898 00000100:00100000:0.0:1746065081.368996:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663168:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.369404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.370447:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261507840 00000100:00100000:2.0:1746065081.370454:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261507840 00000100:00100000:2.0:1746065081.370806:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8773 00000100:00100000:2.0:1746065081.370813:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+61:26180:x1830881261507840:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.370827:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.370844:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d002 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.370861:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.370878:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.370880:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.370886:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 62 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.370898:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 62 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.370907:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ba00, rc 0) 00000100:00100000:2.0:1746065081.370951:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+62:26180:x1830881261507840:12345-192.168.202.27@tcp:101:bash.0 Request processed in 138us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.370957:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8773 00000100:00100000:1.0:1746065081.371933:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262664704:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.371955:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.372000:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262664832:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.372008:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.372028:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.372622:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.373212:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.374090:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.374146:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261507968 00000100:00100000:3.0:1746065081.374153:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261507968 00010000:00010000:3.0:1746065081.374180:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 49 pid: 12258 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.374201:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508096 00000100:00100000:3.0:1746065081.374203:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508096 00010000:00010000:3.0:1746065081.374212:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 62 pid: 12258 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.374230:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508224 00000100:00100000:3.0:1746065081.374231:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508224 00010000:00010000:3.0:1746065081.374239:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 50 pid: 3067 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.374252:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3678 00000100:00100000:3.0:1746065081.374258:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261507968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.374269:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.374273:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 50 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374281:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 50 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374299:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc14637ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf6f expref: 50 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374316:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.374318:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.374322:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374329:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374348:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.374381:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261507968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.374386:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3678 00000100:00100000:3.0:1746065081.374399:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3679 00000100:00100000:3.0:1746065081.374404:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+62:2004:x1830881261508096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.374412:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.374416:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 62 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374423:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 62 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374434:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14637b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf76 expref: 62 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374443:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.374444:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.374447:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374452:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374464:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.374477:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+61:2004:x1830881261508096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.374483:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3679 00000100:00100000:3.0:1746065081.374492:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3680 00000100:00100000:3.0:1746065081.374496:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261508224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.374502:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.374506:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 48 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374513:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 48 pid: 3067 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.374522:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.374524:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.374526:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374531:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374539:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.374567:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261508224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.374572:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3680 00010000:00010000:3.0:1746065081.374608:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374615:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374623:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374629:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374640:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065081.374824:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+145:3761:x1830881262664064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8666us (8706us total) trans 17179872623 rc 0/0 00000100:00100000:3.0:1746065081.374832:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8767 00000100:00100000:3.0:1746065081.374867:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131898000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262664960:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.374881:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374896:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374902:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374909:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374915:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.374926:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1746065081.375021:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+112:3759:x1830881262663296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9006us (10652us total) trans 21474839901 rc 0/0 00000100:00100000:3.0:1746065081.375026:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8766 00010000:00010000:3.0:1746065081.375040:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1746065081.375045:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375051:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009af08600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065081.375054:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375061:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375071:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375076:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc1463966 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375093:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065081.375095:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375100:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065081.375102:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375107:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375113:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375118:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146395f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.375130:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065081.375131:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065081.375132:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065081.375152:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098583480/2, rc 0, transno 21474839901 00000100:00100000:3.0:1746065081.375156:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262663296:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065081.376829:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc1463610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cef1 expref: 47 pid: 3067 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.376843:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262664576:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065081.376859:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.376866:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.376873:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.376880:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.376885:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.376901:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746065081.377040:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+112:3762:x1830881262663040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12070us (13850us total) trans 21474839902 rc 0/0 00000100:00100000:0.0:1746065081.377047:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8763 00000100:00100000:1.0:1746065081.377315:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508352 00000100:00100000:1.0:1746065081.377321:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508352 00010000:00010000:1.0:1746065081.377341:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.377360:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3681 00000100:00100000:1.0:1746065081.377366:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+61:2007:x1830881261508352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.377375:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.377378:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.377386:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.377402:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bee800/0xad6b7ddc146374b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cf4c expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.377416:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.377418:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.377420:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.377430:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.377445:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.377467:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+60:2007:x1830881261508352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.377472:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3681 00000004:00080000:1.0:1746065081.377502:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858c380/2, rc 0, transno 17179872623 00000100:00100000:1.0:1746065081.377507:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262664064:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.377569:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.377582:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508480 00000100:00100000:1.0:1746065081.377584:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508480 00000100:00100000:1.0:1746065081.377599:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8774 00000100:00100000:1.0:1746065081.377604:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+47:26180:x1830881261508480:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.377614:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.377626:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d009 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.377640:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.377650:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.377651:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.377655:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.377663:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 48 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.377674:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:1.0:1746065081.377688:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+48:26180:x1830881261508480:12345-192.168.202.27@tcp:101:bash.0 Request processed in 84us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.377693:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8774 00010000:00010000:0.0:1746065081.382360:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.382372:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.382384:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.382388:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.382396:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.382412:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.382418:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1463951 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.382442:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.382443:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.382445:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065081.382571:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098580700/2, rc 0, transno 21474839902 00000100:00100000:0.0:1746065081.382578:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262663040:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.382685:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.382710:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.382875:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508864 00000100:00100000:1.0:1746065081.382880:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508864 00002000:00010000:1.0:1746065081.382905:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/889 (0->18446744073709551615) 00002000:00100000:1.0:1746065081.382908:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5dc700 with x1830881261508864 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065081.382915:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5dc700. 00000100:00100000:1.0:1746065081.382931:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1287 00000100:00100000:1.0:1746065081.382937:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+60:2005:x1830881261508864:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065081.383058:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x379:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065081.383061:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x379:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:1.0:1746065081.383063:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x379:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.383065:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x379:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:1.0:1746065081.383066:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x379:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065081.383100:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+61:2005:x1830881261508864:12345-192.168.202.27@tcp:10:bash.0 Request processed in 162us (388us total) trans 17179872624 rc 0/0 00000100:00100000:1.0:1746065081.383106:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1287 00002000:00010000:1.0:1746065081.383108:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/889 (0->18446744073709551615) 00002000:00100000:1.0:1746065081.383110:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5dc700 with x1830881261508864 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065081.383114:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5dc700. 00000100:00100000:0.0:1746065081.384128:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508736 00000100:00100000:0.0:1746065081.384134:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508736 00000100:00100000:0.0:1746065081.384167:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4268 00000100:00100000:0.0:1746065081.384173:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+286:27946:x1830881261508736:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065081.384301:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27946:x1830881261508736:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 127us (1618us total) trans 4294975733 rc 0/0 00000100:00100000:0.0:1746065081.384307:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4268 00010000:00010000:3.0:1746065081.384429:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065081.384448:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.384461:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.384469:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.384475:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.384495:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065081.384706:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+145:3759:x1830881262663808:12345-0@lo:6:osp-syn-1-1.0 Request processed in 18080us (18210us total) trans 17179872625 rc 0/0 00000100:00100000:3.0:1746065081.384713:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8768 00000004:00080000:3.0:1746065081.384828:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858d500/2, rc 0, transno 17179872625 00000100:00100000:3.0:1746065081.384832:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262663808:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1746065081.384873:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065081.384878:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.384884:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.384888:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.384894:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.384906:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.384910:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146396d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.384923:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.384924:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.384925:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065081.384966:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.385167:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261508992 00000100:00100000:2.0:1746065081.385171:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261508992 00002000:00010000:2.0:1746065081.385186:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/888 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.385188:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5dfb80 with x1830881261508992 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.385195:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5dfb80. 00000100:00100000:2.0:1746065081.385207:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1288 00000100:00100000:2.0:1746065081.385212:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261508992:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065081.385302:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x378:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.385304:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x378:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.385306:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x378:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.385307:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x378:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.385309:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x378:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.385329:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261508992:12345-192.168.202.27@tcp:10:bash.0 Request processed in 117us (363us total) trans 21474839903 rc 0/0 00000100:00100000:2.0:1746065081.385334:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1288 00002000:00010000:2.0:1746065081.385336:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/888 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.385338:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5dfb80 with x1830881261508992 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.385341:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5dfb80. 00000100:00100000:0.0:1746065081.388890:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.388891:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.389209:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261509504 00000100:00100000:2.0:1746065081.389216:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261509504 00000100:00100000:2.0:1746065081.389262:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4269 00000100:00100000:2.0:1746065081.389269:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+287:26180:x1830881261509504:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065081.389464:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261509504:12345-192.168.202.27@tcp:35:bash.0 Request processed in 195us (581us total) trans 4294975734 rc 0/0 00000100:00100000:2.0:1746065081.389471:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4269 00000100:00100000:2.0:1746065081.389513:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261509248 00000100:00100000:2.0:1746065081.389516:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261509248 00000100:00100000:2.0:1746065081.389556:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12403 00000100:00100000:2.0:1746065081.389562:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+288:27946:x1830881261509248:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.389571:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.389587:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463990 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d010 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.389631:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.389641:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389650:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389658:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.389663:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389668:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389732:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.389740:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389745:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.389753:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 5 00010000:00010000:2.0:1746065081.389810:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389817:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389821:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389826:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389831:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.389834:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389840:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389849:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd900) 00010000:00010000:2.0:1746065081.389851:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.389855:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389860:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463997 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389867:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389871:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389875:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389878:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.389880:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389885:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389889:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd800) 00010000:00010000:2.0:1746065081.389891:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.389893:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389897:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc146399e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.389920:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463990 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.389931:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.389937:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.389938:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.389940:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b400, rc 0) 00000100:00100000:2.0:1746065081.389959:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:27946:x1830881261509248:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 398us (1076us total) trans 4294975735 rc 0/0 00000100:00100000:2.0:1746065081.389964:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12403 00000100:00100000:0.0:1746065081.393616:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.394513:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261509632 00000100:00100000:1.0:1746065081.394521:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261509632 00000100:00100000:1.0:1746065081.394573:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4270 00000100:00100000:1.0:1746065081.394580:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27946:x1830881261509632:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065081.394688:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27946:x1830881261509632:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 109us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.394695:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4270 00000100:00100000:0.0:1746065081.397025:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.397086:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261509888 00000100:00100000:3.0:1746065081.397093:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261509888 00000100:00100000:3.0:1746065081.397134:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12404 00000100:00100000:3.0:1746065081.397140:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27946:x1830881261509888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.397156:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.397171:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009af08600/0xad6b7ddc14639b3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d017 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.397244:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14639ba lrc: 3/0,1 mode: --/PW res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.397259:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14639ba lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.397268:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14639ba lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.397277:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x352:0x0]: returning size 5 00010000:00010000:3.0:1746065081.397345:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009af08600/0xad6b7ddc14639b3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d017 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.397371:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14639ba lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d017 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.397378:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.397380:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065081.397383:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bd3800, rc 0) 00000100:00100000:3.0:1746065081.397426:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27946:x1830881261509888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 285us (406us total) trans 4294975736 rc 0/0 00000100:00100000:3.0:1746065081.397431:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12404 00000100:00100000:0.0:1746065081.399658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.399725:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261510144 00000100:00100000:2.0:1746065081.399733:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261510144 00000100:00100000:2.0:1746065081.399792:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4271 00000100:00100000:2.0:1746065081.399799:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27946:x1830881261510144:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065081.399851:0:16721:0:(mdt_open.c:2285:mdt_close_handle_layouts()) ### [0x240000403:0x352:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14639ba lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d017 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.399878:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065081.399888:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.399894:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.399899:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.399904:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 6/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.399926:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.399936:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.399947:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098582d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262665088:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.400010:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.400016:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 292 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.400022:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098581500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262665216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.400039:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.400044:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 292 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.400049:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098583100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262665344:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.400059:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.402738:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065081.403589:0:16721:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880098582d80 x1830881262665088) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.403604:0:16721:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.403622:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c489600/0xad6b7ddc1463935 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cff4 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.403692:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261510400 00000100:00100000:3.0:1746065081.403698:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261510400 00000100:00100000:3.0:1746065081.403733:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12405 00000100:00100000:3.0:1746065081.403738:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27948:x1830881261510400:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065081.403793:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1746065081.403795:0:7231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc1463935) 00010000:00010000:3.0:1746065081.403802:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 292 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.403820:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463943 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cffb expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.403838:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 291 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.403845:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.403849:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.403856:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.403861:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.403872:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.403890:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.403896:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.403902:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.403911:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.403916:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.403920:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.403978:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 3/0,1 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.403984:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.403989:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065081.404133:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x352:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1746065081.404183:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404188:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404193:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404198:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.404201:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404207:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404213:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:3.0:1746065081.404215:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065081.404218:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 2/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404222:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639dd lrc: 0/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404234:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404238:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404243:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404246:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404249:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.404251:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404255:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404260:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929d0400) 00010000:00010000:3.0:1746065081.404261:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.404263:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404267:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639cf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065081.404277:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a5dd180 reply state ffff88009aa05000 transno 4294975737 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404283:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.404287:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065081.404290:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.404291:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.404335:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27948:x1830881261510400:12345-192.168.202.27@tcp:36:rm.0 Request processed in 595us (1603us total) trans 4294975737 rc 0/0 00000100:00100000:3.0:1746065081.404341:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12405 00000100:00100000:2.0:1746065081.404586:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098582d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262665088:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.404600:0:16721:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880098581500 x1830881262665216) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 1/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 292 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.404608:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc14639a5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d010 expref: 292 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.404620:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262665216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.404627:0:16721:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff880098583100 x1830881262665344) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 1/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 291 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.404633:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc146390b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x352:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfe6 expref: 291 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.404638:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098583100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262665344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.404652:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.404656:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404661:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404665:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000004:00020000:2.0:1746065081.404722:0:16721:0:(lod_lov.c:1538:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000403:0x352:0x0]: rc = -1 00010000:00010000:2.0:1746065081.404735:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404739:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404743:0:16721:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404750:0:16721:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.404752:0:16721:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404757:0:16721:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404763:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.404765:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1746065081.404766:0:16721:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404770:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14639c8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x352:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.404789:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff88008d8c4100) 00010000:00010000:2.0:1746065081.404791:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.404794:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b1bd3800/0xad6b7ddc14639ba lrc: 0/0,0 mode: --/PW res: [0x240000403:0x352:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d017 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.404840:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27946:x1830881261510144:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 5043us (5189us total) trans 4294975738 rc -1/-1 00000100:00100000:2.0:1746065081.404846:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4271 00000100:00100000:0.0:1746065081.407572:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.407645:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261510528 00000100:00100000:3.0:1746065081.407652:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261510528 00000100:00100000:3.0:1746065081.407689:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12406 00000100:00100000:3.0:1746065081.407694:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27946:x1830881261510528:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.407712:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.407727:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc14639e4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d01e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.407793:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc14639e4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d01e expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.407804:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7000/0xad6b7ddc14639e4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x352:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d01e expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.407819:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff880097b72300) 00010000:00010000:3.0:1746065081.407822:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.407824:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7000, rc 0) 00000100:00100000:3.0:1746065081.408530:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27946:x1830881261510528:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 831us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.408536:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12406 00000100:00100000:0.0:1746065081.410857:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.411439:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261510784 00000100:00100000:3.0:1746065081.411446:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261510784 00000100:00100000:3.0:1746065081.411488:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4272 00000100:00100000:3.0:1746065081.411495:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27946:x1830881261510784:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065081.411693:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x352:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065081.411744:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2488, 64 off205824 00000040:00080000:3.0:1746065081.411765:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2484, 64 off205384 00000040:00080000:3.0:1746065081.411802:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2485, 64 off205448 00000040:00080000:3.0:1746065081.411810:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2489, 64 off205888 00010000:00010000:3.0:1746065081.411844:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 3/0,1 mode: --/PW res: [0x240000403:0x352:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065081.411854:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.411861:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.411867:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.411872:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.411876:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.411890:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065081.412004:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27946:x1830881261510784:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 509us (1152us total) trans 4294975739 rc 0/0 00000100:00100000:3.0:1746065081.412009:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4272 00010000:00010000:0.0:1746065081.412277:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.412282:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.412288:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.412292:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.412307:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.412316:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x352:0x0].0x0 (ffff880097b72300) 00010000:00010000:0.0:1746065081.412319:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065081.412322:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 1/0,0 mode: --/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.412326:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14639eb lrc: 0/0,0 mode: --/PW res: [0x240000403:0x352:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.412337:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.412338:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.412340:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.424596:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.425740:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261510912 00000100:00100000:3.0:1746065081.425748:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261510912 00000100:00100000:3.0:1746065081.425798:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12407 00000100:00100000:3.0:1746065081.425805:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27949:x1830881261510912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.425828:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.425846:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc14639f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d025 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.425894:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.425904:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425912:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425920:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.425925:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425930:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425965:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425970:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425975:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425980:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425985:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.425989:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.425994:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426005:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72800) 00010000:00010000:3.0:1746065081.426007:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.426009:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426014:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc14639f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426534:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426549:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426553:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426557:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.426559:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426563:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426570:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065081.426572:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.426574:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426580:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a00 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.426604:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc14639f2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d025 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.426611:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc14639f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d025 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.426619:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6a00, rc 0) 00000100:00100000:3.0:1746065081.427196:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27949:x1830881261510912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1390us (2605us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.427203:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12407 00000100:00100000:0.0:1746065081.429877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.429961:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261511040 00000100:00100000:3.0:1746065081.429968:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261511040 00000100:00100000:3.0:1746065081.430038:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12408 00000100:00100000:3.0:1746065081.430046:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27949:x1830881261511040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.430063:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.430078:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463a07 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d02c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.430127:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.430137:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430145:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430155:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.430160:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430165:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430192:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430197:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430201:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430206:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430210:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.430213:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430218:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430226:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72200) 00010000:00010000:3.0:1746065081.430229:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.430231:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430235:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7e00/0xad6b7ddc1463a0e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430918:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430925:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430929:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430933:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.430935:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430939:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430947:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065081.430949:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.430951:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430955:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b7200/0xad6b7ddc1463a15 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.430981:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463a07 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d02c expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.430987:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463a07 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d02c expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.430996:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6a00, rc 0) 00000100:00100000:3.0:1746065081.431037:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27949:x1830881261511040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 992us (1167us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.431044:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12408 00000100:00100000:2.0:1746065081.435662:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.436267:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.436336:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261511168 00000100:00100000:0.0:1746065081.436343:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261511168 00000100:00100000:0.0:1746065081.436619:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261511424 00000100:00100000:0.0:1746065081.436623:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261511424 00000100:00100000:3.0:1746065081.436668:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12409 00000100:00100000:3.0:1746065081.436677:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27949:x1830881261511168:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.436691:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.436707:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc1463a1c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d033 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.436752:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463a23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.436763:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463a23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.436785:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463a23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.436820:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065081.436823:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065081.436845:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6800/0xad6b7ddc1463a1c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d033 expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.436858:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463a23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d033 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.436864:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:3.0:1746065081.436867:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065081.436869:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e4e200, rc 0) 00000100:00100000:3.0:1746065081.436904:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27949:x1830881261511168:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 228us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.436912:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12409 00000100:00100000:3.0:1746065081.436925:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12410 00000100:00100000:3.0:1746065081.436930:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27950:x1830881261511424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.436935:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.436942:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463a2a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d03a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.436971:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.436978:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.436983:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.436990:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.436995:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437000:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437022:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437027:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437032:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437038:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437042:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa51600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.437045:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437051:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437057:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:3.0:1746065081.437059:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.437062:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437066:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51600/0xad6b7ddc1463a31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437072:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437077:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437081:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437085:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa51400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.437087:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437091:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437100:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065081.437101:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.437103:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437108:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1463a38 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.437122:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463a2a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d03a expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.437128:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463a2a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d03a expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.437133:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019ec00, rc 0) 00000100:00100000:3.0:1746065081.437150:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27950:x1830881261511424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 219us (883us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.437155:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12410 00000100:00100000:3.0:1746065081.440242:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.440306:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261511552 00000100:00100000:1.0:1746065081.440313:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261511552 00000100:00100000:1.0:1746065081.440346:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12411 00000100:00100000:1.0:1746065081.440352:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27950:x1830881261511552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.440366:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.440377:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61e00/0xad6b7ddc1463a3f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d041 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.440419:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.440429:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440438:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440446:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.440452:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440457:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440483:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440489:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440494:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440499:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440503:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.440506:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440511:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440519:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:1.0:1746065081.440522:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.440524:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440529:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463a46 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440553:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440558:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440563:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440566:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.440569:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440573:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440578:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:1.0:1746065081.440580:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.440582:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440587:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463a4d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.440606:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61e00/0xad6b7ddc1463a3f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d041 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.440613:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61e00/0xad6b7ddc1463a3f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d041 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.440619:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61e00, rc 0) 00000100:00100000:1.0:1746065081.440649:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27950:x1830881261511552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 297us (413us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065081.440654:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12411 00000100:00100000:1.0:1746065081.446506:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.446593:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261511808 00000100:00100000:3.0:1746065081.446601:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261511808 00000100:00100000:3.0:1746065081.446640:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12412 00000100:00100000:3.0:1746065081.446647:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27949:x1830881261511808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.446662:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.446665:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.446688:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130e4e200/0xad6b7ddc1463a23 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d033 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.446711:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72400) 00010000:00010000:3.0:1746065081.446719:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.446730:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc1463a54 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d048 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.446826:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.446836:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.446844:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.446851:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.446856:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.446861:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447103:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.447110:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447116:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.447122:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00010000:00010000:3.0:1746065081.447140:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447145:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447150:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447155:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447160:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.447165:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447170:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447177:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097b72800) 00010000:00010000:3.0:1746065081.447179:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.447181:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447186:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1463a5b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065081.447193:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a5ded80 reply state ffff88009a504000 transno 4294975740 ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447200:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.447205:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:3.0:1746065081.447207:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.447210:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065081.447226:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090790600/0xad6b7ddc1463a54 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.447238:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.447243:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff880097b72200) 00010000:00010000:3.0:1746065081.447245:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.447247:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00000100:00100000:3.0:1746065081.447288:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27949:x1830881261511808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 641us (789us total) trans 4294975740 rc 0/0 00000100:00100000:3.0:1746065081.447294:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12412 00000100:00100000:2.0:1746065081.453533:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.454181:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.454244:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261512064 00000100:00100000:3.0:1746065081.454252:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261512064 00000100:00100000:3.0:1746065081.454287:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261512320 00000100:00100000:3.0:1746065081.454289:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261512320 00000100:00100000:3.0:1746065081.454551:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12413 00000100:00100000:3.0:1746065081.454559:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27949:x1830881261512064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.454580:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.454595:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463a77 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d04f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.454672:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.454684:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.454690:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.454714:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.454724:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 297 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.454734:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013189a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262665472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.454814:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.455618:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12414 00000100:00100000:2.0:1746065081.455692:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:27951:x1830881261512320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.455701:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.455710:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1463a85 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d056 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.455748:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.455757:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455766:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.455791:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00010000:00010000:2.0:1746065081.455848:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455854:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455859:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455864:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.455866:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455871:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455880:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff880097b72200) 00010000:00010000:2.0:1746065081.455882:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065081.455885:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455890:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463a8c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.455921:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1463a85 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d056 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.455928:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1463a85 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d056 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.455935:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a200, rc 0) 00000100:00100000:2.0:1746065081.455963:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:27951:x1830881261512320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 338us (1782us total) trans 4294975741 rc 301/301 00000100:00100000:2.0:1746065081.455969:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12414 00000100:00100000:0.0:1746065081.457841:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.457951:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013189a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262665472:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.457969:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065081.458020:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261512448 00000100:00100000:1.0:1746065081.458025:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261512448 00010000:00010000:1.0:1746065081.458047:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 298 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.458065:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3682 00000100:00100000:1.0:1746065081.458070:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+298:2004:x1830881261512448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.458078:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.458082:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 298 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.458091:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 298 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.458104:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1463a69 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d048 expref: 298 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.458117:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff880097b72200) 00010000:00010000:1.0:1746065081.458121:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.458127:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.458132:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.458145:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.458167:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+297:2004:x1830881261512448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.458176:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3682 00010000:00010000:3.0:1746065081.458681:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.458687:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.458705:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00000004:00080000:3.0:1746065081.459032:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x37a:0x0], index 0: 0 00000004:00080000:3.0:1746065081.459038:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x37b:0x0], index 1: 0 00000004:00080000:3.0:1746065081.459041:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x37c:0x0], index 1: 0 00000004:00080000:3.0:1746065081.459044:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x37b:0x0], index 0: 0 00010000:00010000:3.0:1746065081.459111:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459117:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459125:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459129:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.459132:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459137:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459144:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff880097b72200) 00010000:00010000:3.0:1746065081.459147:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.459150:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459154:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463a7e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.459186:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463a77 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d04f expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.459193:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463a77 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d04f expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.459204:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f7800, rc 0) 00000100:00100000:3.0:1746065081.459227:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27949:x1830881261512064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4669us (5700us total) trans 4294975742 rc 301/301 00000100:00100000:3.0:1746065081.459233:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12413 00000100:00100000:2.0:1746065081.462474:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.462603:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261512704 00000100:00100000:1.0:1746065081.462610:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261512704 00000100:00100000:1.0:1746065081.462685:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4273 00000100:00100000:1.0:1746065081.462692:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27949:x1830881261512704:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.462892:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+297:27949:x1830881261512704:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 200us (423us total) trans 4294975743 rc 0/0 00000100:00100000:1.0:1746065081.462898:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4273 00000100:00100000:0.0:1746065081.464129:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.464638:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261512960 00000100:00100000:3.0:1746065081.464644:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261512960 00000100:00100000:3.0:1746065081.464680:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4274 00000100:00100000:3.0:1746065081.464687:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27949:x1830881261512960:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065081.464842:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+298:27949:x1830881261512960:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 155us (716us total) trans 4294975744 rc 0/0 00000100:00100000:3.0:1746065081.464848:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4274 00000100:00100000:0.0:1746065081.465179:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.465301:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261513088 00000100:00100000:2.0:1746065081.465305:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261513088 00000100:00100000:2.0:1746065081.465336:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12415 00000100:00100000:2.0:1746065081.465341:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27951:x1830881261513088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.465350:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.465364:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463aa1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d05d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.465411:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463aa8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.465421:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.465430:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.465446:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00000004:00200000:2.0:1746065081.465449:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.465457:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.465473:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463aa1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d05d expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.465488:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d05d expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.465494:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:2.0:1746065081.465497:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.465499:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ac00, rc 0) 00000100:00100000:2.0:1746065081.465517:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27951:x1830881261513088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 176us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.465522:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12415 00000100:00100000:0.0:1746065081.469016:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.469060:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.470035:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261513216 00000100:00100000:3.0:1746065081.470044:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261513216 00000100:00100000:3.0:1746065081.470085:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261513344 00000100:00100000:3.0:1746065081.470088:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261513344 00000100:00100000:3.0:1746065081.470102:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8775 00000100:00100000:3.0:1746065081.470109:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+61:2005:x1830881261513216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.470123:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.470138:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d064 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.470155:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.470169:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.470172:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.470178:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.470190:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.470200:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f6a00, rc 0) 00000100:00100000:3.0:1746065081.470234:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+62:2005:x1830881261513216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 127us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.470243:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8775 00000100:00100000:3.0:1746065081.470257:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8776 00000100:00100000:3.0:1746065081.470261:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261513344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.470267:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.470276:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d06b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.470287:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.470293:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.470295:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.470298:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.470306:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.470312:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f6e00, rc 0) 00000100:00100000:3.0:1746065081.470325:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261513344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 64us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.470329:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8776 00000100:00100000:0.0:1746065081.471844:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.473882:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261513600 00000100:00100000:2.0:1746065081.473891:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261513600 00000100:00100000:0.0:1746065081.473912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.473976:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261513856 00000100:00100000:1.0:1746065081.473980:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261513856 00000100:00100000:2.0:1746065081.474268:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12416 00000100:00100000:2.0:1746065081.474274:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261513600:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.474293:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.474309:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463abd lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d072 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.474399:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.474409:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474417:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474424:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.474429:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474432:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474462:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463ad2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.474467:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474471:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.474477:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00010000:00010000:2.0:1746065081.474526:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474530:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474535:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474551:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474556:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.474559:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474567:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474575:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd800) 00010000:00010000:2.0:1746065081.474578:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.474581:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474585:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc1463ac4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474612:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474616:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474620:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474623:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.474625:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474630:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474636:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:2.0:1746065081.474637:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.474639:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.474643:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b400/0xad6b7ddc1463acb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065081.474700:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4275 00000100:00100000:1.0:1746065081.474707:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+302:27951:x1830881261513856:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:2.0:1746065081.474748:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463abd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d072 expref: 303 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.474764:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463ad2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d072 expref: 303 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.474769:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:2.0:1746065081.474788:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.474791:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a600, rc 0) 00000100:00100000:1.0:1746065081.476964:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+303:27951:x1830881261513856:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2252us (3048us total) trans 4294975746 rc 0/0 00000100:00100000:1.0:1746065081.476973:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4275 00000100:00100000:2.0:1746065081.476996:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261513600:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2721us (5155us total) trans 4294975745 rc 0/0 00000100:00100000:2.0:1746065081.477002:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12416 00000100:00100000:3.0:1746065081.482580:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.482621:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.482662:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.482680:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261514112 00000100:00100000:3.0:1746065081.482687:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261514112 00000100:00100000:3.0:1746065081.482715:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261514368 00000100:00100000:3.0:1746065081.482717:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261514368 00000100:00100000:0.0:1746065081.483766:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261513984 00000100:00100000:0.0:1746065081.483783:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261513984 00000100:00100000:0.0:1746065081.483814:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 561 00000100:00100000:0.0:1746065081.483820:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+304:2004:x1830881261513984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.483830:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.483849:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1463ad2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d072 expref: 304 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.483867:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:0.0:1746065081.483870:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.483900:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+303:2004:x1830881261513984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.483905:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 561 00000100:00100000:3.0:1746065081.484003:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12417 00000100:00100000:3.0:1746065081.484009:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261514112:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.484026:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.484037:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc1463ae0 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d079 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.484058:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463ae7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.484066:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463ae7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.484073:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463ae7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.484142:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc1463ae0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d079 expref: 304 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.484156:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d079 expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.484161:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.484163:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065081.484165:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6800, rc 0) 00000100:00100000:3.0:1746065081.484187:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013189b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+303:26180:x1830881261514112:12345-192.168.202.27@tcp:101:bash.0 Request processed in 178us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.484191:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12417 00000100:00100000:3.0:1746065081.484201:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12418 00000100:00100000:3.0:1746065081.484205:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:27951:x1830881261514368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.484211:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.484215:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7c00/0xad6b7ddc1463aee lrc: 2/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d080 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.484250:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463af5 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.484255:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463af5 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x354:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.484260:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463af5 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x354:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.484267:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00010000:00010000:3.0:1746065081.484324:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7c00/0xad6b7ddc1463aee lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d080 expref: 305 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.484333:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463af5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x354:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d080 expref: 304 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.484338:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.484340:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065081.484342:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6e00, rc 0) 00000100:00100000:3.0:1746065081.484356:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+304:27951:x1830881261514368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 150us (1693us total) trans 4294975747 rc 0/0 00000100:00100000:3.0:1746065081.484361:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12418 00000100:00100000:0.0:1746065081.487661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.487706:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.489873:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261514624 00000100:00100000:3.0:1746065081.489882:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261514624 00000100:00100000:3.0:1746065081.489926:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261514752 00000100:00100000:3.0:1746065081.489928:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261514752 00000100:00100000:3.0:1746065081.489946:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12419 00000100:00100000:3.0:1746065081.489952:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261514624:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065081.489991:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.490011:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc1463aa8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d05d expref: 305 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.490026:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.490030:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.490145:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.490156:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.490163:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000001:00080000:3.0:1746065081.490188:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975748 00000004:00010000:3.0:1746065081.490200:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129f43800 reply state ffff88009aa03000 transno 4294975749 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.490207:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.490212:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.490214:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.490217:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.490270:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+307:26180:x1830881261514624:12345-192.168.202.27@tcp:36:bash.0 Request processed in 318us (2616us total) trans 4294975749 rc 0/0 00000100:00100000:3.0:1746065081.490276:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12419 00000020:00080000:3.0:1746065081.490280:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746065081.490291:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12420 00000100:00100000:3.0:1746065081.490295:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+306:27951:x1830881261514752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.490304:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.490310:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b0a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d087 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.490349:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.490355:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.490360:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.490370:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 0 00000004:00200000:3.0:1746065081.490373:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065081.490380:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.490393:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b0a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 308 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.490403:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 307 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.490409:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.490410:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.490412:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71bc00, rc 0) 00000100:00100000:3.0:1746065081.490428:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+307:27951:x1830881261514752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 133us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.490436:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12420 00000100:00100000:0.0:1746065081.495182:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.497732:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261515008 00000100:00100000:1.0:1746065081.497742:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261515008 00000100:00100000:1.0:1746065081.497810:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12421 00000100:00100000:1.0:1746065081.497818:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+307:26180:x1830881261515008:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.497836:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.497838:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065081.497860:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463af5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d080 expref: 307 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.497884:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:1.0:1746065081.497888:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.497896:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463b18 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d08e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.497929:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.497938:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 307 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.497943:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 4/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.497963:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 307 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.497972:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 307 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.497981:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262665600:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.498045:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.498404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.498462:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261515264 00000100:00100000:0.0:1746065081.498466:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261515264 00000100:00100000:3.0:1746065081.499845:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4276 00000100:00100000:3.0:1746065081.499959:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+308:27951:x1830881261515264:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065081.500103:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+309:27951:x1830881261515264:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 148us (1698us total) trans 4294975750 rc 0/0 00000100:00100000:3.0:1746065081.500108:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4276 00000100:00100000:1.0:1746065081.500803:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262665600:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.500822:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065081.501033:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.501628:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261515392 00000100:00100000:1.0:1746065081.501633:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261515392 00010000:00010000:1.0:1746065081.501654:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 309 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.501688:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3683 00000100:00100000:1.0:1746065081.501694:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+309:2005:x1830881261515392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.501704:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.501708:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 309 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.501717:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 309 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.501735:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b11 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d087 expref: 309 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.501746:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:1.0:1746065081.501750:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.501758:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.501763:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.501807:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.501832:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+308:2005:x1830881261515392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 138us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.501838:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3683 00010000:00010000:1.0:1746065081.501853:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.501861:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:1.0:1746065081.502023:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2486, 88 off205536 00000004:00080000:1.0:1746065081.502028:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677520254252ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.502066:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2490, 88 off205976 00000004:00080000:1.0:1746065081.502069:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677520295278ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.502080:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2491, 88 off206064 00000004:00080000:1.0:1746065081.502082:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677520308532ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.502089:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2487, 88 off205624 00000004:00080000:1.0:1746065081.502092:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677520318266ns, next at 677717578181ns, rc = 0 00000100:00100000:2.0:1746065081.502638:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.502698:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261515648 00000100:00100000:0.0:1746065081.502702:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261515648 00000100:00100000:0.0:1746065081.502728:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12422 00000100:00100000:0.0:1746065081.502790:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+309:27951:x1830881261515648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.502803:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.502814:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463b26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d095 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.502864:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.502872:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.502878:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.502885:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.502890:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.502894:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.502948:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.502954:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.502959:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:0.0:1746065081.502966:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 2 00010000:00010000:0.0:1746065081.503004:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503009:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503013:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503017:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.503020:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503025:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503030:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:0.0:1746065081.503032:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065081.503035:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503038:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463b3b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503049:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503053:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503057:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503064:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503067:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.503068:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503072:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503076:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34600) 00010000:00010000:0.0:1746065081.503077:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.503078:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503082:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b2d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503087:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503090:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503094:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503097:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.503098:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503102:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503109:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:0.0:1746065081.503111:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.503113:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503116:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463b34 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.503141:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463b26 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d095 expref: 311 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.503147:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463b26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d095 expref: 311 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.503155:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:0.0:1746065081.503177:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+310:27951:x1830881261515648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 444us (540us total) trans 4294975752 rc 301/301 00000100:00100000:0.0:1746065081.503181:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12422 00000100:00100000:1.0:1746065081.505501:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.505664:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261515904 00000100:00100000:3.0:1746065081.505672:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261515904 00000100:00100000:3.0:1746065081.505703:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4277 00000100:00100000:3.0:1746065081.505709:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+310:27951:x1830881261515904:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065081.506571:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+311:27951:x1830881261515904:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 860us (1074us total) trans 4294975753 rc 0/0 00000100:00100000:3.0:1746065081.506579:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4277 00000001:00080000:1.0:1746065081.507102:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975751 is committed 00000004:00080000:1.0:1746065081.507108:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1670 committed 00000004:00080000:1.0:1746065081.507121:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1680 committed 00000004:00080000:1.0:1746065081.507127:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1679 committed 00000004:00080000:1.0:1746065081.507128:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1669 committed 00010000:00010000:0.0:1746065081.507534:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507554:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507560:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507565:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.507568:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507576:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507588:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:0.0:1746065081.507590:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.507593:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507598:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6400/0xad6b7ddc14639d6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.507610:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507615:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507619:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507622:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.507624:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507628:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507633:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097b72600) 00010000:00010000:0.0:1746065081.507635:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.507637:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507641:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019d800/0xad6b7ddc1463a62 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507654:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507659:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507662:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507666:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f7800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.507668:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507672:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.507677:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00000100:00100000:1.0:1746065081.507949:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262665728:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.507986:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065081.508128:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.508132:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.508137:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f7800/0xad6b7ddc1463b03 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x354:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.508154:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262665856:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.508228:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013189b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262666112:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065081.508285:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d08e expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.508291:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.508293:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.508303:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61800/0xad6b7ddc1463b18 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d08e expref: 289 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065081.508314:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d08e expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.508336:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.508338:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.508339:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:3.0:1746065081.508365:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261515008:12345-192.168.202.27@tcp:101:bash.0 Request processed in 10549us (13195us total) trans 4294975751 rc 0/0 00000100:00100000:3.0:1746065081.508371:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12421 00000100:00100000:2.0:1746065081.508486:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262665984:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.508683:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262666240:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.508699:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.508714:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065081.508718:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013189aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262666368:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.508732:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.508752:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665728 00000100:00100000:1.0:1746065081.508756:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665728 00000100:00100000:1.0:1746065081.508799:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666240 00000100:00100000:1.0:1746065081.508802:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666240 00000100:00100000:1.0:1746065081.508811:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666368 00000100:00100000:1.0:1746065081.508812:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666368 00000100:00100000:1.0:1746065081.508822:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8777 00000100:00100000:1.0:1746065081.508827:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+146:3761:x1830881262665728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1746065081.508844:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:889 count 1 00010000:00010000:1.0:1746065081.508858:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.508871:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 61 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.508877:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.508878:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.508881:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.508897:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 61 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.508905:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 61 pid: 1880 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.508913:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262666752:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.508946:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.508957:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8778 00000100:00100000:1.0:1746065081.508962:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+146:3761:x1830881262666240:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065081.509041:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065081.509043:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.509045:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.509047:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.509048:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065081.509070:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+147:3761:x1830881262666240:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (370us total) trans 17179872626 rc 0/0 00000100:00100000:1.0:1746065081.509075:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8778 00000100:00100000:1.0:1746065081.509085:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8779 00000100:00100000:1.0:1746065081.509089:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+112:3761:x1830881262666368:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065081.509098:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:889 count 1 00010000:00010000:1.0:1746065081.509107:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.509117:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 49 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065081.509122:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.509123:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.509125:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.509138:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 49 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065081.509144:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 49 pid: 12258 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.509151:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262666880:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.509168:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1746065081.509194:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e52d80/2, rc 0, transno 17179872626 00000100:00100000:1.0:1746065081.509198:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262666240:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.509525:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.509551:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262666624:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.509570:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.509592:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666112 00000100:00100000:3.0:1746065081.509595:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666112 00000100:00100000:3.0:1746065081.509608:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666624 00000100:00100000:3.0:1746065081.509610:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666624 00000100:00100000:3.0:1746065081.509619:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8780 00000100:00100000:3.0:1746065081.509623:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+114:3760:x1830881262666112:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1746065081.509633:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:888 count 1 00010000:00010000:3.0:1746065081.509642:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.509651:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 49 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.509656:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065081.509657:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065081.509659:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.509677:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 49 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.509684:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 49 pid: 12258 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.509691:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262667008:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.509712:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.509722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.509736:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262666496:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.509751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.509769:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665984 00000100:00100000:3.0:1746065081.509790:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665984 00000100:00100000:3.0:1746065081.509801:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666496 00000100:00100000:3.0:1746065081.509803:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666496 00000100:00100000:3.0:1746065081.509810:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8781 00000100:00100000:3.0:1746065081.509813:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+115:3760:x1830881262666624:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065081.509871:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.509873:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.509875:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.509876:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.509878:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.509896:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+116:3760:x1830881262666624:12345-0@lo:2:osp-syn-0-1.0 Request processed in 82us (325us total) trans 21474839904 rc 0/0 00000100:00100000:3.0:1746065081.509901:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8781 00000100:00100000:3.0:1746065081.509910:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8782 00000100:00100000:3.0:1746065081.509914:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+147:3759:x1830881262665984:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.509961:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+148:3759:x1830881262665984:12345-0@lo:2:osp-syn-1-1.0 Request processed in 46us (238us total) trans 17179872627 rc 0/0 00000100:00100000:3.0:1746065081.509965:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8782 00000100:00100000:3.0:1746065081.509972:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8783 00000100:00100000:3.0:1746065081.509975:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+115:3759:x1830881262666496:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.510009:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+116:3759:x1830881262666496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 33us (257us total) trans 21474839905 rc 0/0 00000100:00100000:3.0:1746065081.510013:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8783 00000004:00080000:3.0:1746065081.510028:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e53b80/2, rc 0, transno 17179872627 00000100:00100000:3.0:1746065081.510031:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262665984:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.510038:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131899500/2, rc 0, transno 21474839905 00000100:00100000:3.0:1746065081.510041:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262666496:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.510054:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc0a80/2, rc 0, transno 21474839904 00000100:00100000:3.0:1746065081.510057:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262666624:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.510261:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.510281:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665856 00000100:00100000:0.0:1746065081.510283:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665856 00000100:00100000:0.0:1746065081.510296:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8784 00000100:00100000:0.0:1746065081.510300:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+148:3762:x1830881262665856:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065081.510308:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:890 count 1 00010000:00010000:0.0:1746065081.510316:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.510325:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065081.510330:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.510332:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.510333:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.510345:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065081.510352:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746065081.510360:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262667136:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.510390:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.511314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.511388:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516032 00000100:00100000:2.0:1746065081.511393:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516032 00000100:00100000:2.0:1746065081.511427:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4278 00000100:00100000:2.0:1746065081.511433:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27951:x1830881261516032:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065081.511515:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27951:x1830881261516032:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.511520:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4278 00000100:00100000:0.0:1746065081.513159:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.513211:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262666752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.513228:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.513358:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881262666880:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.513372:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.513441:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.513502:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516160 00000100:00100000:1.0:1746065081.513506:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516160 00000100:00100000:1.0:1746065081.513533:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8785 00000100:00100000:1.0:1746065081.513538:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:26180:x1830881261516160:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.513557:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.513568:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d09c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.513584:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.513596:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.513598:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.513604:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.513616:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.513624:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019ec00, rc 0) 00000100:00100000:1.0:1746065081.513661:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+51:26180:x1830881261516160:12345-192.168.202.27@tcp:101:bash.0 Request processed in 121us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.513666:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8785 00000100:00100000:0.0:1746065081.513862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.513906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.514761:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262667008:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.514788:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.515334:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516288 00000100:00100000:1.0:1746065081.515338:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516288 00010000:00010000:1.0:1746065081.515358:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 51 pid: 12258 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.515380:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516416 00000100:00100000:1.0:1746065081.515382:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516416 00010000:00010000:1.0:1746065081.515393:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 62 pid: 1880 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.515404:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516544 00000100:00100000:1.0:1746065081.515406:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516544 00010000:00010000:1.0:1746065081.515412:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 52 pid: 12258 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.515432:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3684 00000100:00100000:1.0:1746065081.515437:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261516288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.515444:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.515448:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 52 pid: 12258 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.515456:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 52 pid: 12258 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.515470:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc14638e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd1 expref: 52 pid: 12258 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.515485:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.515486:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.515490:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515496:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515511:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.515533:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261516288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.515538:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3684 00000100:00100000:1.0:1746065081.515557:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3685 00000100:00100000:1.0:1746065081.515562:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+62:2007:x1830881261516416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.515569:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.515573:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 62 pid: 1880 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.515580:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 62 pid: 1880 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.515591:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ba00/0xad6b7ddc1463982 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d002 expref: 62 pid: 1880 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.515599:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.515600:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.515603:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515608:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515621:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.515635:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+61:2007:x1830881261516416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.515640:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3685 00000100:00100000:1.0:1746065081.515649:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3686 00000100:00100000:1.0:1746065081.515654:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261516544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.515659:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.515662:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 50 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.515669:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 50 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.515678:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1463989 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d009 expref: 50 pid: 12258 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.515686:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.515687:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.515689:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515694:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515705:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.515718:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261516544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.515723:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3686 00010000:00010000:1.0:1746065081.515756:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515762:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515769:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515788:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515799:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065081.515944:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+116:3761:x1830881262666368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6855us (7210us total) trans 21474839906 rc 0/0 00000100:00100000:1.0:1746065081.515950:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8779 00010000:00010000:1.0:1746065081.515962:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065081.515966:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515971:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.515974:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515986:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515994:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.515999:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc1463b50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.516010:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.516011:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.516013:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065081.516030:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013189aa00/2, rc 0, transno 21474839906 00000100:00100000:1.0:1746065081.516034:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013189aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262666368:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065081.516184:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.516190:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.516201:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.516207:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.516217:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065081.516298:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+116:3760:x1830881262666112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6673us (6772us total) trans 21474839907 rc 0/0 00000100:00100000:3.0:1746065081.516304:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8780 00000004:00080000:3.0:1746065081.516328:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013189b800/2, rc 0, transno 21474839907 00000100:00100000:3.0:1746065081.516332:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013189b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262666112:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065081.516435:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.516440:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516445:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.516448:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516453:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516461:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516467:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b600/0xad6b7ddc1463b57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516481:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.516482:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.516484:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.516770:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.516792:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.516798:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.516803:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.516813:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.516914:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+149:3761:x1830881262665728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8087us (8928us total) trans 17179872628 rc 0/0 00000100:00100000:2.0:1746065081.516919:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8777 00010000:00010000:0.0:1746065081.516967:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.516971:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516976:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.516978:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.516984:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.517045:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.517056:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1463b49 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.517066:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.517067:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.517069:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065081.518004:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5de300/2, rc 0, transno 17179872628 00000100:00100000:1.0:1746065081.518014:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262665728:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.518269:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.518307:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.518370:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262667136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.518386:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.518403:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516800 00000100:00100000:2.0:1746065081.518408:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516800 00010000:00010000:2.0:1746065081.518436:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746065081.518460:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3687 00000100:00100000:2.0:1746065081.518470:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+61:2004:x1830881261516800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.518480:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.518484:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00010000:00010000:2.0:1746065081.518493:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00010000:00010000:2.0:1746065081.518512:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc14638d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92cfd8 expref: 61 pid: 1880 timeout: 777 lvb_type: 1 00010000:00010000:2.0:1746065081.518522:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.518524:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.518527:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518533:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518558:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065081.518593:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+60:2004:x1830881261516800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.518598:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3687 00010000:00010000:2.0:1746065081.518623:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518628:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518638:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518643:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518653:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.518799:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+149:3762:x1830881262665856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8498us (8537us total) trans 17179872629 rc 0/0 00000100:00100000:2.0:1746065081.518806:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8784 00000100:00100000:2.0:1746065081.518817:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516672 00000100:00100000:2.0:1746065081.518819:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516672 00000100:00100000:2.0:1746065081.518834:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8786 00000100:00100000:2.0:1746065081.518838:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+60:26180:x1830881261516672:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.518848:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.518859:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0a3 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.518875:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.518885:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.518887:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.518891:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 61 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518900:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 61 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.518910:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a000, rc 0) 00000100:00100000:2.0:1746065081.518924:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+61:26180:x1830881261516672:12345-192.168.202.27@tcp:101:bash.0 Request processed in 86us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.518929:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8786 00010000:00010000:1.0:1746065081.519011:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065081.519016:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.519022:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.519025:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.519032:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.519042:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.519046:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1463b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.519056:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.519057:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065081.519058:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065081.519180:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5df100/2, rc 0, transno 17179872629 00000100:00100000:0.0:1746065081.519184:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262665856:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.526130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.526175:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.526234:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261517056 00000100:00100000:2.0:1746065081.526242:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261517056 00002000:00010000:2.0:1746065081.526270:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/891 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.526273:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cc380 with x1830881261517056 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.526281:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925cc380. 00000100:00100000:2.0:1746065081.526306:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261516928 00000100:00100000:2.0:1746065081.526308:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261516928 00002000:00010000:2.0:1746065081.526318:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/890 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.526320:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cf100 with x1830881261516928 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.526326:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cf100. 00000100:00100000:2.0:1746065081.526337:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1289 00000100:00100000:2.0:1746065081.526343:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+61:2004:x1830881261517056:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065081.526472:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.526474:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37b:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.526477:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.526478:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37b:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.526480:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.526515:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+62:2004:x1830881261517056:12345-192.168.202.27@tcp:10:bash.0 Request processed in 172us (392us total) trans 17179872630 rc 0/0 00000100:00100000:2.0:1746065081.526521:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1289 00002000:00010000:2.0:1746065081.526524:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/891 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.526525:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cc380 with x1830881261517056 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.526528:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925cc380. 00000100:00100000:2.0:1746065081.526552:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1290 00000100:00100000:2.0:1746065081.526557:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261516928:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065081.526620:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.526622:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37a:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.526623:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.526625:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37a:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.526626:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.526640:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261516928:12345-192.168.202.27@tcp:10:bash.0 Request processed in 83us (464us total) trans 21474839908 rc 0/0 00000100:00100000:2.0:1746065081.526644:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1290 00002000:00010000:2.0:1746065081.526646:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/890 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.526647:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cf100 with x1830881261516928 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.526650:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cf100. 00000100:00100000:0.0:1746065081.529927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.530012:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261517312 00000100:00100000:2.0:1746065081.530019:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261517312 00000100:00100000:2.0:1746065081.530051:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4279 00000100:00100000:2.0:1746065081.530058:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261517312:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065081.530260:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261517312:12345-192.168.202.27@tcp:35:bash.0 Request processed in 198us (335us total) trans 4294975754 rc 0/0 00000100:00100000:2.0:1746065081.530266:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4279 00000100:00100000:0.0:1746065081.530717:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.530865:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261517568 00000100:00100000:3.0:1746065081.530869:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261517568 00000100:00100000:3.0:1746065081.530895:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12423 00000100:00100000:3.0:1746065081.530900:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27952:x1830881261517568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.530908:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.530921:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b73 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0aa expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.530962:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.530972:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.530980:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.530989:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.530994:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.530998:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531049:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463b88 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.531054:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463b88 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531059:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463b88 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065081.531065:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x354:0x0]: returning size 5 00010000:00010000:3.0:1746065081.531095:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531100:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531104:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531108:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531112:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.531115:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531122:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531130:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880099caf000) 00010000:00010000:3.0:1746065081.531133:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.531135:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531139:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463b7a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531415:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531421:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531425:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531429:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.531431:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531435:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531441:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880099caff00) 00010000:00010000:3.0:1746065081.531443:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.531445:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531449:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463b81 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.531477:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463b73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0aa expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.531486:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463b88 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0aa expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.531491:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.531492:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.531494:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b600, rc 0) 00000100:00100000:3.0:1746065081.531816:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27952:x1830881261517568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 911us (1095us total) trans 4294975755 rc 0/0 00000100:00100000:3.0:1746065081.531823:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12423 00000100:00100000:0.0:1746065081.533824:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.533941:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261517824 00000100:00100000:1.0:1746065081.533947:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261517824 00000100:00100000:1.0:1746065081.533979:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4280 00000100:00100000:1.0:1746065081.533985:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27952:x1830881261517824:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.534147:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27952:x1830881261517824:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 161us (327us total) trans 4294975756 rc 0/0 00000100:00100000:1.0:1746065081.534152:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4280 00000100:00100000:0.0:1746065081.535492:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.535569:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261518080 00000100:00100000:3.0:1746065081.535573:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261518080 00000100:00100000:3.0:1746065081.535606:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12424 00000100:00100000:3.0:1746065081.535611:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27953:x1830881261518080:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:3.0:1746065081.535637:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746065081.535656:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f61600/0xad6b7ddc1463b1f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x354:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d08e expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.535671:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463b88 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0aa expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.535681:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463ae7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x354:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d079 expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.535689:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88012edbd200) 00010000:00010000:3.0:1746065081.535699:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.535714:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.535722:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.535728:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.535735:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.535739:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.535743:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.535819:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.535825:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.535830:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:3.0:1746065081.535980:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2488, 64 off205688 00000040:00080000:3.0:1746065081.535999:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2492, 64 off206128 00000040:00080000:3.0:1746065081.536005:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2493, 64 off206192 00000040:00080000:3.0:1746065081.536011:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2489, 64 off205752 00010000:00010000:3.0:1746065081.536035:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 3/0,1 mode: --/PW res: [0x240000403:0x354:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.536041:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536046:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536051:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536055:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536060:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536070:0:7204:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065081.536080:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536084:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536088:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536092:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.536095:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536099:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536104:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:3.0:1746065081.536106:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1746065081.536109:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536115:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7200/0xad6b7ddc1463ba4 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x354:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536187:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536191:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536196:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536199:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536202:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.536204:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536208:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536212:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a300) 00010000:00010000:3.0:1746065081.536214:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.536215:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536219:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463b96 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:3.0:1746065081.536226:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925cdc00 reply state ffff880087e26000 transno 4294975757 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536232:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.536236:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.536238:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.536240:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.536287:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27953:x1830881261518080:12345-192.168.202.27@tcp:36:rm.0 Request processed in 676us (797us total) trans 4294975757 rc 0/0 00000100:00100000:3.0:1746065081.536293:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12424 00010000:00010000:0.0:1746065081.536339:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.536343:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.536347:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.536350:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.536353:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.536359:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x354:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:0.0:1746065081.536361:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065081.536363:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 1/0,0 mode: --/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.536367:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bab lrc: 0/0,0 mode: --/PW res: [0x240000403:0x354:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.536385:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.536386:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.536388:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.537760:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.539404:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261518208 00000100:00100000:3.0:1746065081.539412:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261518208 00000100:00100000:3.0:1746065081.539492:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12425 00000100:00100000:3.0:1746065081.539500:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27952:x1830881261518208:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.539519:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.539534:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1463bb2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0b1 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.539589:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.539599:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539605:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539667:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.539672:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539677:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539711:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539716:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539721:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539725:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539730:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.539732:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539737:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539745:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a65aa800) 00010000:00010000:3.0:1746065081.539748:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.539751:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539755:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1463bb9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539766:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.539769:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.542123:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.542129:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.542132:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.542138:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.542149:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.542151:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.542154:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.542158:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463bc0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.542198:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1463bb2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0b1 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.542205:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1463bb2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0b1 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.542217:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7000, rc 0) 00000100:00100000:3.0:1746065081.542277:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27952:x1830881261518208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2776us (4519us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.542284:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12425 00000100:00100000:0.0:1746065081.543870:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.544925:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261518336 00000100:00100000:3.0:1746065081.544933:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261518336 00000100:00100000:3.0:1746065081.544979:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12426 00000100:00100000:3.0:1746065081.544985:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27954:x1830881261518336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.545003:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.545019:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463bc7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0b8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.545066:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.545075:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545082:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545090:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.545095:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545099:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545126:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545131:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545136:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545141:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545145:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.545149:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545154:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545162:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25a00) 00010000:00010000:3.0:1746065081.545164:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.545167:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545171:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463bce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545180:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545184:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545188:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545191:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.545193:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545197:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545201:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.545203:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.545205:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545211:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6e00/0xad6b7ddc1463bd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.545230:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463bc7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0b8 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.545236:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463bc7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0b8 expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.545246:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b800, rc 0) 00000100:00100000:3.0:1746065081.545295:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27954:x1830881261518336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 309us (1427us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.545301:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12426 00000100:00100000:0.0:1746065081.547235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.547315:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261518464 00000100:00100000:2.0:1746065081.547328:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261518464 00000100:00100000:2.0:1746065081.547369:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12427 00000100:00100000:2.0:1746065081.547376:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27954:x1830881261518464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.547389:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.547402:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463bdc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0bf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.547442:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.547451:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547459:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547467:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.547472:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547477:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547502:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547506:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547512:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547516:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547521:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.547524:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547529:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547537:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065081.547539:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.547554:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547559:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1463be3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547582:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547587:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547592:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547595:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.547597:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547601:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547607:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:2.0:1746065081.547609:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.547612:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547616:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1463bea lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.547636:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463bdc lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0bf expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.547642:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463bdc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0bf expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.547651:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:2.0:1746065081.547688:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27954:x1830881261518464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 313us (458us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.547693:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12427 00000100:00100000:0.0:1746065081.550992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.551033:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.551090:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261518720 00000100:00100000:3.0:1746065081.551097:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261518720 00000100:00100000:3.0:1746065081.551138:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261518848 00000100:00100000:3.0:1746065081.551141:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261518848 00000100:00100000:3.0:1746065081.551156:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12428 00000100:00100000:3.0:1746065081.551162:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27955:x1830881261518720:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065081.551175:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12429 00010000:00010000:3.0:1746065081.551176:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065081.551183:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27954:x1830881261518848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.551190:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463bf1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0c6 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.551190:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.551197:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463bf8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0cd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.551229:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463bff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.551238:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463bff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.551241:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065081.551246:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463bff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.551248:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551257:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551265:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065081.551270:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065081.551278:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1746065081.551281:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065081.551286:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.551304:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31600/0xad6b7ddc1463bf8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0cd expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.551308:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551314:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551318:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551322:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551326:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.551329:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551333:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551341:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25b00) 00010000:00010000:3.0:1746065081.551343:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.551346:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551350:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463c06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551358:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551361:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551365:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551368:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.551369:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551373:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.551377:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.551379:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.551381:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.551383:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463bff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0cd expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.551384:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463c0d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.551389:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25b00) 00010000:00010000:0.0:1746065081.551391:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1746065081.551393:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00010000:00010000:3.0:1746065081.551401:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463bf1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0c6 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.551406:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6800/0xad6b7ddc1463bf1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0c6 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.551413:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6800, rc 0) 00000100:00100000:0.0:1746065081.551482:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27954:x1830881261518848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 299us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.551487:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12429 00000100:00100000:3.0:1746065081.551574:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27955:x1830881261518720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 411us (587us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.551580:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12428 00000100:00100000:0.0:1746065081.558492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.558649:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261519104 00000100:00100000:3.0:1746065081.558657:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261519104 00000100:00100000:3.0:1746065081.558704:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12430 00000100:00100000:3.0:1746065081.558710:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27954:x1830881261519104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.558726:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.558729:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.558749:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463bff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0cd expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.558765:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25b00) 00010000:00010000:3.0:1746065081.558791:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.558803:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c14 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0d4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.558881:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.558890:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.558897:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.558904:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.558909:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.558913:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559163:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.559170:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559175:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.559182:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00010000:00010000:3.0:1746065081.559198:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559202:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559206:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559211:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559214:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.559217:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559222:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559231:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854c00) 00010000:00010000:3.0:1746065081.559233:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.559235:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559239:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c1b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065081.559246:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008d85c700 reply state ffff880099c86000 transno 4294975758 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559252:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.559256:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.559258:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.559260:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065081.559277:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c14 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.559287:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.559292:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854700) 00010000:00010000:3.0:1746065081.559294:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.559295:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac800, rc 0) 00000100:00100000:3.0:1746065081.559666:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27954:x1830881261519104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 954us (1992us total) trans 4294975758 rc 0/0 00000100:00100000:3.0:1746065081.559673:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12430 00000100:00100000:0.0:1746065081.563796:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.564054:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261519360 00000100:00100000:3.0:1746065081.564063:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261519360 00000100:00100000:3.0:1746065081.564104:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12431 00000100:00100000:3.0:1746065081.564110:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27954:x1830881261519360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.564126:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.564140:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c37 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0db expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.564210:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.564220:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.564225:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.564246:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.564254:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 295 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.564263:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262667264:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.564342:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.564744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.564902:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261519616 00000100:00100000:0.0:1746065081.564906:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261519616 00000100:00100000:2.0:1746065081.564985:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12432 00000100:00100000:2.0:1746065081.564992:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:27956:x1830881261519616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.565000:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.565008:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1463c45 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0e2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.565043:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.565051:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565060:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.565071:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00010000:00010000:2.0:1746065081.565127:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565133:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565139:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565144:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.565147:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565152:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565161:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854700) 00010000:00010000:2.0:1746065081.565163:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065081.565166:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565170:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c4c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.565209:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1463c45 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0e2 expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.565216:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1463c45 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0e2 expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.565223:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a200, rc 0) 00000100:00100000:2.0:1746065081.565259:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:27956:x1830881261519616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 268us (516us total) trans 4294975759 rc 301/301 00000100:00100000:2.0:1746065081.565265:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12432 00000100:00100000:3.0:1746065081.566009:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262667264:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.566023:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.566224:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.566360:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261519744 00000100:00100000:2.0:1746065081.566364:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261519744 00010000:00010000:2.0:1746065081.566382:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 297 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.566400:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3688 00000100:00100000:2.0:1746065081.566406:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+297:2005:x1830881261519744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.566413:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.566418:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 297 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.566427:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 297 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.566439:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463c29 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0d4 expref: 297 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.566447:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854700) 00010000:00010000:2.0:1746065081.566450:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.566456:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.566461:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.566607:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.566664:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566672:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.566687:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00000004:00080000:3.0:1746065081.566848:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x37d:0x0], index 1: 0 00000004:00080000:3.0:1746065081.566853:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x37c:0x0], index 0: 0 00000004:00080000:3.0:1746065081.566857:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x37d:0x0], index 0: 0 00000004:00080000:3.0:1746065081.566860:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x37e:0x0], index 1: 0 00010000:00010000:3.0:1746065081.566921:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566927:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566932:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566936:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.566939:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566943:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566951:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854700) 00010000:00010000:3.0:1746065081.566953:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.566955:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566959:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c3e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.566989:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c37 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0db expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.566995:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c37 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0db expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.567006:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad200, rc 0) 00000100:00100000:2.0:1746065081.567060:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2005:x1830881261519744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 652us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.567067:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3688 00000100:00100000:3.0:1746065081.568213:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27954:x1830881261519360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4099us (4440us total) trans 4294975760 rc 301/301 00000100:00100000:3.0:1746065081.568221:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12431 00000100:00100000:2.0:1746065081.570258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.570345:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261520000 00000100:00100000:1.0:1746065081.570353:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261520000 00000100:00100000:1.0:1746065081.570384:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4281 00000100:00100000:1.0:1746065081.570390:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27954:x1830881261520000:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.571337:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27954:x1830881261520000:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 944us (1082us total) trans 4294975761 rc 0/0 00000100:00100000:1.0:1746065081.571344:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4281 00000100:00100000:0.0:1746065081.573367:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.573426:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261520256 00000100:00100000:1.0:1746065081.573432:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261520256 00000100:00100000:1.0:1746065081.573467:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4282 00000100:00100000:1.0:1746065081.573473:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27954:x1830881261520256:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.573610:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27954:x1830881261520256:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 136us (248us total) trans 4294975762 rc 0/0 00000100:00100000:1.0:1746065081.573616:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4282 00000100:00100000:0.0:1746065081.574492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.574568:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261520384 00000100:00100000:3.0:1746065081.574572:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261520384 00000100:00100000:3.0:1746065081.574609:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12433 00000100:00100000:3.0:1746065081.574615:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27956:x1830881261520384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.574626:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.574643:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463c61 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0e9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.574701:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463c68 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.574711:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463c68 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.574721:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463c68 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.574737:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00000004:00200000:3.0:1746065081.574741:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065081.574751:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463c68 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.574767:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463c61 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0e9 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.574972:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463c68 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0e9 expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.574980:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.574983:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.574985:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7aca00, rc 0) 00000100:00100000:3.0:1746065081.575288:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27956:x1830881261520384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 672us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.575294:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12433 00000100:00100000:0.0:1746065081.579406:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.579450:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.579473:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.579591:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261520512 00000100:00100000:3.0:1746065081.579599:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261520512 00000100:00100000:3.0:1746065081.579627:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261520640 00000100:00100000:3.0:1746065081.579629:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261520640 00000100:00100000:3.0:1746065081.579658:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8787 00000100:00100000:3.0:1746065081.579666:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881261520512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.579680:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.579696:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0f0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.579714:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.579729:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.579731:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.579737:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 51 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.579753:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 51 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.579762:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad200, rc 0) 00000100:00100000:2.0:1746065081.579794:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8788 00000100:00100000:2.0:1746065081.579803:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+62:2007:x1830881261520640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.579811:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.579821:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0f7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.579836:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.579844:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.579845:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.579849:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 63 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.579857:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 63 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.579864:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b000, rc 0) 00000100:00100000:2.0:1746065081.579895:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+63:2007:x1830881261520640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 94us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.579901:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8788 00000100:00100000:3.0:1746065081.580190:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881261520512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 524us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.580195:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8787 00000100:00100000:3.0:1746065081.580212:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261520896 00000100:00100000:3.0:1746065081.580214:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261520896 00000100:00100000:3.0:1746065081.580238:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12434 00000100:00100000:3.0:1746065081.580242:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261520896:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.580251:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.580522:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c7d lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d0fe expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.580616:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.580625:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.580720:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.580730:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.580736:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.580740:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.580874:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c92 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.580884:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c92 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.580890:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c92 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.580897:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00010000:00010000:3.0:1746065081.581019:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581025:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581029:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581034:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581039:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.581042:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581047:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581055:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854e00) 00010000:00010000:3.0:1746065081.581058:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.581061:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581066:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463c84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581130:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581136:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581141:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581144:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.581146:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581150:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581156:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.581157:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.581162:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581166:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463c8b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.581190:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463c7d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0fe expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.581202:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c92 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0fe expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.581207:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.581208:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.581210:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b000, rc 0) 00000100:00100000:3.0:1746065081.581239:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261520896:12345-192.168.202.27@tcp:101:bash.0 Request processed in 996us (1789us total) trans 4294975763 rc 0/0 00000100:00100000:3.0:1746065081.581250:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12434 00000100:00100000:0.0:1746065081.582044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.582128:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261521152 00000100:00100000:1.0:1746065081.582132:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261521152 00000100:00100000:1.0:1746065081.582223:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4283 00000100:00100000:1.0:1746065081.582230:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+300:27956:x1830881261521152:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.582322:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+301:27956:x1830881261521152:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 92us (279us total) trans 4294975764 rc 0/0 00000100:00100000:1.0:1746065081.582327:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4283 00000100:00100000:0.0:1746065081.582618:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.582654:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.582692:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261521408 00000100:00100000:2.0:1746065081.582696:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261521408 00000100:00100000:3.0:1746065081.582717:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261521280 00000100:00100000:3.0:1746065081.582721:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261521280 00000100:00100000:2.0:1746065081.582721:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 562 00000100:00100000:2.0:1746065081.582726:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+302:2006:x1830881261521408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.582733:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065081.582746:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12435 00010000:00010000:2.0:1746065081.582749:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463c92 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0fe expref: 302 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.582751:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261521280:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.582760:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.582762:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.582765:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.582767:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463ca0 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d105 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.582805:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc1463ca7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.582813:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc1463ca7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.582816:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+302:2006:x1830881261521408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065081.582819:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc1463ca7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.582821:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 562 00010000:00010000:3.0:1746065081.582874:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463ca0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d105 expref: 302 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.582885:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc1463ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d105 expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.582894:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.582896:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065081.582898:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090176600, rc 0) 00000100:00100000:3.0:1746065081.583102:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261521280:12345-192.168.202.27@tcp:101:bash.0 Request processed in 168us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.583110:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12435 00000100:00100000:0.0:1746065081.583755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.583917:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261521664 00000100:00100000:3.0:1746065081.583921:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261521664 00000100:00100000:3.0:1746065081.583952:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12436 00000100:00100000:3.0:1746065081.583957:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+301:27956:x1830881261521664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.583967:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.583974:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463cae lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d10c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.584020:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1463cb5 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.584027:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1463cb5 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.584033:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1463cb5 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.584040:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00010000:00010000:3.0:1746065081.584095:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463cae lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d10c expref: 304 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.584105:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1463cb5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d10c expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.584115:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.584117:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065081.584119:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00000100:00100000:3.0:1746065081.584154:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+303:27956:x1830881261521664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 196us (399us total) trans 4294975765 rc 0/0 00000100:00100000:3.0:1746065081.584159:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12436 00000100:00100000:0.0:1746065081.584191:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.584211:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261521920 00000100:00100000:2.0:1746065081.584214:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261521920 00000100:00100000:2.0:1746065081.584237:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12437 00000100:00100000:2.0:1746065081.584242:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+303:26180:x1830881261521920:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065081.584265:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.584275:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463c68 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0e9 expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.584284:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.584286:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.584370:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.584377:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.584383:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065081.584413:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975766 00000004:00010000:2.0:1746065081.584428:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800982dea00 reply state ffff880099bac000 transno 4294975767 ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.584435:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.584440:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.584442:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.584444:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.584490:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261521920:12345-192.168.202.27@tcp:36:bash.0 Request processed in 246us (298us total) trans 4294975767 rc 0/0 00000100:00100000:2.0:1746065081.584495:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12437 00000020:00080000:2.0:1746065081.584498:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065081.585255:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.585333:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261522048 00000100:00100000:3.0:1746065081.585336:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261522048 00000100:00100000:3.0:1746065081.585394:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12438 00000100:00100000:3.0:1746065081.585400:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+305:27956:x1830881261522048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.585409:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.585416:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1463cca lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d113 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.585454:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.585462:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.585468:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.585482:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 0 00000004:00200000:3.0:1746065081.585485:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065081.585493:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.585508:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84be00/0xad6b7ddc1463cca lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 307 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.585518:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.585524:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.585526:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.585528:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a600, rc 0) 00000100:00100000:3.0:1746065081.585809:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+306:27956:x1830881261522048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 408us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.585815:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12438 00000100:00100000:1.0:1746065081.585899:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.585964:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261522304 00000100:00100000:3.0:1746065081.585967:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261522304 00000100:00100000:3.0:1746065081.585991:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12439 00000100:00100000:3.0:1746065081.585996:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+306:26180:x1830881261522304:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.586092:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.586094:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.586104:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1463cb5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d10c expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.586113:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.586116:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.586121:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc1463cd8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d11a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.586141:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.586148:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.586155:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 4/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.586178:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.586193:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 306 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.586203:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262667392:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.586356:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.588067:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.588103:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.588191:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262667392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.588205:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065081.588262:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261522688 00000100:00100000:1.0:1746065081.588266:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261522688 00010000:00010000:1.0:1746065081.588286:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 307 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.588305:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3689 00000100:00100000:1.0:1746065081.588310:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+307:2005:x1830881261522688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.588318:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.588322:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 307 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.588331:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 307 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.588349:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a600/0xad6b7ddc1463cd1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d113 expref: 307 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.588355:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261522560 00000100:00100000:2.0:1746065081.588359:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261522560 00010000:00010000:1.0:1746065081.588359:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.588363:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.588370:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.588375:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.588378:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4284 00000100:00100000:2.0:1746065081.588382:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+307:27956:x1830881261522560:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:1.0:1746065081.588388:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.588414:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+307:2005:x1830881261522688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.588420:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3689 00000100:00100000:2.0:1746065081.588489:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+307:27956:x1830881261522560:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 105us (425us total) trans 4294975768 rc 0/0 00000100:00100000:2.0:1746065081.588494:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4284 00010000:00010000:3.0:1746065081.588530:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.588536:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000040:00080000:3.0:1746065081.588683:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2494, 88 off206280 00000004:00080000:3.0:1746065081.588688:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677606913978ns, next at 677717559249ns, rc = 0 00000040:00080000:3.0:1746065081.588724:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2490, 88 off205840 00000004:00080000:3.0:1746065081.588727:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677606953445ns, next at 677717578181ns, rc = 0 00000040:00080000:3.0:1746065081.588747:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2491, 88 off205928 00000004:00080000:3.0:1746065081.588750:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677606976459ns, next at 677717578181ns, rc = 0 00000040:00080000:3.0:1746065081.588759:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2495, 88 off206368 00000004:00080000:3.0:1746065081.588762:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677606988809ns, next at 677717559249ns, rc = 0 00000001:00080000:0.0:1746065081.590129:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975769 is committed 00000004:00080000:0.0:1746065081.590135:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1682 committed 00010000:00010000:3.0:1746065081.590189:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590197:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590203:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590207:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.590210:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590215:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590225:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.590227:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.590230:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590234:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463b9d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.590247:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590251:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590255:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590258:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.590261:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590265:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590269:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a400) 00010000:00010000:3.0:1746065081.590270:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.590272:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590275:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463c22 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.590286:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.590290:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.590293:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.590296:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.590298:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.590302:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.590307:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.590308:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.590309:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.590317:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463cc3 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00080000:0.0:1746065081.590348:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1672 committed 00000004:00080000:0.0:1746065081.590361:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1671 committed 00000004:00080000:0.0:1746065081.590363:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1681 committed 00000100:00100000:0.0:1746065081.590514:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262667520:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.590567:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.590765:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262668032:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.590801:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.590813:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065081.590818:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262667648:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.590830:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.590938:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262667776:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.590961:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262667904:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.591171:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262668160:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.591186:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.591414:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667520 00000100:00100000:2.0:1746065081.591420:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667520 00000100:00100000:2.0:1746065081.591448:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262668032 00000100:00100000:2.0:1746065081.591451:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262668032 00000100:00100000:2.0:1746065081.591461:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667648 00000100:00100000:2.0:1746065081.591462:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667648 00000100:00100000:2.0:1746065081.591470:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262668160 00000100:00100000:2.0:1746065081.591472:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262668160 00000100:00100000:2.0:1746065081.591483:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8789 00000100:00100000:2.0:1746065081.591488:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+117:3761:x1830881262667520:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065081.591507:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:890 count 1 00010000:00010000:2.0:1746065081.591524:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591538:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591556:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.591558:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.591560:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591579:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591589:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 50 pid: 9548 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.591597:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262668544:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.591637:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.591649:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8790 00000100:00100000:2.0:1746065081.591654:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+150:3761:x1830881262668032:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065081.591665:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:891 count 1 00010000:00010000:2.0:1746065081.591676:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591689:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 62 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591693:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.591694:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.591696:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591710:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 62 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591716:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 62 pid: 10219 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.591724:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262668672:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.591741:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.591753:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8791 00000100:00100000:2.0:1746065081.591757:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+117:3761:x1830881262667648:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065081.591767:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:891 count 1 00010000:00010000:2.0:1746065081.591793:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.591802:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.591806:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.591808:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.591810:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.591984:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8792 00000100:00100000:0.0:1746065081.591990:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+150:3761:x1830881262668160:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065081.592000:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:892 count 1 00010000:00010000:0.0:1746065081.592009:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.592017:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065081.592021:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.592022:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.592024:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.592038:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065081.592045:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746065081.592051:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262668800:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.592073:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.592232:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.592248:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262668416:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.592264:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.592282:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667904 00000100:00100000:3.0:1746065081.592285:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667904 00000100:00100000:3.0:1746065081.592297:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262668416 00000100:00100000:3.0:1746065081.592298:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262668416 00000100:00100000:3.0:1746065081.592305:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8793 00000100:00100000:3.0:1746065081.592309:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+118:3760:x1830881262667904:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065081.592407:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592409:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592411:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592412:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:2.0:1746065081.592412:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065081.592414:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1746065081.592424:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746065081.592433:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262668928:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.592439:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+119:3760:x1830881262667904:12345-0@lo:2:osp-syn-0-1.0 Request processed in 129us (206us total) trans 21474839909 rc 0/0 00000100:00100000:3.0:1746065081.592445:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8793 00000100:00100000:2.0:1746065081.592456:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.592458:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8794 00000100:00100000:3.0:1746065081.592462:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+151:3760:x1830881262668416:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065081.592513:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592515:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592517:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592519:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.592520:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.593532:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262668416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1067us (1264us total) trans 17179872631 rc 0/0 00000100:00100000:3.0:1746065081.593539:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8794 00000004:00080000:3.0:1746065081.593587:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf7480/2, rc 0, transno 21474839909 00000100:00100000:3.0:1746065081.593592:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262667904:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.593603:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e52a00/2, rc 0, transno 17179872631 00000100:00100000:3.0:1746065081.593606:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262668416:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.593621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.593643:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262668288:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.593665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.593745:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667776 00000100:00100000:0.0:1746065081.593751:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667776 00000100:00100000:0.0:1746065081.593788:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262668288 00000100:00100000:0.0:1746065081.593790:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262668288 00000100:00100000:1.0:1746065081.593873:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8795 00000100:00100000:1.0:1746065081.593879:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+119:3759:x1830881262667776:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065081.594032:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d11a expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.594041:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.594043:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.594054:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc1463cd8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d11a expref: 287 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065081.594069:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d11a expref: 286 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.594096:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.594098:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.594100:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53d1000, rc 0) 00000100:00100000:3.0:1746065081.594128:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:26180:x1830881261522304:12345-192.168.202.27@tcp:101:bash.0 Request processed in 8132us (8228us total) trans 4294975769 rc 0/0 00000100:00100000:3.0:1746065081.594134:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12439 00000100:00100000:1.0:1746065081.594233:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+120:3759:x1830881262667776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 354us (610us total) trans 21474839910 rc 0/0 00000100:00100000:1.0:1746065081.594238:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8795 00000100:00100000:1.0:1746065081.594249:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8796 00000100:00100000:1.0:1746065081.594253:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+152:3759:x1830881262668288:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.594316:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+153:3759:x1830881262668288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 61us (651us total) trans 17179872632 rc 0/0 00000100:00100000:1.0:1746065081.594320:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8796 00000100:00100000:0.0:1746065081.594469:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.594573:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262668800:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065081.594587:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.594609:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.594623:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.594643:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.594657:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523200 00000100:00100000:0.0:1746065081.594659:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523200 00010000:00010000:0.0:1746065081.594673:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 63 pid: 10219 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.594686:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523072 00000100:00100000:0.0:1746065081.594688:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523072 00010000:00010000:0.0:1746065081.594695:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 51 pid: 9548 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.594705:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523328 00000100:00100000:0.0:1746065081.594706:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523328 00010000:00010000:0.0:1746065081.594712:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 64 pid: 9549 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746065081.594724:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3690 00000100:00100000:0.0:1746065081.594728:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+64:2004:x1830881261523200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.594736:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.594740:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 64 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.594747:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 64 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.594767:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.594769:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.594788:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594795:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.594805:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463b6c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0a3 expref: 64 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.594806:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065081.594816:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881262668672:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.594821:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+63:2004:x1830881261523200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (210us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065081.594827:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.594829:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3690 00010000:00010000:2.0:1746065081.594834:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.594838:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3691 00010000:00010000:2.0:1746065081.594840:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.594842:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261523072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.594846:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594848:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.594851:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 51 pid: 9548 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.594856:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594858:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 51 pid: 9548 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.594868:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.594869:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.594869:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.594871:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594876:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594883:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.594892:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261523072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.594897:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3691 00000100:00100000:0.0:1746065081.594904:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3692 00000100:00100000:0.0:1746065081.594907:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+62:2005:x1830881261523328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.594912:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.594915:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.594923:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.594932:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6a00/0xad6b7ddc1463aaf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d064 expref: 62 pid: 9549 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.594943:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.594945:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.594947:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594952:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.594962:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.594976:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+61:2005:x1830881261523328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.594981:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3692 00000100:00100000:2.0:1746065081.595009:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+153:3761:x1830881262668032:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3354us (4206us total) trans 17179872633 rc 0/0 00010000:00010000:0.0:1746065081.595010:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.595014:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.595015:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8790 00010000:00010000:0.0:1746065081.595021:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.595024:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595034:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746065081.595042:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50700/2, rc 0, transno 17179872633 00010000:00010000:0.0:1746065081.595042:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.595046:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262668032:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065081.595046:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463ced lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595057:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.595058:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.595059:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.595065:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1463b65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d09c expref: 50 pid: 9548 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.595065:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595070:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.595073:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262668544:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065081.595076:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595080:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595081:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595087:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595089:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065081.595092:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595098:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595112:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595122:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065081.595175:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+153:3761:x1830881262668160:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3186us (3988us total) trans 17179872634 rc 0/0 00000100:00100000:0.0:1746065081.595184:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8792 00010000:00010000:0.0:1746065081.595195:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065081.595198:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595204:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.595207:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.595208:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+120:3761:x1830881262667520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3718us (4640us total) trans 21474839911 rc 0/0 00010000:00010000:0.0:1746065081.595212:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.595213:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8789 00010000:00010000:0.0:1746065081.595220:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595227:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.595227:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31200/0xad6b7ddc1463cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595232:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595237:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.595237:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.595238:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.595239:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.595239:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.595245:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595253:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595258:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1463ce6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.595268:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.595270:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.595272:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065081.595285:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50000/2, rc 0, transno 17179872634 00000100:00100000:2.0:1746065081.595288:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262668160:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1746065081.595297:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098581f80/2, rc 0, transno 21474839911 00000100:00100000:2.0:1746065081.595300:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262667520:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.595896:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf6d80/2, rc 0, transno 21474839910 00000100:00100000:3.0:1746065081.595902:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262667776:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.595915:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50e00/2, rc 0, transno 17179872632 00000100:00100000:3.0:1746065081.595918:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262668288:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.595932:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261522944 00000100:00100000:3.0:1746065081.595936:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261522944 00000100:00100000:3.0:1746065081.595957:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12440 00000100:00100000:3.0:1746065081.595962:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27956:x1830881261522944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.595973:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.595984:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1463d02 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d121 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.596040:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.596048:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596055:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596065:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.596070:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596077:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596141:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.596148:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596153:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.596159:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 2 00010000:00010000:3.0:1746065081.596210:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596215:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596219:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596224:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596228:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.596230:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596235:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596241:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854e00) 00010000:00010000:3.0:1746065081.596244:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.596246:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596251:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30400/0xad6b7ddc1463d09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596259:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596264:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596268:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596271:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.596273:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596277:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596282:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012f854700) 00010000:00010000:3.0:1746065081.596283:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.596285:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596289:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30200/0xad6b7ddc1463d10 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.596315:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30a00/0xad6b7ddc1463d02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.596325:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.596330:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.596332:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.596334:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30000, rc 0) 00000100:00100000:3.0:1746065081.596893:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27956:x1830881261522944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 927us (2421us total) trans 4294975770 rc 0/0 00000100:00100000:3.0:1746065081.596899:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12440 00000100:00100000:2.0:1746065081.596977:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262668928:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.596991:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.597033:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.598207:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523456 00000100:00100000:0.0:1746065081.598215:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523456 00010000:00010000:0.0:1746065081.598241:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746065081.598308:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3693 00000100:00100000:0.0:1746065081.598315:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881261523456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.598326:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.598330:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.598339:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.598355:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1463ab6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d06b expref: 50 pid: 9549 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.598367:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.598369:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.598372:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598378:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598403:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.598429:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881261523456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.598435:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3693 00010000:00010000:3.0:1746065081.598457:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.598465:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.598472:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.598478:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.598489:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.598515:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.598533:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523584 00000100:00100000:2.0:1746065081.598536:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523584 00000100:00100000:2.0:1746065081.598571:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4285 00000100:00100000:2.0:1746065081.598576:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261523584:12345-192.168.202.27@tcp:49:bash.0 00000100:00100000:2.0:1746065081.598632:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261523584:12345-192.168.202.27@tcp:49:bash.0 Request processed in 57us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.598637:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4285 00010000:00010000:0.0:1746065081.598858:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.598864:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598870:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.598873:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598881:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598890:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598894:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc1463cf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.598906:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.598907:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.598909:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065081.599121:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+120:3761:x1830881262667648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7361us (8288us total) trans 21474839912 rc 0/0 00000100:00100000:3.0:1746065081.599128:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8791 00000004:00080000:3.0:1746065081.599362:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf6680/2, rc 0, transno 21474839912 00000100:00100000:1.0:1746065081.599365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.599367:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262667648:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.599419:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523840 00000100:00100000:0.0:1746065081.599422:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523840 00000100:00100000:0.0:1746065081.599438:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4286 00000100:00100000:0.0:1746065081.599443:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27956:x1830881261523840:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065081.599532:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27956:x1830881261523840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 89us (168us total) trans 4294975771 rc 0/0 00000100:00100000:0.0:1746065081.599537:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4286 00000100:00100000:2.0:1746065081.601467:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.601741:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261523968 00000100:00100000:3.0:1746065081.601748:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261523968 00000100:00100000:3.0:1746065081.601810:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8797 00000100:00100000:3.0:1746065081.601817:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+61:26180:x1830881261523968:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.601830:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.601844:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d128 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.601862:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.601877:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.601879:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.601885:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 62 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.601892:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.601895:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 62 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.601903:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019ec00, rc 0) 00000100:00100000:3.0:1746065081.601946:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+62:26180:x1830881261523968:12345-192.168.202.27@tcp:101:bash.0 Request processed in 130us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.601951:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8797 00000100:00100000:2.0:1746065081.601952:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261524096 00000100:00100000:2.0:1746065081.601955:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261524096 00000100:00100000:2.0:1746065081.601985:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4287 00000100:00100000:2.0:1746065081.601991:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27956:x1830881261524096:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065081.602069:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27956:x1830881261524096:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.602077:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4287 00000100:00100000:0.0:1746065081.606068:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.606161:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261524224 00000100:00100000:3.0:1746065081.606168:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261524224 00000100:00100000:3.0:1746065081.606357:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8798 00000100:00100000:3.0:1746065081.606366:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+49:26180:x1830881261524224:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.606383:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.606400:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d12f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.606423:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065081.606440:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.606442:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.606449:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.606461:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.606469:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31c00, rc 0) 00000100:00100000:3.0:1746065081.606517:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+50:26180:x1830881261524224:12345-192.168.202.27@tcp:101:bash.0 Request processed in 153us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.606522:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8798 00000100:00100000:0.0:1746065081.611667:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.611812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.611909:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.612123:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261524480 00000100:00100000:3.0:1746065081.612131:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261524480 00002000:00010000:3.0:1746065081.612163:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/892 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.612167:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098583b80 with x1830881261524480 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065081.612177:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098583b80. 00000100:00100000:3.0:1746065081.612192:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261524352 00000100:00100000:3.0:1746065081.612194:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261524352 00002000:00010000:3.0:1746065081.612202:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/893 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.612204:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881261524352 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065081.612209:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd880. 00000100:00100000:3.0:1746065081.612230:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1291 00000100:00100000:3.0:1746065081.612238:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261524480:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065081.612371:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.612374:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.612376:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.612377:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.612378:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.612426:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261524480:12345-192.168.202.27@tcp:10:bash.0 Request processed in 188us (765us total) trans 21474839913 rc 0/0 00000100:00100000:3.0:1746065081.612432:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1291 00002000:00010000:3.0:1746065081.612435:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/892 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.612437:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098583b80 with x1830881261524480 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065081.612440:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098583b80. 00000100:00100000:3.0:1746065081.612453:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1292 00000100:00100000:3.0:1746065081.612457:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+62:2004:x1830881261524352:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065081.612523:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.612525:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.612527:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.612528:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.612530:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.612559:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+63:2004:x1830881261524352:12345-192.168.202.27@tcp:10:bash.0 Request processed in 101us (650us total) trans 17179872635 rc 0/0 00000100:00100000:3.0:1746065081.612564:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1292 00002000:00010000:3.0:1746065081.612566:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/893 (0->18446744073709551615) 00002000:00100000:3.0:1746065081.612568:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881261524352 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065081.612571:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd880. 00000100:00100000:3.0:1746065081.612590:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261524736 00000100:00100000:3.0:1746065081.612593:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261524736 00000100:00100000:3.0:1746065081.612616:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12441 00000100:00100000:3.0:1746065081.612621:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+289:27957:x1830881261524736:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.612630:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.612644:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463d33 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d136 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.612713:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 3/1,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.612724:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.612732:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.612741:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 2 00010000:00010000:3.0:1746065081.612820:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463d33 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.612836:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.612842:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.612845:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065081.612847:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44200, rc 0) 00000100:00100000:3.0:1746065081.612877:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27957:x1830881261524736:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 255us (1065us total) trans 4294975772 rc 0/0 00000100:00100000:3.0:1746065081.612881:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12441 00000100:00100000:0.0:1746065081.617552:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.618026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.618032:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261524992 00000100:00100000:2.0:1746065081.618040:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261524992 00000100:00100000:2.0:1746065081.618079:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4288 00000100:00100000:2.0:1746065081.618086:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261524992:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065081.618288:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261524992:12345-192.168.202.27@tcp:35:bash.0 Request processed in 202us (751us total) trans 4294975773 rc 0/0 00000100:00100000:2.0:1746065081.618294:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4288 00000100:00100000:0.0:1746065081.618492:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261525248 00000100:00100000:0.0:1746065081.618496:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261525248 00000100:00100000:0.0:1746065081.618528:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12442 00000100:00100000:0.0:1746065081.618534:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27957:x1830881261525248:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.618552:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.618568:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463d48 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d13d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.618620:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.618632:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.618637:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 4/0,1 mode: --/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.618660:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.618670:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.618680:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262669056:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.618746:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.621530:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.621603:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261525376 00000100:00100000:3.0:1746065081.621610:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261525376 00010000:00010000:3.0:1746065081.621641:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 294 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.621665:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3694 00000100:00100000:3.0:1746065081.621671:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261525376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.621682:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.621686:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 294 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.621696:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 294 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.621713:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.621718:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,1 mode: --/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.621725:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.621731:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.621745:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.621814:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ac30000/0xad6b7ddc1463d17 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d121 expref: 294 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.621827:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262669056:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.621843:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.621849:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.621853:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.621871:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 5 00010000:00010000:2.0:1746065081.621964:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31200/0xad6b7ddc1463d48 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.621981:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.621991:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.621993:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065081.621995:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30200, rc 0) 00000100:00100000:2.0:1746065081.622029:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27957:x1830881261525248:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3494us (4003us total) trans 4294975774 rc 0/0 00000100:00100000:2.0:1746065081.622035:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12442 00000100:00100000:3.0:1746065081.622177:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+293:2004:x1830881261525376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 505us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.622182:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3694 00000100:00100000:0.0:1746065081.624043:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.624114:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261525504 00000100:00100000:2.0:1746065081.624120:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261525504 00000100:00100000:2.0:1746065081.624164:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12443 00000100:00100000:2.0:1746065081.624171:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27958:x1830881261525504:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1746065081.624189:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.624202:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463d5d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d144 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.624248:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.624258:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.624266:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.624276:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.624281:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.624286:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.624346:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.624355:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.624360:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.624382:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.624391:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 294 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.624399:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262669184:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.624464:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.624652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.624754:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261525632 00000100:00100000:3.0:1746065081.624758:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261525632 00000100:00100000:3.0:1746065081.624799:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12444 00000100:00100000:3.0:1746065081.624805:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27957:x1830881261525632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.624815:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.624821:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1463d79 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d14b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.624860:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.624866:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.624871:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.627341:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262669184:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.627361:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065081.627738:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.627813:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261525760 00000100:00100000:3.0:1746065081.627818:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261525760 00010000:00010000:3.0:1746065081.627839:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 297 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.627858:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3695 00000100:00100000:3.0:1746065081.627864:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+297:2004:x1830881261525760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.627873:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.627877:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 297 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.627886:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 297 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.627928:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463d4f lrc: 0/0,0 mode: --/CW res: [0x240000403:0x356:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d13d expref: 297 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.627954:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.627958:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.627966:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.627971:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.627977:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.627981:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.627984:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.628007:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.628048:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261525760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 184us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.628055:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3695 00010000:00010000:2.0:1746065081.628106:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.628113:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.628152:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 5 00000004:00200000:2.0:1746065081.628156:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.628169:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.628194:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44c00/0xad6b7ddc1463d79 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d14b expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.628204:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d14b expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.628210:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.628213:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.628215:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:2.0:1746065081.628270:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27957:x1830881261525632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3464us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.628275:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12444 00010000:00010000:2.0:1746065081.628295:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628300:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.628316:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 5 00000004:00200000:2.0:1746065081.628318:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.628325:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628332:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628340:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628344:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628352:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628357:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628361:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.628364:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628368:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628374:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd200) 00010000:00010000:2.0:1746065081.628376:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.628379:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628383:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463d64 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628391:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628395:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628399:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628402:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.628404:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628411:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628417:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbdd00) 00010000:00010000:2.0:1746065081.628418:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.628421:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628425:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463d6b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.628447:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463d5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d144 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.628458:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d144 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.628464:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.628466:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.628467:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a400, rc 0) 00000100:00100000:2.0:1746065081.628500:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27958:x1830881261525504:12345-192.168.202.27@tcp:101:rm.0 Request processed in 4329us (4461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.628506:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12443 00000100:00100000:0.0:1746065081.631251:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.631291:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261526016 00000100:00100000:2.0:1746065081.631298:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261526016 00000100:00100000:2.0:1746065081.631342:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4289 00000100:00100000:2.0:1746065081.631349:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27957:x1830881261526016:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.631534:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27957:x1830881261526016:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 184us (288us total) trans 4294975775 rc 0/0 00000100:00100000:2.0:1746065081.631550:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4289 00000100:00100000:2.0:1746065081.631692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.631802:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261526144 00000100:00100000:3.0:1746065081.631807:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261526144 00000100:00100000:3.0:1746065081.631832:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 563 00000100:00100000:3.0:1746065081.631837:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261526144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.631845:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.631861:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463d72 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d144 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.631877:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065081.631881:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.632130:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261526144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 291us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.632136:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 563 00000100:00100000:0.0:1746065081.633266:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.633332:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261526400 00000100:00100000:2.0:1746065081.633337:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261526400 00000100:00100000:2.0:1746065081.633366:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12445 00000100:00100000:2.0:1746065081.633371:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27958:x1830881261526400:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065081.633401:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065081.633414:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc1463cdf lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d11a expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.633429:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44000/0xad6b7ddc1463d80 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d14b expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.633439:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc1463ca7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d105 expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.633447:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.633450:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.633468:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.633477:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.633483:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.633492:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.633500:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.633505:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.633566:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.633573:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.633578:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.633600:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 291 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.633608:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 291 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.633618:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262669312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.634709:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.634794:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.635009:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261526656 00000100:00100000:1.0:1746065081.635014:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261526656 00000100:00100000:1.0:1746065081.635042:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12446 00000100:00100000:1.0:1746065081.635048:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27957:x1830881261526656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.635060:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.635062:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065081.635069:0:7203:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 292 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.635083:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.635087:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635093:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635097:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635106:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.635113:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463d9c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d152 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.635173:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463da3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.635179:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463da3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.635185:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463da3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:1.0:1746065081.635197:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 5 00010000:00010000:2.0:1746065081.635416:0:7231:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff88008f7ff800 x1830881262669312) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 1/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.635425:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463d3a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d136 expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.635439:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262669312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.635449:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.635453:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635459:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635462:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065081.635620:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x356:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1746065081.635674:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635680:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635685:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635689:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.635692:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635696:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6a00/0xad6b7ddc1463d9c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d152 expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.635697:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635704:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.635706:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065081.635709:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635713:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1463d95 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635722:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635723:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463da3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d152 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.635727:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635729:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.635730:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.635731:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.635732:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6600, rc 0) 00010000:00010000:2.0:1746065081.635735:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635738:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.635739:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635743:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635748:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbde00) 00010000:00010000:2.0:1746065081.635750:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.635752:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635755:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1463d87 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065081.635766:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800955cc000 reply state ffff88012c456000 transno 4294975776 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065081.635767:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27957:x1830881261526656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 719us (1060us total) trans 4294975777 rc 0/0 00010000:00010000:2.0:1746065081.635793:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.635798:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd600) 00010000:00010000:2.0:1746065081.635800:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.635802:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.635828:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+295:27958:x1830881261526400:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2457us (2564us total) trans 4294975776 rc 0/0 00000100:00100000:1.0:1746065081.635994:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12446 00000100:00100000:2.0:1746065081.636152:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12445 00000100:00100000:0.0:1746065081.639805:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.639906:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261526784 00000100:00100000:2.0:1746065081.639915:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261526784 00000100:00100000:2.0:1746065081.639954:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12447 00000100:00100000:2.0:1746065081.639960:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27957:x1830881261526784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.639979:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.639993:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463db1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d159 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.640037:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463db1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d159 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.640047:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463db1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d159 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.640059:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065081.640061:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.640064:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b600, rc 0) 00000100:00100000:2.0:1746065081.640095:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+295:27957:x1830881261526784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.640103:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12447 00000100:00100000:0.0:1746065081.641878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.642035:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261526912 00000100:00100000:2.0:1746065081.642040:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261526912 00000100:00100000:2.0:1746065081.642074:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8799 00000100:00100000:2.0:1746065081.642079:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+63:2004:x1830881261526912:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065081.642108:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.642121:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 63 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.642126:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.642128:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.642130:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.642153:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 63 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.642163:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 63 pid: 9550 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.642175:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262669440:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.642232:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.645503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.645592:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262669440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.645611:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.645763:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527040 00000100:00100000:1.0:1746065081.645769:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527040 00002000:00100000:1.0:1746065081.645824:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x37d:0x0] (0->4) req@ffff880099cc1880 x1830881261527040/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/0 e 0 to 0 dl 1746065092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1746065081.645833:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1880 with x1830881261527040 ext(0->4) 00010000:00010000:1.0:1746065081.645839:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 64 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.645850:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 64 pid: 9550 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746065081.645856:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc1880 00000100:00100000:1.0:1746065081.645872:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 222 00000100:00100000:1.0:1746065081.645878:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+64:2005:x1830881261527040:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:1.0:1746065081.647386:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261527040:12345-192.168.202.27@tcp:4:bash.0 Request processed in 1502us (1884us total) trans 17179872636 rc 0/0 00000100:00100000:1.0:1746065081.647395:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 222 00002000:00100000:1.0:1746065081.647402:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x37d:0x0] (0->4) req@ffff880099cc1880 x1830881261527040/t17179872636(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/448 e 0 to 0 dl 1746065092 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1746065081.647740:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1880 with x1830881261527040 ext(0->4) 00010000:00010000:1.0:1746065081.647749:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 66 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.647760:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 66 pid: 9550 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746065081.647767:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc1880 00000100:00100000:0.0:1746065081.650682:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.650726:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.650800:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527296 00000100:00100000:1.0:1746065081.650807:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527296 00000100:00100000:2.0:1746065081.651515:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12448 00000100:00100000:2.0:1746065081.651524:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+295:27959:x1830881261527296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.651546:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.651562:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463dbf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d160 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.651790:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527168 00000100:00100000:3.0:1746065081.651794:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527168 00010000:00010000:3.0:1746065081.651812:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 66 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.651830:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.651841:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.651850:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.651858:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3696 00010000:00010000:2.0:1746065081.651858:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.651863:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.651864:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+66:2006:x1830881261527168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.651868:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.651872:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065081.651884:0:9565:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1746065081.651886:0:9565:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1746065081.651890:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 66 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.651897:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.651899:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 66 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.651902:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.651906:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.651911:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.651912:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009019ec00/0xad6b7ddc1463d25 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d128 expref: 66 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.651916:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.651919:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.651924:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.651936:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.651939:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.651942:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.651949:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.651968:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.652002:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+65:2006:x1830881261527168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 137us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.652007:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3696 00010000:00010000:2.0:1746065081.652155:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbdc00) 00010000:00010000:2.0:1746065081.652159:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.652163:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652167:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463dc6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652375:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652381:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652385:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652389:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.652391:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652396:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652405:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd600) 00010000:00010000:2.0:1746065081.652407:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.652409:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652413:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1463dcd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.652433:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463dbf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d160 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652440:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463dbf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d160 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652450:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a400, rc 0) 00010000:00010000:2.0:1746065081.652464:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652470:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652482:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652487:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652494:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652498:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.652501:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652506:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652514:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.652519:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463db8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.652567:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+64:2004:x1830881261526912:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10487us (10695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.652575:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8799 00000100:00100000:2.0:1746065081.652599:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+295:27959:x1830881261527296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1077us (1924us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.652604:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12448 00000100:00100000:0.0:1746065081.656315:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.656356:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.656405:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527424 00000100:00100000:2.0:1746065081.656412:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527424 00000100:00100000:2.0:1746065081.656442:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527680 00000100:00100000:2.0:1746065081.656445:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527680 00000100:00100000:2.0:1746065081.656470:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12449 00000100:00100000:2.0:1746065081.656477:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:27959:x1830881261527424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.656492:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.656509:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463dd4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d167 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.656569:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.656579:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656587:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656596:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.656601:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656606:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656635:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656640:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656645:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656650:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656655:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.656658:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656663:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656672:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd200) 00010000:00010000:2.0:1746065081.656675:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.656678:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656682:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4200/0xad6b7ddc1463ddb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656690:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656694:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656699:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065081.656700:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12450 00010000:00010000:2.0:1746065081.656702:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.656704:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00000100:00100000:1.0:1746065081.656707:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27957:x1830881261527680:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065081.656709:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656714:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd600) 00010000:00010000:2.0:1746065081.656716:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.656717:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.656721:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463de2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.656724:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.656734:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463db1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d159 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.656738:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463dd4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d167 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.656743:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463dd4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d167 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.656747:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.656749:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.656752:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4400, rc 0) 00010000:00010000:1.0:1746065081.656761:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.656766:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.656788:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.656800:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+295:27959:x1830881261527424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 324us (492us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.656805:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12449 00000040:00080000:1.0:1746065081.656933:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2496, 88 off206456 00000004:00080000:1.0:1746065081.656940:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677675165176ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.656977:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2492, 88 off206016 00000004:00080000:1.0:1746065081.656981:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677675207129ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.657005:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2493, 88 off206104 00000004:00080000:1.0:1746065081.657007:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677675233984ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.657016:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2497, 88 off206544 00000004:00080000:1.0:1746065081.657018:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677675244388ns, next at 677717559249ns, rc = 0 00000100:00100000:1.0:1746065081.662704:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.663309:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527808 00000100:00100000:0.0:1746065081.663317:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527808 00000100:00100000:0.0:1746065081.663364:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12451 00000100:00100000:0.0:1746065081.663371:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27959:x1830881261527808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.663389:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.663406:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463df0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d16e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746065081.663440:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975778 is committed 00000004:00080000:2.0:1746065081.663446:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1684 committed 00010000:00010000:0.0:1746065081.663455:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463df7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065081.663465:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463df7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.663475:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463df7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065081.663722:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1746065081.663726:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1746065081.663749:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31a00/0xad6b7ddc1463df0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d16e expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.663819:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463df7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d16e expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.663826:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:0.0:1746065081.663828:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00080000:2.0:1746065081.663851:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1674 committed 00010000:00010000:0.0:1746065081.663879:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:0.0:1746065081.663917:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27959:x1830881261527808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 547us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.663922:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12451 00000100:00100000:3.0:1746065081.663939:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262669568:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065081.663939:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.663945:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.663950:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.663954:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.663957:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.663961:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.663970:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065081.663970:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd600) 00010000:00010000:0.0:1746065081.663971:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.663974:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.663978:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463d8e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065081.664000:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065081.664004:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262669696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.664017:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.664034:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262669568 00000100:00100000:3.0:1746065081.664037:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262669568 00000100:00100000:3.0:1746065081.664060:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262669696 00000100:00100000:3.0:1746065081.664062:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262669696 00000100:00100000:3.0:1746065081.664073:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8800 00000100:00100000:3.0:1746065081.664078:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+154:3761:x1830881262669568:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.664174:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+155:3761:x1830881262669568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (203us total) trans 17179872637 rc 0/0 00000100:00100000:3.0:1746065081.664180:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8800 00000100:00100000:3.0:1746065081.664189:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8801 00000100:00100000:3.0:1746065081.664192:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+154:3761:x1830881262669696:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065081.664231:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.664235:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.664236:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.664238:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.664240:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1746065081.664585:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1673 committed 00000004:00080000:2.0:1746065081.664592:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1683 committed 00000004:00080000:2.0:1746065081.664659:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a2a00/2, rc 0, transno 17179872638 00000004:00010000:1.0:1746065081.664660:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc2a00 reply state ffff88008c532800 transno 4294975778 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.664664:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262669696:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065081.664669:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000004:00080000:2.0:1746065081.664670:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009858ed80/2, rc 0, transno 17179872637 00000100:00100000:2.0:1746065081.664673:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262669568:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1746065081.664675:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.664677:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065081.664680:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.664706:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262669952:0@lo:2:osp-syn-0-1.0 00010000:00080000:1.0:1746065081.664718:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065081.664725:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.664726:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27957:x1830881261527680:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 8019us (8370us total) trans 4294975778 rc 0/0 00000100:00100000:1.0:1746065081.664731:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12450 00000100:00100000:2.0:1746065081.664737:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065081.664741:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262669824:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065081.664746:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.664752:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.664754:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065081.664757:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.664761:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad600 already unused, calling callback (ffffffffa0f21690) 00000100:00100000:0.0:1746065081.664905:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262669952 00000100:00100000:0.0:1746065081.664908:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262669952 00000100:00100000:2.0:1746065081.664919:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262669824 00000100:00100000:2.0:1746065081.664921:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262669824 00000100:00100000:0.0:1746065081.664926:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8802 00000100:00100000:0.0:1746065081.664930:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+121:3760:x1830881262669952:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.664934:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8803 00000100:00100000:2.0:1746065081.664937:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+121:3760:x1830881262669824:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065081.664988:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.664990:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.664992:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.664993:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.664995:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746065081.665001:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.665003:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.665004:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.665006:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.665007:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.665015:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+123:3760:x1830881262669824:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (259us total) trans 21474839915 rc 0/0 00000100:00100000:2.0:1746065081.665019:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8803 00000100:00100000:0.0:1746065081.665021:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+123:3760:x1830881262669952:12345-0@lo:2:osp-syn-0-1.0 Request processed in 91us (295us total) trans 21474839914 rc 0/0 00000100:00100000:0.0:1746065081.665025:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8802 00000004:00080000:2.0:1746065081.665040:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7ff800/2, rc 0, transno 21474839915 00000100:00100000:2.0:1746065081.665043:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262669824:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.665049:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fdc00/2, rc 0, transno 21474839914 00000100:00100000:2.0:1746065081.665051:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262669952:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065081.665070:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.665076:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.665083:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.665085:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.665087:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.665091:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463de9 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065081.666031:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+155:3761:x1830881262669696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 63us (238us total) trans 17179872638 rc 0/0 00000100:00100000:3.0:1746065081.666041:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8801 00000100:00100000:0.0:1746065081.667909:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.668023:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261527936 00000100:00100000:1.0:1746065081.668031:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261527936 00000100:00100000:1.0:1746065081.668070:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12452 00000100:00100000:1.0:1746065081.668077:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+286:27957:x1830881261527936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.668096:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.668109:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d175 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.668155:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.668167:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 287 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.668181:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.668184:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.668187:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad000, rc 0) 00000100:00100000:1.0:1746065081.668746:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27957:x1830881261527936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 668us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.668752:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12452 00000100:00100000:0.0:1746065081.672248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.674020:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261528064 00000100:00100000:1.0:1746065081.674031:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261528064 00000100:00100000:1.0:1746065081.674073:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12453 00000100:00100000:1.0:1746065081.674081:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27959:x1830881261528064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.674095:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.674110:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463e05 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d17c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.674162:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.674174:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674183:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674193:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.674199:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674204:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674238:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674243:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674248:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674253:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674257:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.674260:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674266:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674275:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:1.0:1746065081.674278:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.674282:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.674286:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1463e0c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675766:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675788:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675794:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675798:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7aca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.675801:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675807:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675816:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880092a25a00) 00010000:00010000:1.0:1746065081.675818:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.675820:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675825:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1463e13 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.675864:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463e05 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d17c expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.675870:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463e05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d17c expref: 288 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.675876:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac600, rc 0) 00000100:00100000:1.0:1746065081.676411:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+287:27959:x1830881261528064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2327us (4169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065081.676419:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12453 00000100:00100000:0.0:1746065081.676498:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.676516:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261528192 00000100:00100000:0.0:1746065081.676521:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261528192 00000100:00100000:0.0:1746065081.676567:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12454 00000100:00100000:0.0:1746065081.676573:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+287:27957:x1830881261528192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.676585:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.676596:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1463e1a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d183 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.676644:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463e21 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065081.676653:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463e21 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.676661:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463e21 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065081.676690:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x356:0x0]: returning size 5 00000004:00200000:0.0:1746065081.676694:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065081.676706:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463e21 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.676721:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c31c00/0xad6b7ddc1463e1a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d183 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.676732:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463e21 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d183 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.676738:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065081.676740:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065081.676742:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30200, rc 0) 00000100:00100000:0.0:1746065081.676768:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27957:x1830881261528192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 189us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.676799:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12454 00000100:00100000:0.0:1746065081.678494:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.678587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.678657:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261528320 00000100:00100000:3.0:1746065081.678663:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261528320 00000100:00100000:1.0:1746065081.678666:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261528576 00000100:00100000:1.0:1746065081.678670:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261528576 00000100:00100000:3.0:1746065081.678760:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8804 00000100:00100000:3.0:1746065081.678768:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+64:2005:x1830881261528320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.678877:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.678892:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d18a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.678909:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37d:0x0] initial LVB size: 5, mtime: 0x6812d6b9, atime: 0x0, ctime: 0x6812d6b9, blocks: 0x8 00010000:00010000:3.0:1746065081.678924:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.678926:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.678933:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 65 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.678944:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 65 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.678953:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:3.0:1746065081.678983:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+65:2005:x1830881261528320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 217us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.678988:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8804 00000100:00100000:1.0:1746065081.679071:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12455 00000100:00100000:1.0:1746065081.679077:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:27959:x1830881261528576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.679088:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.679090:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065081.679103:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30000/0xad6b7ddc1463df7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d16e expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.679112:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:1.0:1746065081.679119:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.679125:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463e2f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d191 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.679185:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.679192:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679198:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679205:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.679209:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679213:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679449:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.679456:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679464:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065081.679470:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 0 00010000:00010000:1.0:1746065081.679483:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679487:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679492:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679496:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679500:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.679502:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679506:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679511:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880092a25b00) 00010000:00010000:1.0:1746065081.679513:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.679515:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679519:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e36 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065081.679525:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc1c00 reply state ffff88012f0ea000 transno 4294975779 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679534:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.679550:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a65aa800) 00010000:00010000:1.0:1746065081.679552:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065081.679553:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.679569:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463e2f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.679578:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.679583:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff880099caf000) 00010000:00010000:1.0:1746065081.679585:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065081.679586:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a800, rc 0) 00000100:00100000:1.0:1746065081.679616:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27959:x1830881261528576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 539us (1030us total) trans 4294975779 rc 0/0 00000100:00100000:1.0:1746065081.679621:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12455 00000100:00100000:0.0:1746065081.684171:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.684215:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.684281:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261528832 00000100:00100000:1.0:1746065081.684289:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261528832 00000100:00100000:1.0:1746065081.684323:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12456 00000100:00100000:3.0:1746065081.684326:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261528960 00000100:00100000:1.0:1746065081.684330:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27959:x1830881261528832:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065081.684331:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261528960 00010000:00010000:1.0:1746065081.684348:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065081.684353:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8805 00000100:00100000:3.0:1746065081.684358:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+65:2007:x1830881261528960:12345-192.168.202.27@tcp:23:lfs.0 00010000:00010000:1.0:1746065081.684361:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463e52 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d198 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.684427:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+65:2007:x1830881261528960:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 69us (212us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065081.684432:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065081.684433:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8805 00010000:00010000:1.0:1746065081.684445:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.684452:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.684474:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.684482:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 291 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.684491:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262670080:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.684535:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.685849:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262670080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.685862:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:2.0:1746065081.686320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.686375:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.686428:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261529088 00000100:00100000:3.0:1746065081.686432:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261529088 00000100:00100000:3.0:1746065081.686454:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8806 00000100:00100000:3.0:1746065081.686460:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+65:2005:x1830881261529088:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065081.686465:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261529216 00000100:00100000:0.0:1746065081.686468:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261529216 00010000:00010000:0.0:1746065081.686486:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 292 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.686504:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3697 00000100:00100000:0.0:1746065081.686509:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+292:2004:x1830881261529216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065081.686511:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+65:2005:x1830881261529088:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.686517:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8806 00010000:00010000:0.0:1746065081.686523:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.686528:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 292 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.686536:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 292 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.686563:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463e44 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d191 expref: 292 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.686573:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff880099caf000) 00010000:00010000:0.0:1746065081.686576:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.686583:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.686587:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.686610:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.686630:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+291:2004:x1830881261529216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (254us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065081.686636:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065081.686636:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3697 00010000:00010000:1.0:1746065081.686641:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065081.686657:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 0 00000004:00080000:1.0:1746065081.687005:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x37e:0x0], index 0: 0 00000004:00080000:1.0:1746065081.687012:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x37f:0x0], index 1: 0 00000004:00080000:1.0:1746065081.687016:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x380:0x0], index 1: 0 00000004:00080000:1.0:1746065081.687019:0:7204:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x37f:0x0], index 0: 0 00010000:00010000:1.0:1746065081.687091:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687098:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687102:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687106:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.687109:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687113:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687120:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff880099caf000) 00010000:00010000:1.0:1746065081.687122:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.687124:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687128:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463e59 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.687157:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463e52 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d198 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.687163:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463e52 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d198 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.687172:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b600, rc 0) 00000100:00100000:1.0:1746065081.687204:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27959:x1830881261528832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2874us (3040us total) trans 4294975780 rc 301/301 00000100:00100000:1.0:1746065081.687213:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12456 00000100:00100000:0.0:1746065081.688826:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.688998:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261529472 00000100:00100000:2.0:1746065081.689004:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261529472 00000100:00100000:2.0:1746065081.689039:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4290 00000100:00100000:2.0:1746065081.689045:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27959:x1830881261529472:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.689223:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27959:x1830881261529472:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 177us (400us total) trans 4294975781 rc 0/0 00000100:00100000:2.0:1746065081.689229:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4290 00000100:00100000:0.0:1746065081.689657:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.689715:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261529728 00000100:00100000:1.0:1746065081.689719:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261529728 00000100:00100000:1.0:1746065081.689741:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12457 00000100:00100000:1.0:1746065081.689746:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27957:x1830881261529728:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065081.689765:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.689800:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30200/0xad6b7ddc1463e21 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x356:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d183 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.689812:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.689816:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.689834:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.689843:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.689850:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065081.689890:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc0700 reply state ffff8800997f4000 transno 4294975782 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.689897:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.689901:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.689904:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065081.689906:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065081.689935:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27957:x1830881261529728:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 188us (278us total) trans 4294975782 rc 0/0 00000100:00100000:1.0:1746065081.689941:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12457 00000100:00100000:0.0:1746065081.692192:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.692250:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261529984 00000100:00100000:2.0:1746065081.692254:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261529984 00000100:00100000:2.0:1746065081.692280:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4291 00000100:00100000:2.0:1746065081.692285:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27959:x1830881261529984:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.692593:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27959:x1830881261529984:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 306us (403us total) trans 4294975783 rc 0/0 00000100:00100000:2.0:1746065081.692599:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4291 00000100:00100000:0.0:1746065081.692854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.693896:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261530112 00000100:00100000:2.0:1746065081.693901:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261530112 00000100:00100000:2.0:1746065081.693940:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8807 00000100:00100000:2.0:1746065081.693952:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+65:2005:x1830881261530112:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065081.694049:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065081.694052:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.694054:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb atime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.694055:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.694057:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065081.694083:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261530112:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 138us (1229us total) trans 17179872639 rc 0/0 00000100:00100000:2.0:1746065081.694088:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8807 00000100:00100000:1.0:1746065081.699366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.699990:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261530368 00000100:00100000:2.0:1746065081.699997:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261530368 00000100:00100000:1.0:1746065081.700007:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.700022:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261530624 00000100:00100000:1.0:1746065081.700024:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261530624 00000100:00100000:2.0:1746065081.700034:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12458 00000100:00100000:1.0:1746065081.700040:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4292 00000100:00100000:2.0:1746065081.700041:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261530368:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065081.700044:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27957:x1830881261530624:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065081.700106:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x356:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463da3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d152 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.700142:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065081.700143:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.700151:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.700153:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463e75 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d19f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.700157:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.700180:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.700190:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 295 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.700200:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262670208:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.700233:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.700240:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00000100:00100000:1.0:1746065081.700269:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065081.700348:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700359:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.700368:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700373:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700412:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463e8a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.700418:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463e8a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700423:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463e8a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.700430:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 0 00010000:00010000:3.0:1746065081.700488:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700494:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700498:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700503:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700507:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.700510:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700514:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700524:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854e00) 00010000:00010000:3.0:1746065081.700527:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.700529:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700533:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d45400/0xad6b7ddc1463e7c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700677:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700686:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700695:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700698:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.700700:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700704:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700715:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a65aa800) 00010000:00010000:3.0:1746065081.700717:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.700719:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700722:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c400/0xad6b7ddc1463e83 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.700767:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44200/0xad6b7ddc1463e75 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d19f expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.700800:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463e8a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d19f expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.700805:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.700807:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.700809:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d000, rc 0) 00000100:00100000:3.0:1746065081.700863:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261530368:12345-192.168.202.27@tcp:101:bash.0 Request processed in 823us (1503us total) trans 4294975784 rc 0/0 00000100:00100000:3.0:1746065081.700880:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12458 00000100:00100000:1.0:1746065081.702428:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262670208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.702446:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:2.0:1746065081.703759:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.703909:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261530752 00000100:00100000:0.0:1746065081.703915:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261530752 00010000:00010000:0.0:1746065081.703942:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 296 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.703973:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3698 00000100:00100000:0.0:1746065081.703980:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261530752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.703990:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.703995:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 296 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.704005:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 296 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.704021:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1463dfe lrc: 0/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d175 expref: 296 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.704034:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065081.704038:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.704045:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.704050:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.704064:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.704090:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261530752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.704095:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3698 00000100:00100000:0.0:1746065081.704151:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.704263:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261530880 00000100:00100000:2.0:1746065081.704266:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261530880 00000100:00100000:2.0:1746065081.704289:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12459 00000100:00100000:2.0:1746065081.704294:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261530880:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.704310:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.704319:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463e98 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1a6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.704340:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc1463e9f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.704347:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc1463e9f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.704353:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc1463e9f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.704449:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463e98 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1a6 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.704463:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc1463e9f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1a6 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.704469:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.704471:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065081.704472:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358800, rc 0) 00000100:00100000:2.0:1746065081.704493:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261530880:12345-192.168.202.27@tcp:101:bash.0 Request processed in 199us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.704498:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12459 00010000:00010000:1.0:1746065081.704592:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.704599:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:1.0:1746065081.704794:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2498, 88 off206632 00000004:00080000:1.0:1746065081.704800:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677723025849ns, next at 677717559249ns, rc = 0 00000040:00080000:1.0:1746065081.704829:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2494, 88 off206192 00000004:00080000:1.0:1746065081.704832:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677723058433ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.704855:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2495, 88 off206280 00000004:00080000:1.0:1746065081.704858:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677723084306ns, next at 677717578181ns, rc = 0 00000040:00080000:1.0:1746065081.704866:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2499, 88 off206720 00000004:00080000:1.0:1746065081.704869:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677723095324ns, next at 677717559249ns, rc = 0 00000100:00100000:0.0:1746065081.706576:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.706639:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261531136 00000100:00100000:3.0:1746065081.706645:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261531136 00000100:00100000:3.0:1746065081.706682:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12460 00000100:00100000:3.0:1746065081.706687:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261531136:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065081.706718:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.706736:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463e8a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d19f expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.706751:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.706754:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.707096:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065081.707106:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.707113:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:0.0:1746065081.707138:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975786 00000004:00010000:0.0:1746065081.707157:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc0380 reply state ffff88009a58e000 transno 4294975787 ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.707164:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.707169:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.707171:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065081.707173:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065081.707233:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+299:26180:x1830881261531136:12345-192.168.202.27@tcp:36:bash.0 Request processed in 544us (661us total) trans 4294975787 rc 0/0 00000100:00100000:0.0:1746065081.707238:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12460 00000020:00080000:0.0:1746065081.707241:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1746065081.708249:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975785 is committed 00000004:00080000:2.0:1746065081.708254:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1686 committed 00000004:00080000:2.0:1746065081.708259:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1676 committed 00000004:00080000:2.0:1746065081.708270:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1675 committed 00000004:00080000:2.0:1746065081.708272:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1685 committed 00000100:00100000:3.0:1746065081.708376:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262670464:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.708411:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.708433:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065081.708437:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262670336:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.708451:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.708469:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670464 00000100:00100000:3.0:1746065081.708473:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670464 00000100:00100000:3.0:1746065081.708494:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670336 00000100:00100000:3.0:1746065081.708496:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670336 00000100:00100000:3.0:1746065081.708511:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8808 00000100:00100000:3.0:1746065081.708517:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+123:3762:x1830881262670464:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065081.708604:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.708607:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.708608:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.708610:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.708611:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.708634:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+124:3762:x1830881262670464:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (222us total) trans 21474839916 rc 0/0 00000100:00100000:3.0:1746065081.708639:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8808 00000100:00100000:3.0:1746065081.708649:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8809 00000100:00100000:3.0:1746065081.708653:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+123:3762:x1830881262670336:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065081.708688:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.708690:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:3.0:1746065081.708691:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.708693:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:3.0:1746065081.708694:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.708711:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+124:3762:x1830881262670336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 58us (259us total) trans 21474839917 rc 0/0 00000100:00100000:3.0:1746065081.708716:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8809 00000004:00080000:3.0:1746065081.708742:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a1f80/2, rc 0, transno 21474839917 00000100:00100000:3.0:1746065081.708746:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262670336:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.708753:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a3480/2, rc 0, transno 21474839916 00000100:00100000:3.0:1746065081.708755:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262670464:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.708956:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262670592:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.708978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.709004:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065081.709008:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262670720:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.709022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.709068:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670592 00000100:00100000:0.0:1746065081.709071:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670592 00000100:00100000:0.0:1746065081.709086:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670720 00000100:00100000:0.0:1746065081.709088:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670720 00000100:00100000:0.0:1746065081.709097:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8810 00000100:00100000:0.0:1746065081.709100:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+156:3759:x1830881262670592:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065081.709150:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1746065081.709153:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.709155:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb atime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.709157:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:0.0:1746065081.709158:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1746065081.709180:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+157:3759:x1830881262670592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 79us (201us total) trans 17179872640 rc 0/0 00000100:00100000:0.0:1746065081.709185:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8810 00000100:00100000:0.0:1746065081.709195:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8811 00000100:00100000:0.0:1746065081.709199:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+156:3759:x1830881262670720:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065081.709234:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.709236:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.709238:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.709239:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.709241:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.709256:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+157:3759:x1830881262670720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (233us total) trans 17179872641 rc 0/0 00000100:00100000:0.0:1746065081.709261:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8811 00010000:00010000:1.0:1746065081.709322:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709329:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709334:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709338:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.709341:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709347:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709356:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a65aa800) 00010000:00010000:1.0:1746065081.709358:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.709361:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709365:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f2b8400/0xad6b7ddc1463e3d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709384:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709388:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709392:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709395:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.709397:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709401:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709406:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.709408:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.709410:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.709414:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a400/0xad6b7ddc1463e67 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065081.709439:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b26850 reply state ffff88008c532c00 transno 4294975785 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709447:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709452:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.709454:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065081.709456:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.709460:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.709461:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065081.709465:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b6600/0xad6b7ddc1463da3 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d152 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065081.709515:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065081.709523:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27957:x1830881261530624:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 9477us (9516us total) trans 4294975785 rc 0/0 00000100:00100000:1.0:1746065081.709529:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4292 00010000:00010000:1.0:1746065081.709580:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709585:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709589:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709593:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.709595:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709599:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709608:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065081.709610:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.709611:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.709615:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463e6e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000004:00080000:2.0:1746065081.709735:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cc380/2, rc 0, transno 17179872641 00000100:00100000:2.0:1746065081.709739:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262670720:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065081.709744:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800982cdc00/2, rc 0, transno 17179872640 00000100:00100000:2.0:1746065081.709746:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262670592:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.710303:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.710377:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261531264 00000100:00100000:2.0:1746065081.710381:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261531264 00000100:00100000:2.0:1746065081.710403:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12461 00000100:00100000:2.0:1746065081.710408:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261531264:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.710418:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.710428:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ead lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1ad expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.710458:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ead lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ad expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.710467:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ead lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ad expref: 289 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.710479:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.710481:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.710483:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0e0600, rc 0) 00000100:00100000:2.0:1746065081.710629:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261531264:12345-192.168.202.27@tcp:101:bash.0 Request processed in 219us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.710634:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12461 00000100:00100000:0.0:1746065081.711158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.711210:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261531392 00000100:00100000:2.0:1746065081.711213:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261531392 00000100:00100000:2.0:1746065081.711228:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12462 00000100:00100000:2.0:1746065081.711233:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27957:x1830881261531392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.711244:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.711252:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0200/0xad6b7ddc1463eb4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1b4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.711272:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0200/0xad6b7ddc1463eb4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1b4 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.711278:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0200/0xad6b7ddc1463eb4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x356:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1b4 expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.711286:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff8800ac4f4700) 00010000:00010000:2.0:1746065081.711288:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.711290:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0e0200, rc 0) 00000100:00100000:2.0:1746065081.711320:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27957:x1830881261531392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.711325:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12462 00000100:00100000:0.0:1746065081.712492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.712551:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261531648 00000100:00100000:2.0:1746065081.712554:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261531648 00000100:00100000:2.0:1746065081.712573:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12463 00000100:00100000:2.0:1746065081.712577:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261531648:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.712586:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.712588:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065081.712598:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ead lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ad expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.712616:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.712619:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.712645:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463ebb lrc: 2/0,0 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1bb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.712670:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463ec2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.712677:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463ec2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.712683:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463ec2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:2.0:1746065081.716721:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2496, 88 off206368 00000004:00080000:2.0:1746065081.716729:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677734955088ns, next at 677717578181ns, rc = 0 00000040:00080000:2.0:1746065081.716761:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2500, 88 off206808 00000004:00080000:2.0:1746065081.716764:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677734990325ns, next at 677717559249ns, rc = 0 00000040:00080000:2.0:1746065081.716786:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2501, 88 off206896 00000004:00080000:2.0:1746065081.716789:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677735015135ns, next at 677717559249ns, rc = 0 00000040:00080000:2.0:1746065081.716797:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2497, 88 off206456 00000004:00080000:2.0:1746065081.716799:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677735025405ns, next at 677717578181ns, rc = 0 00000100:00100000:0.0:1746065081.719681:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.719808:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261531904 00000100:00100000:1.0:1746065081.719815:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261531904 00000100:00100000:1.0:1746065081.719855:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4293 00000100:00100000:1.0:1746065081.719861:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27957:x1830881261531904:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:1.0:1746065081.720340:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x356:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1746065081.720379:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2502, 64 off206960 00000004:00080000:1.0:1746065081.720384:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677738610069ns, next at 678738608678ns, rc = 0 00000040:00080000:1.0:1746065081.720395:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2498, 64 off206520 00000004:00080000:1.0:1746065081.720397:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677738623887ns, next at 678738623360ns, rc = 0 00000040:00080000:1.0:1746065081.720403:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2499, 64 off206584 00000040:00080000:1.0:1746065081.720410:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2503, 64 off207024 00010000:00010000:1.0:1746065081.720528:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065081.720551:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.720560:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.720566:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.720575:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.720581:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.720596:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.720617:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.720622:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.720627:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.720630:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.720638:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.720647:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x356:0x0].0x0 (ffff8800ac4f4700) 00010000:00010000:0.0:1746065081.720649:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065081.720652:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.720656:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463ec9 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x356:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.720666:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.720667:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.720669:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065081.720854:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27957:x1830881261531904:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 991us (1178us total) trans 4294975789 rc 0/0 00000100:00100000:1.0:1746065081.720861:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4293 00000001:00080000:2.0:1746065081.721352:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975788 is committed 00000004:00080000:2.0:1746065081.721358:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1678 committed 00000004:00080000:2.0:1746065081.721370:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1688 committed 00000004:00080000:2.0:1746065081.721374:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1687 committed 00000004:00080000:2.0:1746065081.721376:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1677 committed 00000100:00100000:3.0:1746065081.721437:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262670976:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.721437:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262670848:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.721465:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.721466:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262671232:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.721481:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.721495:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.721522:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670976 00000100:00100000:3.0:1746065081.721526:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670976 00010000:00010000:2.0:1746065081.721527:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463ec2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1bb expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.721534:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.721536:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1746065081.721554:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262671232 00000100:00100000:3.0:1746065081.721556:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262671232 00010000:00010000:2.0:1746065081.721557:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4400/0xad6b7ddc1463ebb lrc: 0/0,0 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1bb expref: 290 pid: 7205 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746065081.721567:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670848 00010000:00010000:2.0:1746065081.721568:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463ec2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1bb expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.721569:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670848 00000100:00100000:3.0:1746065081.721579:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8812 00000100:00100000:3.0:1746065081.721583:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+124:3762:x1830881262670976:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1746065081.721583:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.721585:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065081.721587:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4600, rc 0) 00000100:00100000:2.0:1746065081.721607:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261531648:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9029us (9116us total) trans 4294975788 rc 0/0 00000100:00100000:2.0:1746065081.721612:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12463 00000100:00100000:2.0:1746065081.721633:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800727a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262671104:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.721650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.721664:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+125:3762:x1830881262670976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 81us (199us total) trans 21474839918 rc 0/0 00000100:00100000:3.0:1746065081.721669:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8812 00000100:00100000:2.0:1746065081.721674:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262671104 00000100:00100000:3.0:1746065081.721677:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8813 00000100:00100000:2.0:1746065081.721677:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262671104 00000100:00100000:3.0:1746065081.721681:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+158:3759:x1830881262671232:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.721693:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8814 00000100:00100000:2.0:1746065081.721697:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+158:3761:x1830881262670848:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.721740:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+160:3759:x1830881262671232:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (257us total) trans 17179872642 rc 0/0 00000100:00100000:2.0:1746065081.721743:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+160:3761:x1830881262670848:12345-0@lo:2:osp-syn-1-1.0 Request processed in 46us (247us total) trans 17179872643 rc 0/0 00000100:00100000:3.0:1746065081.721744:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8813 00000100:00100000:2.0:1746065081.721747:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8814 00000100:00100000:3.0:1746065081.721753:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8815 00000100:00100000:3.0:1746065081.721756:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+125:3759:x1830881262671104:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.721785:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7ff480/2, rc 0, transno 17179872643 00000100:00100000:2.0:1746065081.721792:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262670848:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065081.721809:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc380/2, rc 0, transno 17179872642 00000100:00100000:2.0:1746065081.721813:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262671232:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.721821:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+126:3759:x1830881262671104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 64us (170us total) trans 21474839919 rc 0/0 00000004:00080000:2.0:1746065081.721821:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a0000/2, rc 0, transno 21474839919 00000100:00100000:2.0:1746065081.721825:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262671104:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.721826:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8815 00000004:00080000:3.0:1746065081.721844:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800727a3100/2, rc 0, transno 21474839918 00000100:00100000:3.0:1746065081.721849:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800727a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262670976:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065081.721877:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.721884:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.721889:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.721896:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.721899:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.721904:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.721911:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:1.0:1746065081.721913:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.721916:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.721920:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099c30c00/0xad6b7ddc1463ea6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065081.725964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.727512:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261532032 00000100:00100000:1.0:1746065081.727522:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261532032 00000100:00100000:1.0:1746065081.727583:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8816 00000100:00100000:1.0:1746065081.727591:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+51:26180:x1830881261532032:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.727606:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.727624:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1c2 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.727643:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.727659:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.727661:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.727667:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.727679:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.727688:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:1.0:1746065081.727738:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+52:26180:x1830881261532032:12345-192.168.202.27@tcp:101:bash.0 Request processed in 148us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.727743:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8816 00000100:00100000:0.0:1746065081.730685:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.731103:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261532160 00000100:00100000:1.0:1746065081.731110:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261532160 00000100:00100000:1.0:1746065081.731144:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8817 00000100:00100000:1.0:1746065081.731151:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+66:26180:x1830881261532160:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.731166:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.731182:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1c9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.731199:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.731215:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.731217:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.731224:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 67 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.731235:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 67 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.731244:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad600, rc 0) 00000100:00100000:1.0:1746065081.731298:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+67:26180:x1830881261532160:12345-192.168.202.27@tcp:101:bash.0 Request processed in 146us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.731304:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8817 00000100:00100000:0.0:1746065081.733144:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.733179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.733289:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261532288 00000100:00100000:2.0:1746065081.733297:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261532288 00002000:00010000:2.0:1746065081.733327:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/894 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.733330:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459500 with x1830881261532288 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.733337:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459500. 00000100:00100000:1.0:1746065081.733656:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261532416 00000100:00100000:1.0:1746065081.733660:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261532416 00000100:00100000:2.0:1746065081.733661:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1293 00000100:00100000:2.0:1746065081.733667:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261532288:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:1.0:1746065081.733672:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/895 (0->18446744073709551615) 00002000:00100000:1.0:1746065081.733674:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45a300 with x1830881261532416 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065081.733679:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45a300. 00000100:00100000:1.0:1746065081.733811:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1294 00000100:00100000:1.0:1746065081.733817:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+67:2005:x1830881261532416:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065081.733919:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065081.733919:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.733922:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:1.0:1746065081.733922:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb mtime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.733924:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065081.733924:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.733925:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:1.0:1746065081.733925:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb ctime from disk: 0 -> 1746065081 00002000:00010000:2.0:1746065081.733927:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1746065081.733927:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065081.733960:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+68:2005:x1830881261532416:12345-192.168.202.27@tcp:10:bash.0 Request processed in 142us (780us total) trans 17179872644 rc 0/0 00000100:00100000:1.0:1746065081.733965:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1294 00002000:00010000:1.0:1746065081.733968:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/895 (0->18446744073709551615) 00002000:00100000:1.0:1746065081.733970:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45a300 with x1830881261532416 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065081.733973:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45a300. 00000100:00100000:2.0:1746065081.734389:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261532288:12345-192.168.202.27@tcp:10:bash.0 Request processed in 720us (1248us total) trans 21474839920 rc 0/0 00000100:00100000:2.0:1746065081.734395:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1293 00002000:00010000:2.0:1746065081.734398:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/894 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.734400:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459500 with x1830881261532288 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.734404:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459500. 00000100:00100000:0.0:1746065081.736211:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.736716:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261532800 00000100:00100000:1.0:1746065081.736723:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261532800 00000100:00100000:1.0:1746065081.736757:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4294 00000100:00100000:1.0:1746065081.736763:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261532800:12345-192.168.202.27@tcp:35:bash.0 00010000:00010000:3.0:1746065081.737070:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065081.737434:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261532800:12345-192.168.202.27@tcp:35:bash.0 Request processed in 669us (1226us total) trans 4294975790 rc 0/0 00000100:00100000:1.0:1746065081.737440:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4294 00000100:00100000:0.0:1746065081.737557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.737591:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261532928 00000100:00100000:2.0:1746065081.737594:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261532928 00000100:00100000:2.0:1746065081.737627:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12464 00000100:00100000:2.0:1746065081.737632:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27960:x1830881261532928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.737641:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.737848:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1463ede lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1d0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.738104:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.738115:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738124:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738135:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.738140:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738145:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738214:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.738222:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738228:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065081.738235:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 5 00010000:00010000:2.0:1746065081.738274:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738279:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738283:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738288:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738292:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.738295:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738300:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738309:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090535300) 00010000:00010000:2.0:1746065081.738311:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.738314:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738318:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1463ee5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738340:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738348:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738352:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738356:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.738358:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738362:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738367:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880090535100) 00010000:00010000:2.0:1746065081.738369:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.738371:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738375:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463eec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.738403:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1463ede lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.738414:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.738419:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.738421:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.738423:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0e0600, rc 0) 00000100:00100000:2.0:1746065081.738448:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27960:x1830881261532928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 815us (891us total) trans 4294975791 rc 0/0 00000100:00100000:2.0:1746065081.738453:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12464 00000100:00100000:0.0:1746065081.743649:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.743711:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261533184 00000100:00100000:1.0:1746065081.743719:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261533184 00000100:00100000:1.0:1746065081.743761:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4295 00000100:00100000:1.0:1746065081.743768:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27960:x1830881261533184:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.744133:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27960:x1830881261533184:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 365us (490us total) trans 4294975792 rc 0/0 00000100:00100000:1.0:1746065081.744139:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4295 00000100:00100000:0.0:1746065081.745716:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.746302:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261533440 00000100:00100000:1.0:1746065081.746307:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261533440 00000100:00100000:1.0:1746065081.746344:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12465 00000100:00100000:1.0:1746065081.746349:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27960:x1830881261533440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.746365:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.746378:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463f01 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1d7 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.746446:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.746456:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.746462:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.746484:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.746492:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 293 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.746501:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262671360:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.746581:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d316cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.749448:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.749566:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262671360:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.749584:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:3.0:1746065081.750530:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261533568 00000100:00100000:3.0:1746065081.750537:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261533568 00010000:00010000:3.0:1746065081.750570:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 294 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.750591:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3699 00000100:00100000:3.0:1746065081.750596:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261533568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.750606:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.750610:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 294 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.750618:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 294 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.750635:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463ef3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d0 expref: 294 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.750648:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.750652:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.750658:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.750663:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065081.750758:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.750765:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.750770:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065081.750800:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 5 00010000:00010000:1.0:1746065081.750898:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1463f01 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.750909:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261533568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 312us (1467us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065081.750909:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.750914:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3699 00010000:00010000:1.0:1746065081.750915:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:1.0:1746065081.750917:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065081.750919:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac600, rc 0) 00000100:00100000:1.0:1746065081.750940:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27960:x1830881261533440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4591us (5229us total) trans 4294975793 rc 0/0 00000100:00100000:1.0:1746065081.750946:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12465 00000100:00100000:0.0:1746065081.751153:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.751212:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261533696 00000100:00100000:1.0:1746065081.751215:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261533696 00000100:00100000:1.0:1746065081.751246:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12466 00000100:00100000:1.0:1746065081.751251:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27961:x1830881261533696:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:1.0:1746065081.751261:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.751271:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463f16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1de expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.751304:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.751310:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.751316:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.751329:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.751335:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.751339:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.751389:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.751397:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.751403:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 4/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.751423:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.751545:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 294 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.751555:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262671488:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.751961:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.753168:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.753203:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261533824 00000100:00100000:0.0:1746065081.753208:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261533824 00010000:00010000:0.0:1746065081.753226:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 295 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.753236:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262671488:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.753247:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065081.753252:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3700 00000100:00100000:0.0:1746065081.753259:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+295:2006:x1830881261533824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.753266:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.753270:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 295 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.753278:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 295 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.753290:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463f08 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x358:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1d7 expref: 295 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.753301:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.753305:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.753311:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.753317:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.753331:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.753368:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753374:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065081.753405:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 5 00000004:00200000:2.0:1746065081.753408:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.753418:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753424:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753432:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753436:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753441:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753446:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753451:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.753454:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753459:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753466:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008ec72500) 00010000:00010000:2.0:1746065081.753469:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.753471:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753476:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1463f1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753488:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753493:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753732:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753867:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.753869:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753874:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753881:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88008ec72800) 00010000:00010000:2.0:1746065081.753883:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.753885:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753889:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1463f24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.753913:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1463f16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1de expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.753923:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1de expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.753928:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.753930:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.753932:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a800, rc 0) 00000100:00100000:0.0:1746065081.753941:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881261533824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 682us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.753947:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3700 00000100:00100000:2.0:1746065081.753952:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27961:x1830881261533696:12345-192.168.202.27@tcp:101:rm.0 Request processed in 2702us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.753956:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12466 00000100:00100000:3.0:1746065081.754113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.754288:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261533952 00000100:00100000:0.0:1746065081.754292:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261533952 00000100:00100000:0.0:1746065081.755057:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12467 00000100:00100000:0.0:1746065081.755065:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27960:x1830881261533952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.755084:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.755093:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463f32 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1e5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.755144:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065081.755152:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.755158:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065081.755172:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 5 00000004:00200000:0.0:1746065081.755175:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065081.755181:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065081.755195:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a000/0xad6b7ddc1463f32 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.755204:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.755210:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.755212:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065081.755214:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a400, rc 0) 00000100:00100000:0.0:1746065081.755283:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27960:x1830881261533952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 219us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.755289:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12467 00000100:00100000:3.0:1746065081.756057:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.756103:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261534208 00000100:00100000:0.0:1746065081.756107:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261534208 00000100:00100000:0.0:1746065081.756212:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12468 00000100:00100000:0.0:1746065081.756219:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27961:x1830881261534208:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:0.0:1746065081.756241:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1746065081.756253:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4600/0xad6b7ddc1463ec2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1bb expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.756269:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a800/0xad6b7ddc1463f2b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1de expref: 293 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.756279:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d358800/0xad6b7ddc1463e9f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1a6 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.756286:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.756289:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.756302:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.756308:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.756314:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.756322:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.756327:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.756332:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.756389:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.756397:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.756403:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 4/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.756424:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.756433:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 291 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.756443:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262671616:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.757185:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.757635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.758078:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261534464 00000100:00100000:2.0:1746065081.758083:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261534464 00000100:00100000:2.0:1746065081.758123:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12469 00000100:00100000:2.0:1746065081.758165:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27960:x1830881261534464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.758176:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.758186:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463f55 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1ec expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.758270:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1463f5c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065081.758279:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1463f5c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065081.758287:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1463f5c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065081.758296:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 5 00000100:00100000:3.0:1746065081.758359:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065081.758365:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1463f55 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ec expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.758377:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1463f5c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ec expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.758383:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.758385:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.758387:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d200, rc 0) 00000100:00100000:0.0:1746065081.758404:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261534592 00000100:00100000:0.0:1746065081.758407:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261534592 00000100:00100000:2.0:1746065081.758414:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27960:x1830881261534464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 285us (780us total) trans 4294975794 rc 0/0 00000100:00100000:2.0:1746065081.758419:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12469 00010000:00010000:0.0:1746065081.758422:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 295 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.758436:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3701 00000100:00100000:0.0:1746065081.758441:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261534592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.758447:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.758529:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 294 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.758551:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 294 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.758562:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.758565:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.758570:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.758575:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.758586:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.758603:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261534592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 162us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.758608:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3701 00010000:00010000:0.0:1746065081.758635:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008ec5a400/0xad6b7ddc1463f39 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1e5 expref: 293 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.758645:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262671616:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065081.758657:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.758663:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.758667:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00080000:0.0:1746065081.759071:0:7205:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x358:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1746065081.759115:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759121:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759127:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759132:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.759135:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759141:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759148:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.759150:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065081.759153:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 2/0,0 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759157:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b200/0xad6b7ddc1463f4e lrc: 0/0,0 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759169:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759174:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759178:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759185:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759189:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0e0600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.759190:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759194:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759199:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:0.0:1746065081.759201:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.759203:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759206:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e0600/0xad6b7ddc1463f40 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000004:00010000:0.0:1746065081.759216:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800727a0700 reply state ffff88009ae63000 transno 4294975795 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759223:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.759228:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:0.0:1746065081.759229:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065081.759232:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065081.759271:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27961:x1830881261534208:12345-192.168.202.27@tcp:36:rm.0 Request processed in 3052us (3215us total) trans 4294975795 rc 0/0 00000100:00100000:0.0:1746065081.759277:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12468 00000100:00100000:0.0:1746065081.760600:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.760667:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261534720 00000100:00100000:2.0:1746065081.760671:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261534720 00000100:00100000:2.0:1746065081.760695:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12470 00000100:00100000:2.0:1746065081.760700:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27960:x1830881261534720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.760709:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.760719:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc1463f6a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1f3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.760747:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc1463f6a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1f3 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.760754:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc1463f6a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1f3 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.760764:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.760766:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.760768:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4000, rc 0) 00000100:00100000:2.0:1746065081.761086:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27960:x1830881261534720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 384us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.761092:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12470 00000100:00100000:0.0:1746065081.762412:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.762502:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261534848 00000100:00100000:2.0:1746065081.762507:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261534848 00000100:00100000:2.0:1746065081.762555:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8818 00000100:00100000:2.0:1746065081.762561:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261534848:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065081.762588:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.762601:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 53 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.762608:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.762609:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.762612:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.762633:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 53 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.762643:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 53 pid: 9549 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.762654:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262671744:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.762722:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.764218:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.764305:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262671744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.764324:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.764380:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261534976 00000100:00100000:3.0:1746065081.764385:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261534976 00002000:00100000:3.0:1746065081.764411:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37e:0x0] (0->4) req@ffff88009577ea00 x1830881261534976/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/0 e 0 to 0 dl 1746065092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065081.764419:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881261534976 ext(0->4) 00010000:00010000:3.0:1746065081.764425:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 54 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.764435:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 54 pid: 9549 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746065081.764440:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009577ea00 00000100:00100000:3.0:1746065081.764821:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 223 00000100:00100000:3.0:1746065081.764828:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261534976:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:3.0:1746065081.765565:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881261534976:12345-192.168.202.27@tcp:4:bash.0 Request processed in 735us (1348us total) trans 21474839921 rc 0/0 00000100:00100000:3.0:1746065081.765571:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 223 00002000:00100000:3.0:1746065081.765577:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x37e:0x0] (0->4) req@ffff88009577ea00 x1830881261534976/t21474839921(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/448 e 0 to 0 dl 1746065092 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1746065081.765691:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881261534976 ext(0->4) 00010000:00010000:3.0:1746065081.765698:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 56 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.765711:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 56 pid: 9549 timeout: 777 lvb_type: 0 00002000:00010000:3.0:1746065081.765715:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009577ea00 00000100:00100000:1.0:1746065081.765910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.766015:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261535104 00000100:00100000:2.0:1746065081.766020:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261535104 00000100:00100000:2.0:1746065081.766060:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12471 00000100:00100000:2.0:1746065081.766069:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27962:x1830881261535104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.766083:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.766098:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1463f78 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d1fa expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.766142:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.766151:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766159:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766166:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.766171:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766176:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766199:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766212:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766217:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766222:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766227:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.766230:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766235:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766243:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c512500) 00010000:00010000:2.0:1746065081.766245:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.766248:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766252:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc1463f7f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766273:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766278:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766282:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766286:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.766289:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766293:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766396:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:2.0:1746065081.766398:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.766401:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766405:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1463f86 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.766425:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1463f78 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1fa expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.766432:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fa00/0xad6b7ddc1463f78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1fa expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.766441:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:2.0:1746065081.766578:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27962:x1830881261535104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 511us (668us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.766584:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12471 00000100:00100000:0.0:1746065081.767286:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.767351:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261535232 00000100:00100000:3.0:1746065081.767355:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261535232 00010000:00010000:3.0:1746065081.767372:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 56 pid: 9549 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.767389:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3702 00000100:00100000:3.0:1746065081.767394:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881261535232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.767403:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065081.767414:0:9565:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1746065081.767416:0:9565:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1746065081.767420:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 56 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.767565:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 56 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.767581:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1463ed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c2 expref: 56 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.767603:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.767605:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.767609:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.767617:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.767641:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.767663:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.767670:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881261535232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 275us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.767676:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3702 00010000:00010000:2.0:1746065081.767860:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.767862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065081.767873:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.767879:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.767885:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.767890:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.767893:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.767899:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.767907:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.767913:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c000/0xad6b7ddc1463f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.767954:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261534848:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 5393us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.767962:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8818 00000100:00100000:3.0:1746065081.767986:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261535360 00000100:00100000:3.0:1746065081.767990:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261535360 00000100:00100000:3.0:1746065081.768008:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12472 00000100:00100000:3.0:1746065081.768012:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27962:x1830881261535360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.768023:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.768031:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1463f8d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d201 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.768186:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.768195:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768202:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768210:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.768215:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768223:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768245:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768250:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768254:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768258:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768262:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.768264:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768268:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768274:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800ac4e2800) 00010000:00010000:3.0:1746065081.768276:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.768278:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768282:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1463f94 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768290:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768294:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768299:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768303:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.768305:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768309:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768314:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:3.0:1746065081.768315:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.768317:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768321:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095779e00/0xad6b7ddc1463f9b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.768338:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1463f8d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d201 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.768344:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66600/0xad6b7ddc1463f8d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d201 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.768354:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66600, rc 0) 00000100:00100000:3.0:1746065081.768428:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27962:x1830881261535360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 413us (565us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.768433:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12472 00000100:00100000:0.0:1746065081.769374:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.769612:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261535616 00000100:00100000:3.0:1746065081.769617:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261535616 00000100:00100000:3.0:1746065081.769651:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12473 00000100:00100000:3.0:1746065081.769657:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27960:x1830881261535616:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065081.769683:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.769696:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090de4000/0xad6b7ddc1463f6a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1f3 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.769705:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.769708:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.769723:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.769731:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.769739:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:3.0:1746065081.769945:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2500, 88 off206672 00000004:00080000:3.0:1746065081.769950:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677788176123ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065081.769984:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2504, 88 off207112 00000100:00100000:0.0:1746065081.769986:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:3.0:1746065081.769988:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677788214297ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065081.770000:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2505, 88 off207200 00000004:00080000:3.0:1746065081.770002:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677788228791ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065081.770011:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2501, 88 off206760 00000004:00080000:3.0:1746065081.770013:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677788239847ns, next at 678738623360ns, rc = 0 00000100:00100000:1.0:1746065081.770047:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261535744 00000100:00100000:1.0:1746065081.770050:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261535744 00000100:00100000:1.0:1746065081.770072:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12474 00000100:00100000:1.0:1746065081.770077:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27962:x1830881261535744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.770085:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.770093:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463fa9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d208 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.770121:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463fb0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065081.770127:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463fb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065081.770133:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463fb0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065081.770157:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065081.770161:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065081.770181:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1463fa9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d208 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.770200:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463fb0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d208 expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.770206:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065081.770208:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065081.770291:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac600, rc 0) 00000100:00100000:1.0:1746065081.770328:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:27962:x1830881261535744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 251us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.770333:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12474 00000001:00080000:3.0:1746065081.771732:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975796 is committed 00000004:00080000:3.0:1746065081.771738:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1681 committed 00000004:00080000:3.0:1746065081.771752:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1691 committed 00000004:00080000:3.0:1746065081.771757:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1690 committed 00000004:00080000:3.0:1746065081.771758:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1680 committed 00000004:00080000:3.0:1746065081.771785:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1679 committed 00000004:00080000:3.0:1746065081.771787:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1689 committed 00000004:00010000:3.0:1746065081.771811:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009577c000 reply state ffff88008c52e800 transno 4294975796 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.771823:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.771830:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.771832:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065081.771835:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.771850:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262671872:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.771859:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262672256:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.771883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.771884:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262672128:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.771899:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.771914:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065081.771918:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262672000:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.771929:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.771937:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065081.771942:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262672512:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.771956:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.771958:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065081.771962:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262672640:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.771973:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672256 00000100:00100000:2.0:1746065081.771977:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.771978:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672256 00000100:00100000:2.0:1746065081.771993:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262672768:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.771997:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672128 00000100:00100000:3.0:1746065081.771999:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672128 00000100:00100000:2.0:1746065081.772005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.772008:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672000 00000100:00100000:3.0:1746065081.772009:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672000 00000100:00100000:2.0:1746065081.772013:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065081.772017:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672512 00000100:00100000:2.0:1746065081.772017:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262672384:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.772018:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672512 00000100:00100000:3.0:1746065081.772028:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672640 00000100:00100000:2.0:1746065081.772028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.772029:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672640 00000100:00100000:3.0:1746065081.772035:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672768 00000100:00100000:3.0:1746065081.772037:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672768 00000100:00100000:2.0:1746065081.772040:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262672384 00000100:00100000:2.0:1746065081.772042:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262672384 00000100:00100000:3.0:1746065081.772044:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8819 00000100:00100000:3.0:1746065081.772048:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+161:3759:x1830881262672256:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.772053:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8820 00000100:00100000:2.0:1746065081.772056:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+161:3762:x1830881262672128:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.772111:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8821 00000100:00100000:2.0:1746065081.772115:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+163:3762:x1830881262672000:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065081.772126:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:894 count 1 00000100:00100000:3.0:1746065081.772136:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+163:3759:x1830881262672256:12345-0@lo:2:osp-syn-1-1.0 Request processed in 87us (253us total) trans 17179872646 rc 0/0 00010000:00010000:2.0:1746065081.772139:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.772141:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8819 00000100:00100000:3.0:1746065081.772151:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8822 00010000:00010000:2.0:1746065081.772152:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 67 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065081.772155:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+129:3762:x1830881262672512:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065081.772158:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.772160:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1746065081.772162:0:3068:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:893 count 1 00010000:00010000:2.0:1746065081.772162:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.772171:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.772179:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 53 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.772179:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 67 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.772184:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.772186:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.772188:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.772193:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 67 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:3.0:1746065081.772199:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 53 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065081.772202:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262672896:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.772204:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 53 pid: 12258 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746065081.772212:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262673024:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.772233:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db600 going to sleep for 11 seconds 00002000:00010000:2.0:1746065081.772257:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1746065081.772257:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8823 00002000:00010000:2.0:1746065081.772259:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.772261:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.772263:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00000100:00100000:0.0:1746065081.772263:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+129:3761:x1830881262672640:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1746065081.772265:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.772284:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+162:3762:x1830881262672128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 227us (384us total) trans 17179872645 rc 0/0 00000100:00100000:2.0:1746065081.772289:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8820 00000100:00100000:2.0:1746065081.772298:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8824 00000100:00100000:2.0:1746065081.772302:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+129:3759:x1830881262672768:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.772342:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+131:3759:x1830881262672768:12345-0@lo:2:osp-syn-0-1.0 Request processed in 41us (337us total) trans 21474839923 rc 0/0 00000100:00100000:0.0:1746065081.772342:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+131:3761:x1830881262672640:12345-0@lo:2:osp-syn-0-1.0 Request processed in 79us (363us total) trans 21474839922 rc 0/0 00000100:00100000:2.0:1746065081.772347:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8824 00000100:00100000:0.0:1746065081.772354:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8823 00000100:00100000:2.0:1746065081.772356:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8825 00000100:00100000:2.0:1746065081.772360:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+129:3759:x1830881262672384:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065081.772368:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:892 count 1 00010000:00010000:2.0:1746065081.772375:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065081.772378:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8e00/2, rc 0, transno 21474839922 00000100:00100000:0.0:1746065081.772382:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262672640:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1746065081.772388:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 53 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.772392:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.772394:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.772396:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.772408:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 53 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.772415:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 53 pid: 9550 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.772422:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262673152:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.772491:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.772498:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.772503:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.772507:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.772511:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.772516:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.772524:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7ab500) 00010000:00010000:1.0:1746065081.772527:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.772529:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.772533:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ae00/0xad6b7ddc1463f47 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065081.773036:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.773184:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.773207:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262671872 00000100:00100000:3.0:1746065081.773211:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262671872 00000100:00100000:3.0:1746065081.773223:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8826 00000100:00100000:3.0:1746065081.773227:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+162:3760:x1830881262671872:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065081.773235:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:893 count 1 00010000:00010000:3.0:1746065081.773243:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.773252:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 67 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.773257:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.773258:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.773259:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.773271:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 67 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.773277:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 67 pid: 9550 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746065081.773283:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262673280:192.168.202.27@tcp:104: 00000004:00080000:2.0:1746065081.773600:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8380/2, rc 0, transno 21474839923 00000100:00100000:2.0:1746065081.773604:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262672768:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.773611:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dc000/2, rc 0, transno 17179872646 00000100:00100000:2.0:1746065081.773614:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262672256:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.773649:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.773690:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00000004:00080000:3.0:1746065081.773707:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6de680/2, rc 0, transno 17179872645 00000100:00100000:3.0:1746065081.773711:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262672128:0@lo:2:osp-syn-1-1.0 00010000:00080000:3.0:1746065081.773755:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065081.773765:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27960:x1830881261535616:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 4107us (4392us total) trans 4294975796 rc 0/0 00000100:00100000:3.0:1746065081.773770:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12473 00010000:00010000:3.0:1746065081.773803:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773809:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773814:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773818:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.773820:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773825:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773833:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.773835:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.773837:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773841:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc1463fa2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065081.773853:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261535872 00000100:00100000:3.0:1746065081.773856:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261535872 00000100:00100000:3.0:1746065081.773872:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12475 00000100:00100000:3.0:1746065081.773877:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27962:x1830881261535872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.773888:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.773896:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463fd3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d20f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.773930:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.773938:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773945:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.773955:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065081.773985:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065081.774343:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774349:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774376:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774381:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774385:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774389:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774393:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.774396:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774400:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774406:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065081.774408:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.774410:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774414:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd7e000/0xad6b7ddc1463fda lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774421:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774425:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774429:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774432:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095669e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.774434:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774438:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774443:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd100) 00010000:00010000:3.0:1746065081.774444:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.774446:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774453:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc1463fe1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.774474:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463fd3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d20f expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.774481:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1463fd3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d20f expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.774487:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d000, rc 0) 00000100:00100000:3.0:1746065081.774519:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27962:x1830881261535872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 641us (869us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.774525:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12475 00000100:00100000:1.0:1746065081.777132:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.777170:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.777199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.777214:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.777233:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536256 00000100:00100000:1.0:1746065081.777238:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536256 00010000:00010000:1.0:1746065081.777263:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 54 pid: 9550 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.777290:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536512 00000100:00100000:1.0:1746065081.777292:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536512 00010000:00010000:1.0:1746065081.777302:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 68 pid: 9550 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.777314:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536128 00000100:00100000:1.0:1746065081.777316:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536128 00010000:00010000:1.0:1746065081.777324:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 69 pid: 10219 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.777335:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3703 00000100:00100000:1.0:1746065081.777341:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261536256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.777350:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.777354:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 54 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.777361:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 54 pid: 9550 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.777379:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.777381:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.777384:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.777390:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065081.777391:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262672896:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.777406:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.777474:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881262673280:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.777486:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.777503:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881262673024:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.777510:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.777524:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1463d2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d12f expref: 54 pid: 9550 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.777532:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262673152:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.777584:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3704 00000100:00100000:0.0:1746065081.777591:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261536512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.777599:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.777602:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 69 pid: 9550 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777609:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 69 pid: 9550 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777620:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc1463e28 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d18a expref: 69 pid: 9550 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777631:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.777632:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.777635:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.777641:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.777667:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.777695:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+68:2005:x1830881261536512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.777701:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3704 00000100:00100000:0.0:1746065081.777714:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3705 00000100:00100000:0.0:1746065081.777718:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+67:2005:x1830881261536128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.777724:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.777728:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 67 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777734:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 67 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777744:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc1463c76 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f7 expref: 67 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777751:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.777752:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.777754:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.777759:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.777771:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.777805:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+66:2005:x1830881261536128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.777810:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3705 00000100:00100000:0.0:1746065081.777858:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.777871:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536384 00000100:00100000:0.0:1746065081.777874:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536384 00010000:00010000:0.0:1746065081.777885:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 54 pid: 12258 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746065081.777899:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3706 00000100:00100000:0.0:1746065081.777903:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881261536384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.777909:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.777912:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 54 pid: 12258 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777920:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 54 pid: 12258 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777930:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1463c6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d0f0 expref: 54 pid: 12258 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746065081.777938:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.777940:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.777942:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.777953:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.777965:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.777978:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261536384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.777982:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3706 00010000:00010000:2.0:1746065081.778195:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778202:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778209:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778215:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778227:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.778387:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+163:3762:x1830881262672000:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6271us (6455us total) trans 17179872647 rc 0/0 00000100:00100000:2.0:1746065081.778394:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8821 00010000:00010000:2.0:1746065081.778411:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778417:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778423:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778429:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.778437:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065081.778576:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+163:3760:x1830881262671872:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5347us (5391us total) trans 17179872648 rc 0/0 00000100:00100000:2.0:1746065081.778581:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8826 00000004:00080000:2.0:1746065081.778611:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dd500/2, rc 0, transno 17179872648 00000100:00100000:2.0:1746065081.778616:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262671872:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065081.778717:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065081.778743:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dea00/2, rc 0, transno 17179872647 00000100:00100000:3.0:1746065081.778746:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262672000:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065081.778757:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.778762:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.778768:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.778787:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.778797:0:3068:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1746065081.778896:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+130:3762:x1830881262672512:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6740us (6938us total) trans 21474839924 rc 0/0 00000100:00100000:3.0:1746065081.778901:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8822 00000004:00080000:3.0:1746065081.778920:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6de300/2, rc 0, transno 21474839924 00000100:00100000:3.0:1746065081.778924:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262672512:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.778938:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536000 00000100:00100000:3.0:1746065081.778941:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536000 00000100:00100000:3.0:1746065081.778963:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12476 00000100:00100000:3.0:1746065081.778967:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27960:x1830881261536000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.778981:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.778992:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d216 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779026:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779036:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779049:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065081.779052:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.779054:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669800, rc 0) 00000100:00100000:3.0:1746065081.779074:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27960:x1830881261536000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.779079:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12476 00010000:00010000:1.0:1746065081.779137:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.779153:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261536256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1812us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.779158:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3703 00010000:00010000:3.0:1746065081.779307:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779314:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779320:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779325:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779330:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1746065081.779407:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+130:3759:x1830881262672384:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7045us (7376us total) trans 21474839925 rc 0/0 00000100:00100000:3.0:1746065081.779412:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8825 00000100:00100000:1.0:1746065081.779565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065081.779689:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1746065081.779695:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779702:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.779705:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779711:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779721:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779727:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc1463fb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779739:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1746065081.779743:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779748:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.779751:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779757:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779764:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779769:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc1463fcc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.779783:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1746065081.779788:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.779793:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577bc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.779794:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065081.779796:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.779796:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779800:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.779802:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779803:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779808:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.779811:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779814:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.779816:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1463fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.779819:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1463fc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.779825:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.779826:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.779828:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.779830:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.779831:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.779832:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.779833:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065081.779848:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6df480/2, rc 0, transno 21474839925 00000100:00100000:3.0:1746065081.779871:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536768 00000100:00100000:3.0:1746065081.779874:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536768 00000100:00100000:3.0:1746065081.779894:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12477 00000100:00100000:3.0:1746065081.779899:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+288:27962:x1830881261536768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.779906:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.779908:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.779920:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1463fb0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d208 expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.779929:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065081.779934:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.779941:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1463fef lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d21d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.780153:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.780161:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780168:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780178:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.780183:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780187:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.780208:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262672384:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065081.780436:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.780441:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780445:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.780449:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 0 00010000:00010000:3.0:1746065081.780462:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780465:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780468:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780471:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780473:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.780475:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780477:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780481:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012edbd600) 00010000:00010000:3.0:1746065081.780482:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.780484:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780488:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1463ff6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065081.780494:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc3100 reply state ffff88009a8de000 transno 4294975797 ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780498:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.780501:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd700) 00010000:00010000:3.0:1746065081.780502:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.780503:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065081.780515:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1463fef lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 290 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.780521:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.780525:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88012edbdc00) 00010000:00010000:3.0:1746065081.780526:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.780527:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:3.0:1746065081.780565:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+290:27962:x1830881261536768:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 665us (1000us total) trans 4294975797 rc 0/0 00000100:00100000:3.0:1746065081.780570:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12477 00000100:00100000:0.0:1746065081.782508:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.782643:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.782689:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261536896 00000100:00100000:1.0:1746065081.782695:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261536896 00000100:00100000:1.0:1746065081.782723:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261537152 00000100:00100000:1.0:1746065081.782725:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261537152 00000100:00100000:1.0:1746065081.782743:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12478 00000100:00100000:1.0:1746065081.782749:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27960:x1830881261536896:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.782767:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065081.782813:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12479 00000100:00100000:3.0:1746065081.782819:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27962:x1830881261537152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.782826:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.782855:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1464019 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d224 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.783059:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc1464012 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d22b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.783125:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1464020 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065081.783136:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1464020 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.783144:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1464020 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.783270:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.783279:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.783284:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.783306:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.783315:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.783324:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262673408:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.783388:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000004:00200000:1.0:1746065081.783439:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x358:0x0]: returning size 5 00000004:00200000:1.0:1746065081.783442:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065081.783453:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1464020 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.783607:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc1464019 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d224 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.783620:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1464020 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d224 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.783626:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:1.0:1746065081.783628:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065081.783631:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad000, rc 0) 00000100:00100000:1.0:1746065081.783655:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27960:x1830881261536896:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 906us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.783660:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12478 00000100:00100000:3.0:1746065081.785856:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262673408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.785876:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.786783:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.786921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.786972:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261537280 00000100:00100000:1.0:1746065081.786977:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261537280 00010000:00010000:1.0:1746065081.787000:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.787020:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3707 00000100:00100000:1.0:1746065081.787025:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+293:2006:x1830881261537280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.787034:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.787039:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.787047:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.787061:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464004 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d21d expref: 293 pid: 7203 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.787071:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88012edbdc00) 00010000:00010000:1.0:1746065081.787075:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.787082:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.787087:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.787108:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.787126:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787134:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065081.787137:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+292:2006:x1830881261537280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.787142:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3707 00000004:00200000:2.0:1746065081.787151:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 0 00000100:00100000:3.0:1746065081.787199:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261537408 00000100:00100000:3.0:1746065081.787202:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261537408 00000100:00100000:3.0:1746065081.787225:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8827 00000100:00100000:3.0:1746065081.787230:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881261537408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.787241:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.787251:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d232 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065081.787272:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37e:0x0] initial LVB size: 5, mtime: 0x6812d6b9, atime: 0x0, ctime: 0x6812d6b9, blocks: 0x8 00010000:00010000:3.0:1746065081.787284:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.787285:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.787292:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 53 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.787303:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 53 pid: 9548 timeout: 0 lvb_type: 1 00000004:00080000:2.0:1746065081.787419:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x381:0x0], index 1: 0 00000004:00080000:2.0:1746065081.787425:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x380:0x0], index 0: 0 00000004:00080000:2.0:1746065081.787428:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x381:0x0], index 0: 0 00000004:00080000:2.0:1746065081.787431:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x382:0x0], index 1: 0 00010000:00010000:2.0:1746065081.787502:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787509:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787514:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787518:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.787521:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787526:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787533:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88012edbdc00) 00010000:00010000:2.0:1746065081.787536:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.787549:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787553:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a600/0xad6b7ddc1464027 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.787584:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc1464012 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d22b expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.787589:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc1464012 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d22b expref: 292 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.787598:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b400, rc 0) 00000100:00100000:2.0:1746065081.787629:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27962:x1830881261537152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4811us (4986us total) trans 4294975798 rc 301/301 00000100:00100000:2.0:1746065081.787635:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12479 00010000:00010000:3.0:1746065081.787678:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:3.0:1746065081.787692:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881261537408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 462us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.787697:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8827 00000100:00100000:0.0:1746065081.790170:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.790254:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.790417:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261537792 00000100:00100000:3.0:1746065081.790424:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261537792 00000100:00100000:3.0:1746065081.790466:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8828 00000100:00100000:3.0:1746065081.790473:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261537792:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065081.790561:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261537792:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 88us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.790567:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8828 00000100:00100000:1.0:1746065081.790813:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261537664 00000100:00100000:1.0:1746065081.790818:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261537664 00000100:00100000:1.0:1746065081.790840:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4296 00000100:00100000:1.0:1746065081.790845:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27962:x1830881261537664:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065081.791019:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27962:x1830881261537664:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 172us (854us total) trans 4294975799 rc 0/0 00000100:00100000:1.0:1746065081.791025:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4296 00000100:00100000:0.0:1746065081.793476:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.793524:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.793585:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261537920 00000100:00100000:2.0:1746065081.793591:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261537920 00000100:00100000:2.0:1746065081.793874:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8829 00000100:00100000:2.0:1746065081.793882:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881261537920:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065081.794066:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261538176 00000100:00100000:1.0:1746065081.794070:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261538176 00000100:00100000:1.0:1746065081.794090:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4297 00000100:00100000:1.0:1746065081.794095:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27962:x1830881261538176:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.794671:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881261537920:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 788us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.794677:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8829 00000100:00100000:1.0:1746065081.795252:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27962:x1830881261538176:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1154us (1725us total) trans 4294975800 rc 0/0 00000100:00100000:1.0:1746065081.795258:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4297 00000100:00100000:0.0:1746065081.804183:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.804293:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261538432 00000100:00100000:2.0:1746065081.804301:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261538432 00000100:00100000:2.0:1746065081.804348:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12480 00000100:00100000:2.0:1746065081.804354:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+293:27960:x1830881261538432:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065081.804396:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.804417:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1464020 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x358:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d224 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.804430:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.804434:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.804452:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.804460:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.804466:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065081.804550:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012dc3ce00 reply state ffff880131027000 transno 4294975801 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.804558:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.804563:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:2.0:1746065081.804564:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.804566:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.805369:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27960:x1830881261538432:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 1013us (1192us total) trans 4294975801 rc 0/0 00000100:00100000:2.0:1746065081.805376:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12480 00000100:00100000:0.0:1746065081.805937:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.805994:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261538688 00000100:00100000:2.0:1746065081.805998:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261538688 00000100:00100000:2.0:1746065081.806027:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12481 00000100:00100000:2.0:1746065081.806033:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261538688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.806043:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.806055:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc1464043 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d239 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.806160:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.806168:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806174:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806184:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.806194:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806198:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806233:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1464058 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.806239:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1464058 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806244:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1464058 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.806251:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 0 00010000:00010000:2.0:1746065081.806292:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806298:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806303:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806309:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806314:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.806317:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806322:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806330:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88008c512e00) 00010000:00010000:2.0:1746065081.806332:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.806335:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806339:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c000/0xad6b7ddc146404a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806347:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806352:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806356:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806361:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.806363:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806367:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806372:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd700) 00010000:00010000:2.0:1746065081.806374:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.806376:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806380:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464051 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.806409:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c800/0xad6b7ddc1464043 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d239 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.806424:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1464058 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d239 expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.806429:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.806431:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.806433:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857e00, rc 0) 00000100:00100000:2.0:1746065081.806462:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261538688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 429us (526us total) trans 4294975802 rc 0/0 00000100:00100000:2.0:1746065081.806468:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12481 00000100:00100000:1.0:1746065081.806592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.806674:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261538816 00000100:00100000:2.0:1746065081.806677:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261538816 00000100:00100000:2.0:1746065081.806710:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8830 00000100:00100000:2.0:1746065081.806715:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+53:27960:x1830881261538816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.806725:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.806734:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d240 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.806749:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 54 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.806755:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.806757:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.806759:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 54 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.806806:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 54 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.806876:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 54 pid: 9548 timeout: 777 lvb_type: 1 00000100:00100000:2.0:1746065081.806890:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262673536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.806962:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.808569:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.808631:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.808694:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261538944 00000100:00100000:2.0:1746065081.808699:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261538944 00000100:00100000:2.0:1746065081.808728:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12482 00000100:00100000:3.0:1746065081.808732:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262673536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.808734:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261538944:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.808748:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.808751:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 54 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.808757:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927c00/0xad6b7ddc146406d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d247 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.808763:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927a00, rc 0) 00000100:00100000:1.0:1746065081.808794:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261539072 00000100:00100000:1.0:1746065081.808797:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261539072 00000100:00100000:3.0:1746065081.808809:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+55:27960:x1830881261538816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2092us (2216us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065081.808812:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 55 pid: 9548 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746065081.808815:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8830 00000100:00100000:1.0:1746065081.808828:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3708 00000100:00100000:1.0:1746065081.808832:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261539072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.808837:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927400/0xad6b7ddc1464074 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065081.808840:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.808845:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927400/0xad6b7ddc1464074 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.808852:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 54 pid: 9548 timeout: 777 lvb_type: 1 00010000:00010000:2.0:1746065081.808853:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927400/0xad6b7ddc1464074 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065081.808860:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 54 pid: 9548 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.808872:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577ba00/0xad6b7ddc146402e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d232 expref: 54 pid: 9548 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.808880:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.808881:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.808885:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 53 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.808891:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 53 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.808909:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 53 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.808914:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927c00/0xad6b7ddc146406d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d247 expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.808921:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262673664:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065081.808923:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927400/0xad6b7ddc1464074 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d247 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.808928:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.808930:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065081.808932:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927400, rc 0) 00000100:00100000:2.0:1746065081.808947:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261538944:12345-192.168.202.27@tcp:101:bash.0 Request processed in 215us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.808952:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12482 00000100:00100000:1.0:1746065081.808961:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.810961:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.810978:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881262673664:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065081.810989:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065081.810990:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.811016:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881261539072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2183us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.811024:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3708 00000100:00100000:2.0:1746065081.811097:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261539328 00000100:00100000:2.0:1746065081.811101:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261539328 00000100:00100000:2.0:1746065081.811127:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12483 00000100:00100000:2.0:1746065081.811132:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261539328:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065081.811202:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.811219:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d857e00/0xad6b7ddc1464058 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d239 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.811235:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.811238:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.811273:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261539456 00000100:00100000:3.0:1746065081.811277:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261539456 00000100:00100000:3.0:1746065081.811301:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8831 00000100:00100000:3.0:1746065081.811306:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881261539456:12345-192.168.202.27@tcp:2:lfs.0 00010000:00010000:2.0:1746065081.811359:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.811367:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00002000:00010000:3.0:1746065081.811372:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:2.0:1746065081.811374:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00002000:00010000:3.0:1746065081.811375:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:3.0:1746065081.811377:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb atime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.811379:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb ctime from disk: 1746065081 -> 1746065082 00002000:00010000:3.0:1746065081.811380:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb blocks from disk: 8 -> 8 00000001:00080000:2.0:1746065081.811399:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975803 00000100:00100000:3.0:1746065081.811400:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881261539456:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 94us (410us total) trans 21474839926 rc 0/0 00000100:00100000:3.0:1746065081.811405:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8831 00000004:00010000:2.0:1746065081.811413:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012dc3ca80 reply state ffff88009fadc000 transno 4294975804 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.811420:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.811425:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.811427:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.811428:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.811464:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+299:26180:x1830881261539328:12345-192.168.202.27@tcp:36:bash.0 Request processed in 331us (507us total) trans 4294975804 rc 0/0 00000100:00100000:2.0:1746065081.811468:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12483 00000020:00080000:2.0:1746065081.811471:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065081.812745:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.812859:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261539584 00000100:00100000:2.0:1746065081.812864:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261539584 00000100:00100000:0.0:1746065081.812896:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.812935:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261539840 00000100:00100000:1.0:1746065081.812938:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261539840 00000100:00100000:1.0:1746065081.812961:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4298 00000100:00100000:1.0:1746065081.812967:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+300:27960:x1830881261539840:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065081.813002:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x358:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1463f5c lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ec expref: 300 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.813027:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00000100:00100000:2.0:1746065081.813072:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12484 00000100:00100000:2.0:1746065081.813082:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261539584:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.813090:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.813099:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464089 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d24e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.813126:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464089 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d24e expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.813135:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464089 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d24e expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.813149:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.813151:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.813154:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:2.0:1746065081.813190:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261539584:12345-192.168.202.27@tcp:101:bash.0 Request processed in 112us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.813195:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12484 00010000:00010000:1.0:1746065081.813224:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 300 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.813231:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.813253:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 300 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.813263:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 300 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.813274:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262673792:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.814448:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065081.815147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.815307:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540096 00000100:00100000:3.0:1746065081.815312:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540096 00000100:00100000:0.0:1746065081.815422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.815473:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540224 00000100:00100000:1.0:1746065081.815477:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540224 00010000:00010000:1.0:1746065081.815494:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 302 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.815532:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3709 00000100:00100000:0.0:1746065081.815548:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+302:2004:x1830881261540224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.815557:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065081.815578:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12485 00000100:00100000:3.0:1746065081.815583:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261540096:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065081.815590:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262673792:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.815594:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.815596:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065081.815608:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065081.815610:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464089 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d24e expref: 302 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.815623:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.815626:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.815633:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464090 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d255 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.815648:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 302 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.815658:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 302 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.815662:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464097 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.815670:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464097 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.815671:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1463fe8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d216 expref: 302 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.815677:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464097 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.815682:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.815685:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.815690:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.815694:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.815706:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.815730:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+301:2004:x1830881261540224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 193us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.815735:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3709 00010000:00010000:1.0:1746065081.815845:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.815851:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:3.0:1746065081.815859:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2506, 88 off207288 00000004:00080000:3.0:1746065081.815864:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677834089906ns, next at 678738608678ns, rc = 0 00000040:00080000:1.0:1746065081.815932:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2502, 88 off206848 00000004:00080000:1.0:1746065081.815936:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677834162479ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065081.816547:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2503, 88 off206936 00000040:00080000:1.0:1746065081.816548:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2507, 88 off207376 00000004:00080000:3.0:1746065081.816553:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677834778898ns, next at 678738623360ns, rc = 0 00000004:00080000:1.0:1746065081.816553:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677834778894ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065081.816562:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2504, 88 off207024 00000040:00080000:1.0:1746065081.816562:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2508, 88 off207464 00000004:00080000:1.0:1746065081.816564:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677834790985ns, next at 678738608678ns, rc = 0 00000004:00080000:3.0:1746065081.816565:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677834791027ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065081.816572:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2509, 88 off207552 00000040:00080000:1.0:1746065081.816572:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2505, 88 off207112 00000004:00080000:1.0:1746065081.816574:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677834800887ns, next at 678738623360ns, rc = 0 00000004:00080000:3.0:1746065081.816575:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677834801198ns, next at 678738608678ns, rc = 0 00000001:00080000:3.0:1746065081.817990:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975805 is committed 00000004:00080000:3.0:1746065081.817997:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1695 committed 00000004:00080000:3.0:1746065081.818012:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1684 committed 00000004:00080000:3.0:1746065081.818016:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1683 committed 00000004:00080000:3.0:1746065081.818017:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1692 committed 00000001:00080000:3.0:1746065081.818020:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975806 is committed 00000004:00080000:3.0:1746065081.818022:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1685 committed 00000004:00080000:3.0:1746065081.818024:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1694 committed 00000004:00080000:3.0:1746065081.818025:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1693 committed 00000004:00080000:3.0:1746065081.818026:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1682 committed 00010000:00010000:0.0:1746065081.818029:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818037:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818043:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818048:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.818052:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818058:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818069:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012edbd700) 00010000:00010000:0.0:1746065081.818072:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.818074:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.818076:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464097 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d255 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.818079:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668e00/0xad6b7ddc1463ffd lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.818083:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.818085:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.818094:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464090 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d255 expref: 292 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065081.818095:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818099:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818103:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.818105:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464097 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d255 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.818107:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.818109:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818112:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.818116:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:0.0:1746065081.818118:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.818120:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.818123:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065081.818123:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc146403c lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.818125:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.818127:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ac00, rc 0) 00010000:00010000:0.0:1746065081.818130:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.818134:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.818137:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.818140:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.818142:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.818146:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.818150:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065081.818151:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.818153:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.818158:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c719c00/0xad6b7ddc146407b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065081.818166:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261540096:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2582us (3021us total) trans 4294975805 rc 0/0 00000100:00100000:3.0:1746065081.818172:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12485 00000100:00100000:0.0:1746065081.818255:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262674048:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.818262:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262673920:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.818302:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262674176:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.818316:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.818319:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262674304:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.818335:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.818351:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674048 00000100:00100000:2.0:1746065081.818352:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.818356:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674048 00000100:00100000:2.0:1746065081.818367:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674304 00000100:00100000:2.0:1746065081.818370:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674304 00000100:00100000:0.0:1746065081.818377:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262673920 00000100:00100000:0.0:1746065081.818379:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262673920 00000100:00100000:2.0:1746065081.818383:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8832 00000100:00100000:2.0:1746065081.818387:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+132:3761:x1830881262674048:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.818393:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8833 00000100:00100000:0.0:1746065081.818397:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+132:3759:x1830881262674304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.818449:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8834 00000100:00100000:2.0:1746065081.818453:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+134:3760:x1830881262673920:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.818473:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+134:3759:x1830881262674304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 75us (136us total) trans 21474839927 rc 0/0 00000100:00100000:0.0:1746065081.818481:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8833 00002000:00010000:2.0:1746065081.818492:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065081.818494:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.818497:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb atime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.818498:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:2.0:1746065081.818500:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x37e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065081.818517:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+134:3760:x1830881262673920:12345-0@lo:2:osp-syn-0-1.0 Request processed in 65us (164us total) trans 21474839929 rc 0/0 00000100:00100000:2.0:1746065081.818522:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8834 00000004:00080000:2.0:1746065081.818554:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecb480/2, rc 0, transno 21474839927 00000100:00100000:2.0:1746065081.818558:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262674304:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.818570:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8000/2, rc 0, transno 21474839929 00000100:00100000:2.0:1746065081.818572:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262673920:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.818598:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+133:3761:x1830881262674048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 211us (282us total) trans 21474839928 rc 0/0 00000100:00100000:2.0:1746065081.818603:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8832 00000004:00080000:0.0:1746065081.818610:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecbb80/2, rc 0, transno 21474839928 00000100:00100000:0.0:1746065081.818614:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262674048:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.818639:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262674560:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.818643:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262674816:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.818656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.818667:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065081.818668:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.818671:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262674432:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.818678:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065081.818682:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262674688:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.818683:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.818694:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.818697:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674816 00000100:00100000:2.0:1746065081.818699:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674816 00000100:00100000:0.0:1746065081.818705:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674560 00000100:00100000:0.0:1746065081.818707:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674560 00000100:00100000:2.0:1746065081.818713:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674432 00000100:00100000:2.0:1746065081.818714:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674432 00000100:00100000:0.0:1746065081.818717:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674688 00000100:00100000:0.0:1746065081.818718:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674688 00000100:00100000:2.0:1746065081.818724:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8835 00000100:00100000:0.0:1746065081.818727:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8836 00000100:00100000:2.0:1746065081.818728:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+166:3759:x1830881262674816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.818730:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+166:3761:x1830881262674560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.818770:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8837 00000100:00100000:0.0:1746065081.818794:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+168:3759:x1830881262674432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.818810:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+168:3759:x1830881262674816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 81us (153us total) trans 17179872649 rc 0/0 00000100:00100000:2.0:1746065081.818817:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8835 00000100:00100000:2.0:1746065081.818826:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8838 00000100:00100000:2.0:1746065081.818830:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+168:3761:x1830881262674688:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.818842:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+168:3759:x1830881262674432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 49us (158us total) trans 17179872651 rc 0/0 00000100:00100000:0.0:1746065081.818846:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8837 00000100:00100000:2.0:1746065081.818875:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+168:3761:x1830881262674688:12345-0@lo:2:osp-syn-1-1.0 Request processed in 45us (180us total) trans 17179872652 rc 0/0 00000100:00100000:2.0:1746065081.818880:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8838 00000004:00080000:0.0:1746065081.818880:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570e680/2, rc 0, transno 17179872652 00000100:00100000:0.0:1746065081.818883:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262674688:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065081.818898:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570d880/2, rc 0, transno 17179872651 00000100:00100000:2.0:1746065081.818900:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262674432:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1746065081.818905:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570f480/2, rc 0, transno 17179872649 00000100:00100000:2.0:1746065081.818907:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262674816:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065081.818922:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.818924:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb mtime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.818925:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.818927:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb ctime from disk: 1746065081 -> 1746065081 00002000:00010000:2.0:1746065081.818928:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x37f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.818942:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+167:3761:x1830881262674560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 212us (273us total) trans 17179872650 rc 0/0 00000004:00080000:0.0:1746065081.818946:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570f800/2, rc 0, transno 17179872650 00000100:00100000:2.0:1746065081.818947:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8836 00000100:00100000:0.0:1746065081.818949:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262674560:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.819005:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.819022:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262674176 00000100:00100000:3.0:1746065081.819024:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262674176 00000100:00100000:3.0:1746065081.819035:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8839 00000100:00100000:3.0:1746065081.819038:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+133:3762:x1830881262674176:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.819089:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+134:3762:x1830881262674176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 49us (83us total) trans 21474839930 rc 0/0 00000100:00100000:3.0:1746065081.819093:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8839 00000004:00080000:3.0:1746065081.819112:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecad80/2, rc 0, transno 21474839930 00000100:00100000:3.0:1746065081.819115:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262674176:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065081.819234:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b26450 reply state ffff8800955ab400 transno 4294975806 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819248:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819253:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:1.0:1746065081.819255:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065081.819257:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.819260:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:1.0:1746065081.819262:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065081.819265:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1463f5c lrc: 0/0,0 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1ec expref: 288 pid: 7204 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065081.819551:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065081.819562:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27960:x1830881261539840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 6594us (6664us total) trans 4294975806 rc 0/0 00000100:00100000:1.0:1746065081.819568:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4298 00010000:00010000:1.0:1746065081.819602:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819607:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819612:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819617:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.819619:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819623:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819634:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff88012f854d00) 00010000:00010000:1.0:1746065081.819636:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.819638:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.819642:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc1464082 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065081.820990:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.821261:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540352 00000100:00100000:3.0:1746065081.821266:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540352 00000100:00100000:0.0:1746065081.821309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.821352:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12486 00000100:00100000:3.0:1746065081.821359:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+287:27960:x1830881261540352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.821377:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065081.821428:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540480 00000100:00100000:2.0:1746065081.821432:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540480 00000100:00100000:2.0:1746065081.821451:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8840 00000100:00100000:2.0:1746065081.821455:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+66:26180:x1830881261540480:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.821461:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.821473:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d263 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.821491:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.821505:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.821507:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.821513:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 67 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.821523:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 67 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.821531:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bae200, rc 0) 00000100:00100000:2.0:1746065081.821582:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+67:26180:x1830881261540480:12345-192.168.202.27@tcp:101:bash.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.821587:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8840 00010000:00010000:3.0:1746065081.821688:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc14640a5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d25c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.821727:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc14640a5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d25c expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.821736:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a000/0xad6b7ddc14640a5 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x358:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d25c expref: 288 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.821747:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff880098c34000) 00010000:00010000:3.0:1746065081.821749:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.821751:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a000, rc 0) 00000100:00100000:3.0:1746065081.821798:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27960:x1830881261540352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 439us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.821803:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12486 00000100:00100000:0.0:1746065081.822753:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.823053:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540608 00000100:00100000:2.0:1746065081.823058:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540608 00000100:00100000:2.0:1746065081.823087:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8841 00000100:00100000:2.0:1746065081.823093:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+54:26180:x1830881261540608:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065081.823103:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.823115:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d26a expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.823130:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.823142:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.823144:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.823148:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 55 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.823163:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 55 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.823170:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf400, rc 0) 00000100:00100000:2.0:1746065081.823194:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+55:26180:x1830881261540608:12345-192.168.202.27@tcp:101:bash.0 Request processed in 102us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.823199:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8841 00000100:00100000:1.0:1746065081.823428:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.823444:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540864 00000100:00100000:2.0:1746065081.823447:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540864 00000100:00100000:2.0:1746065081.823694:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4299 00000100:00100000:2.0:1746065081.823700:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27960:x1830881261540864:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:2.0:1746065081.824007:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x358:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1746065081.824050:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2506, 64 off207176 00000040:00080000:2.0:1746065081.824070:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2510, 64 off207616 00000040:00080000:2.0:1746065081.824078:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2511, 64 off207680 00000040:00080000:2.0:1746065081.824086:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2507, 64 off207240 00010000:00010000:2.0:1746065081.824125:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065081.824134:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.824143:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.824149:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.824157:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.824161:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.824184:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.824306:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27960:x1830881261540864:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 605us (878us total) trans 4294975807 rc 0/0 00000100:00100000:2.0:1746065081.824312:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4299 00010000:00010000:0.0:1746065081.824410:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.824415:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.824421:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.824424:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.824429:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.824438:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x358:0x0].0x0 (ffff880098c34000) 00010000:00010000:0.0:1746065081.824441:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065081.824443:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.824448:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640b3 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x358:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.824455:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.824456:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.824457:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065081.824526:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.824572:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.824624:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261540992 00000100:00100000:0.0:1746065081.824628:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261540992 00002000:00010000:0.0:1746065081.824646:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/897 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.824649:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881261540992 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.824656:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459880. 00000100:00100000:0.0:1746065081.824678:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261541120 00000100:00100000:0.0:1746065081.824681:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261541120 00002000:00010000:0.0:1746065081.824689:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/896 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.824692:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458380 with x1830881261541120 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.824697:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458380. 00000100:00100000:0.0:1746065081.824708:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1295 00000100:00100000:0.0:1746065081.824713:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+67:2005:x1830881261540992:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065081.824830:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.824832:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:0.0:1746065081.824834:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.824836:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:0.0:1746065081.824837:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.824865:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+68:2005:x1830881261540992:12345-192.168.202.27@tcp:10:bash.0 Request processed in 151us (339us total) trans 17179872653 rc 0/0 00000100:00100000:0.0:1746065081.824870:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1295 00002000:00010000:0.0:1746065081.824872:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/897 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.824874:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881261540992 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.824877:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459880. 00000100:00100000:0.0:1746065081.824887:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1296 00000100:00100000:0.0:1746065081.824892:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881261541120:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:0.0:1746065081.824953:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.824956:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:0.0:1746065081.824957:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.824959:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:0.0:1746065081.824960:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.824977:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881261541120:12345-192.168.202.27@tcp:10:bash.0 Request processed in 84us (404us total) trans 21474839931 rc 0/0 00000100:00100000:0.0:1746065081.824982:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1296 00002000:00010000:0.0:1746065081.824984:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/896 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.824986:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458380 with x1830881261541120 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.824989:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458380. 00000100:00100000:0.0:1746065081.832350:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.832413:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261541376 00000100:00100000:3.0:1746065081.832420:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261541376 00000100:00100000:3.0:1746065081.833375:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12487 00000100:00100000:3.0:1746065081.833384:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27964:x1830881261541376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.833403:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.833420:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640ba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d271 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.833530:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.833548:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833557:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833568:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.833573:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833577:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833656:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.833664:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833669:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.833676:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 2 00010000:00010000:3.0:1746065081.833733:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833739:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833746:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833751:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833755:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.833758:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833763:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833833:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34200) 00010000:00010000:3.0:1746065081.833836:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.833840:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833844:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14640c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833860:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833864:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833869:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833872:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.833874:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833881:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833887:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880098c34400) 00010000:00010000:3.0:1746065081.833889:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.833891:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833895:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b400/0xad6b7ddc14640c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.833926:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.833938:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.833943:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.833945:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.833947:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a400, rc 0) 00000100:00100000:3.0:1746065081.834073:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27964:x1830881261541376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 689us (1728us total) trans 4294975808 rc 0/0 00000100:00100000:3.0:1746065081.834078:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12487 00000100:00100000:0.0:1746065081.834160:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.836317:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261541632 00000100:00100000:2.0:1746065081.836325:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261541632 00000100:00100000:2.0:1746065081.836369:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4300 00000100:00100000:2.0:1746065081.836376:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261541632:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065081.836567:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261541632:12345-192.168.202.27@tcp:35:bash.0 Request processed in 190us (2406us total) trans 4294975809 rc 0/0 00000100:00100000:2.0:1746065081.836573:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4300 00000100:00100000:0.0:1746065081.836643:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.836740:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261541888 00000100:00100000:2.0:1746065081.836743:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261541888 00000100:00100000:2.0:1746065081.836759:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4301 00000100:00100000:2.0:1746065081.836764:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27964:x1830881261541888:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.836858:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27964:x1830881261541888:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 93us (214us total) trans 4294975810 rc 0/0 00000100:00100000:2.0:1746065081.836863:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4301 00000100:00100000:2.0:1746065081.838966:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.839101:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261542144 00000100:00100000:3.0:1746065081.839107:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261542144 00000100:00100000:3.0:1746065081.839136:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12488 00000100:00100000:3.0:1746065081.839142:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27964:x1830881261542144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.839158:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.839172:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14640dd lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d278 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.839239:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.839250:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.839256:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.839279:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.839288:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 294 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.839297:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262674944:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.839732:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.841967:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.842010:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261542272 00000100:00100000:0.0:1746065081.842017:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261542272 00010000:00010000:0.0:1746065081.842044:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 295 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.842124:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3710 00000100:00100000:0.0:1746065081.842131:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+295:2005:x1830881261542272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065081.842140:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.842145:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 295 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.842155:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 295 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.842171:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065081.842175:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.842182:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.842187:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.842204:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.842235:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+295:2005:x1830881261542272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.842241:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3710 00000100:00100000:1.0:1746065081.842257:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.842317:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc14640cf lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d271 expref: 294 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.842333:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262674944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.842347:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.842364:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.842368:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.842392:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 5 00000100:00100000:2.0:1746065081.842499:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261542400 00000100:00100000:2.0:1746065081.842503:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261542400 00000100:00100000:2.0:1746065081.842524:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12489 00000100:00100000:2.0:1746065081.842528:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27965:x1830881261542400:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1746065081.842553:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.842566:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640f2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d27f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.842906:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc14640dd lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.842917:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.842923:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.842925:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065081.842928:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:3.0:1746065081.842952:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27964:x1830881261542144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3809us (3990us total) trans 4294975811 rc 0/0 00000100:00100000:3.0:1746065081.842957:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12488 00010000:00010000:2.0:1746065081.843041:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.843048:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.843055:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.843064:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.843069:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.843074:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.843122:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.843129:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.843135:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.843159:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.843169:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 295 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.843179:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262675072:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.843226:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.845133:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262675072:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.845150:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.845640:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.845854:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261542528 00000100:00100000:3.0:1746065081.845860:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261542528 00000100:00100000:3.0:1746065081.845906:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12490 00000100:00100000:3.0:1746065081.845912:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27964:x1830881261542528:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.845928:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.845939:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146410e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d286 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.845997:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.846005:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.846012:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065081.846217:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.846357:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261542656 00000100:00100000:2.0:1746065081.846360:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261542656 00010000:00010000:2.0:1746065081.846374:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 298 pid: 7205 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.846450:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3711 00000100:00100000:2.0:1746065081.846456:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+298:2005:x1830881261542656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.846465:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.846470:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 298 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.846478:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 298 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.846491:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14640e4 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x35a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d278 expref: 298 pid: 7205 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.846661:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.846665:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.846671:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.846676:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.846682:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.846686:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.846689:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.846845:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.846909:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.846915:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.847061:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.847067:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065081.847089:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 5 00000004:00200000:3.0:1746065081.847093:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065081.847103:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.847121:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146410e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d286 expref: 298 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.847131:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d286 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.847136:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.847139:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.847140:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b800, rc 0) 00000004:00200000:0.0:1746065081.847175:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 5 00000004:00200000:0.0:1746065081.847178:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065081.847186:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847194:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847203:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847209:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847218:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847222:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.847223:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+297:2005:x1830881261542656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 766us (1005us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065081.847227:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baec00 already unused, calling callback (ffffffffa0f21690) 00000100:00100000:2.0:1746065081.847229:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3711 00010000:00010000:0.0:1746065081.847230:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847235:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847242:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:0.0:1746065081.847244:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.847246:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847251:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baec00/0xad6b7ddc14640f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065081.847494:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27964:x1830881261542528:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1581us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.847499:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12490 00010000:00010000:0.0:1746065081.847557:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847563:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847566:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847570:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019ec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.847572:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847576:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847583:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973600) 00010000:00010000:0.0:1746065081.847585:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.847587:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847595:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464100 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.847618:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14640f2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d27f expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.847631:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d27f expref: 295 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.847636:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065081.847638:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065081.847640:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:0.0:1746065081.847657:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27965:x1830881261542400:12345-192.168.202.27@tcp:101:rm.0 Request processed in 5128us (5400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.847662:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12489 00000100:00100000:0.0:1746065081.849500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.849680:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261542912 00000100:00100000:2.0:1746065081.849686:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261542912 00000100:00100000:2.0:1746065081.849770:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12491 00000100:00100000:2.0:1746065081.849799:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27964:x1830881261542912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.849812:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.849825:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc146411c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d28d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.849890:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1464123 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.849899:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1464123 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.849906:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1464123 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:2.0:1746065081.849914:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 5 00010000:00010000:2.0:1746065081.850573:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7a00/0xad6b7ddc146411c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d28d expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.850589:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1464123 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d28d expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.850596:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.850599:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.850601:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7c00, rc 0) 00000100:00100000:2.0:1746065081.850642:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27964:x1830881261542912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 842us (1146us total) trans 4294975812 rc 0/0 00000100:00100000:2.0:1746065081.850648:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12491 00000100:00100000:0.0:1746065081.850825:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.850943:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543040 00000100:00100000:2.0:1746065081.850947:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543040 00000100:00100000:2.0:1746065081.850976:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 564 00000100:00100000:2.0:1746065081.850982:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+297:2004:x1830881261543040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.850990:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.851191:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1464107 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d27f expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.851201:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.851204:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065081.851222:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261543040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 241us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.851228:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 564 00000100:00100000:0.0:1746065081.851354:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.851404:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543296 00000100:00100000:2.0:1746065081.851408:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543296 00000100:00100000:2.0:1746065081.851431:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12492 00000100:00100000:2.0:1746065081.851435:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27965:x1830881261543296:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065081.851457:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065081.851465:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464097 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d255 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.851475:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc1464115 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d286 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.851484:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927400/0xad6b7ddc1464074 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d247 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.851491:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.851493:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.851507:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.851513:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.851519:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.851527:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.851531:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.851535:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.851601:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065081.851607:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.851612:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:2.0:1746065081.852810:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x35a:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1746065081.852873:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852879:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852884:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852890:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.852893:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852898:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852908:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.852910:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065081.852913:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852917:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a97a00/0xad6b7ddc146413f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852931:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852935:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852939:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852943:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852946:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.852948:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852952:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852956:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:2.0:1746065081.852958:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.852960:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852963:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ef3ca00/0xad6b7ddc1464131 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065081.852977:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009acedf80 reply state ffff88009fadd000 transno 4294975813 ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852984:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065081.852988:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973100) 00010000:00010000:2.0:1746065081.852990:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.852992:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.853074:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27965:x1830881261543296:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1635us (1717us total) trans 4294975813 rc 0/0 00000100:00100000:2.0:1746065081.853080:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12492 00000100:00100000:1.0:1746065081.853266:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.853666:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543424 00000100:00100000:3.0:1746065081.853671:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543424 00000100:00100000:3.0:1746065081.853703:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12493 00000100:00100000:3.0:1746065081.853709:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27964:x1830881261543424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.853721:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.853729:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1464146 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d294 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.853758:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1464146 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d294 expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.853766:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1464146 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d294 expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.853799:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.853802:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.853804:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:3.0:1746065081.854302:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27964:x1830881261543424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 591us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.854307:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12493 00000100:00100000:0.0:1746065081.857412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.857592:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543552 00000100:00100000:1.0:1746065081.857600:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543552 00000100:00100000:1.0:1746065081.857642:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8842 00000100:00100000:1.0:1746065081.857649:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+68:2006:x1830881261543552:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065081.857683:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.857697:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 68 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.857704:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.857706:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065081.857708:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.857737:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 68 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.857747:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 68 pid: 10219 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.857758:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800982cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262675200:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.857845:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.859062:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800982cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881262675200:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.859078:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.861337:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.861481:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543680 00000100:00100000:2.0:1746065081.861489:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543680 00002000:00100000:2.0:1746065081.861524:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x381:0x0] (0->4) req@ffff88009acec380 x1830881261543680/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/0 e 0 to 0 dl 1746065092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065081.861532:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec380 with x1830881261543680 ext(0->4) 00010000:00010000:2.0:1746065081.861548:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 69 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.861559:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 69 pid: 10219 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746065081.861566:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acec380 00000100:00100000:2.0:1746065081.861837:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 224 00000100:00100000:2.0:1746065081.861845:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261543680:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:2.0:1746065081.862692:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+71:2005:x1830881261543680:12345-192.168.202.27@tcp:4:bash.0 Request processed in 846us (1359us total) trans 17179872654 rc 0/0 00000100:00100000:2.0:1746065081.862699:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 224 00002000:00100000:2.0:1746065081.862705:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x381:0x0] (0->4) req@ffff88009acec380 x1830881261543680/t17179872654(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:752/0 lens 496/448 e 0 to 0 dl 1746065092 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065081.862711:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec380 with x1830881261543680 ext(0->4) 00010000:00010000:2.0:1746065081.862716:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 71 pid: 10219 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.862990:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.863045:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543808 00000100:00100000:3.0:1746065081.863049:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543808 00000100:00100000:3.0:1746065081.863078:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12494 00000100:00100000:3.0:1746065081.863083:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27966:x1830881261543808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.863097:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.863110:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc1464154 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d29b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.863193:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 71 pid: 10219 timeout: 777 lvb_type: 0 00002000:00010000:2.0:1746065081.863200:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acec380 00010000:00010000:3.0:1746065081.863282:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.863292:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863300:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863308:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.863313:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863317:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863341:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863346:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863355:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863360:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863364:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.863367:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863373:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863381:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34f00) 00010000:00010000:3.0:1746065081.863383:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.863387:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863391:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b800/0xad6b7ddc146415b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863415:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863420:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863424:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863428:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.863429:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863433:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863438:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973100) 00010000:00010000:3.0:1746065081.863440:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.863442:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863446:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464162 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.863465:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc1464154 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d29b expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.863470:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a400/0xad6b7ddc1464154 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d29b expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.863479:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a400, rc 0) 00000100:00100000:3.0:1746065081.863513:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27966:x1830881261543808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 429us (522us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.863519:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12494 00000100:00100000:0.0:1746065081.865000:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.865075:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261543936 00000100:00100000:2.0:1746065081.865079:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261543936 00010000:00010000:2.0:1746065081.865100:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 71 pid: 10219 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.865133:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3712 00000100:00100000:2.0:1746065081.865140:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261543936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065081.865149:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065081.865161:0:8352:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1746065081.865164:0:8352:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065081.865169:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 71 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.865179:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 71 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.865195:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091bae200/0xad6b7ddc146409e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d263 expref: 71 pid: 10219 timeout: 777 lvb_type: 0 00010000:00010000:2.0:1746065081.865220:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.865223:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.865227:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.865235:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.865254:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065081.865268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.865280:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+70:2004:x1830881261543936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.865285:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3712 00010000:00010000:1.0:1746065081.865361:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865368:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865382:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865387:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865393:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865398:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065081.865401:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865406:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865415:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.865421:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146414d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.865462:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+69:2006:x1830881261543552:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 7813us (8058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.865469:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8842 00000100:00100000:3.0:1746065081.865570:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261544064 00000100:00100000:3.0:1746065081.865574:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261544064 00000100:00100000:3.0:1746065081.865596:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12495 00000100:00100000:3.0:1746065081.865600:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27966:x1830881261544064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.865614:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.865623:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc1464169 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2a2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.865660:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.865668:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865675:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865683:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.865689:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865693:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865717:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865722:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865730:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865734:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865738:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.865740:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865745:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865752:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34800) 00010000:00010000:3.0:1746065081.865754:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.865757:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865760:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856800/0xad6b7ddc1464170 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865768:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865811:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865816:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865819:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.865821:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865829:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865835:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973100) 00010000:00010000:3.0:1746065081.865837:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.865839:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865842:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d856400/0xad6b7ddc1464177 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.865863:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc1464169 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2a2 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.865869:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc1464169 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2a2 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.865879:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:3.0:1746065081.865904:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27966:x1830881261544064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 302us (635us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065081.865908:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12495 00000100:00100000:0.0:1746065081.866888:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.866988:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261544320 00000100:00100000:1.0:1746065081.866993:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261544320 00000100:00100000:1.0:1746065081.867060:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12496 00000100:00100000:1.0:1746065081.867067:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27964:x1830881261544320:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065081.867091:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.867108:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc1464146 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d294 expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.867117:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:1.0:1746065081.867121:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.867135:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065081.867143:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.867149:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:1.0:1746065081.867292:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2512, 88 off207768 00000004:00080000:1.0:1746065081.867297:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677885523108ns, next at 678738608678ns, rc = 0 00000100:00100000:0.0:1746065081.867518:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000040:00080000:1.0:1746065081.867809:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2508, 88 off207328 00000004:00080000:1.0:1746065081.867814:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677886040539ns, next at 678738623360ns, rc = 0 00000100:00100000:3.0:1746065081.867855:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261544448 00000100:00100000:3.0:1746065081.867858:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261544448 00000100:00100000:3.0:1746065081.867885:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12497 00000100:00100000:3.0:1746065081.867890:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27966:x1830881261544448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.867899:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.867908:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464185 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2a9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1746065081.867961:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2509, 88 off207416 00000004:00080000:1.0:1746065081.867964:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677886190258ns, next at 678738623360ns, rc = 0 00000040:00080000:1.0:1746065081.867972:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2513, 88 off207856 00000004:00080000:1.0:1746065081.867974:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677886200099ns, next at 678738608678ns, rc = 0 00010000:00010000:3.0:1746065081.868226:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146418c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.868234:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146418c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.868241:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146418c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.868265:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065081.868269:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065081.868291:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc1464185 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2a9 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.868863:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146418c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2a9 expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.868869:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34d00) 00010000:00010000:3.0:1746065081.868871:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065081.868873:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:3.0:1746065081.868909:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27966:x1830881261544448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1018us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.868914:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12497 00000001:00080000:3.0:1746065081.870842:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975814 is committed 00000004:00080000:3.0:1746065081.870851:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1697 committed 00000004:00080000:3.0:1746065081.870857:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1687 committed 00000004:00080000:3.0:1746065081.870862:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1686 committed 00000004:00080000:3.0:1746065081.870864:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1696 committed 00000100:00100000:2.0:1746065081.870993:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262675328:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.871043:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.871081:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065081.871086:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262675712:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.871101:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.871122:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675328 00000100:00100000:2.0:1746065081.871127:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675328 00000100:00100000:2.0:1746065081.871152:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675712 00000100:00100000:2.0:1746065081.871153:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675712 00000100:00100000:2.0:1746065081.871165:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8843 00000100:00100000:2.0:1746065081.871170:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+168:3760:x1830881262675328:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065081.871192:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:895 count 1 00010000:00010000:2.0:1746065081.871210:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871225:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 68 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871231:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.871232:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.871234:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871252:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 68 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871261:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 68 pid: 9549 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.871269:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262675840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.871313:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.871326:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8844 00010000:00010000:0.0:1746065081.871326:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065081.871330:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+168:3760:x1830881262675712:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065081.871337:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.871342:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.871346:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800906d0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.871350:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.871354:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.871364:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973100) 00010000:00010000:0.0:1746065081.871367:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.871370:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.871375:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464138 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:0.0:1746065081.871402:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262675456:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.871423:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.871427:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+169:3760:x1830881262675712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (325us total) trans 17179872655 rc 0/0 00000100:00100000:2.0:1746065081.871433:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8844 00000100:00100000:0.0:1746065081.871436:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065081.871439:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262675584:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.871442:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675456 00000100:00100000:2.0:1746065081.871444:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675456 00000100:00100000:0.0:1746065081.871452:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.871455:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675584 00000100:00100000:2.0:1746065081.871457:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675584 00000100:00100000:2.0:1746065081.871468:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8845 00000100:00100000:0.0:1746065081.871471:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8846 00000100:00100000:2.0:1746065081.871472:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+170:3761:x1830881262675456:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065081.871475:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+170:3761:x1830881262675584:12345-0@lo:2:osp-syn-1-1.0 00002000:00080000:2.0:1746065081.871480:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:896 count 1 00002000:00010000:2.0:1746065081.871494:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.871498:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871504:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.871506:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.871509:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871517:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.871524:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.871525:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+171:3761:x1830881262675584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 50us (73us total) trans 17179872656 rc 0/0 00010000:00010000:2.0:1746065081.871529:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.871530:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8846 00010000:00010000:2.0:1746065081.871553:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.871558:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.871563:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.871568:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.871570:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.871575:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.871585:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.871590:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146419a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.871600:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.871601:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.871603:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746065081.871621:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570c700/2, rc 0, transno 17179872656 00000100:00100000:0.0:1746065081.871625:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262675584:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1746065081.872274:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570e300/2, rc 0, transno 17179872657 00000100:00100000:0.0:1746065081.872279:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262675456:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.873532:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262676352:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065081.873561:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aceea00 reply state ffff8800955abc00 transno 4294975814 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.873579:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.873588:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:1.0:1746065081.873591:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065081.873594:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.874532:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+171:3761:x1830881262675456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3055us (3102us total) trans 17179872657 rc 0/0 00000100:00100000:2.0:1746065081.874549:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8845 00000100:00100000:0.0:1746065081.874552:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262676096:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.874580:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.874588:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262675968:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.874602:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065081.874607:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008d85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262676224:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.874609:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.874619:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065081.874636:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570fb80/2, rc 0, transno 17179872655 00000100:00100000:2.0:1746065081.874640:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262675712:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.874654:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676096 00000100:00100000:2.0:1746065081.874658:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676096 00000100:00100000:2.0:1746065081.874677:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675968 00000100:00100000:2.0:1746065081.874679:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675968 00000100:00100000:2.0:1746065081.874694:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676224 00000100:00100000:2.0:1746065081.874695:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676224 00000100:00100000:2.0:1746065081.874710:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8847 00000100:00100000:2.0:1746065081.874715:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+136:3761:x1830881262676096:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.874720:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8848 00000100:00100000:0.0:1746065081.874724:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+136:3760:x1830881262675968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065081.874735:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:895 count 1 00002000:00080000:0.0:1746065081.874735:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:894 count 1 00010000:00010000:0.0:1746065081.874749:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.874755:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065081.874758:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.874762:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 55 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.874763:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.874765:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.874767:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065081.874768:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.874768:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065081.874770:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.874805:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 55 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.874814:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 55 pid: 9548 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.874822:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262676480:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065081.874857:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065081.875206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.875239:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676352 00000100:00100000:3.0:1746065081.875242:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676352 00000100:00100000:3.0:1746065081.875258:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8849 00000100:00100000:3.0:1746065081.875263:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+137:3761:x1830881262676224:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065081.875349:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065081.875351:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065081.875354:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065081.875355:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065081.875357:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065081.875386:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+138:3761:x1830881262676224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 123us (765us total) trans 21474839932 rc 0/0 00000100:00100000:3.0:1746065081.875391:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8849 00000100:00100000:3.0:1746065081.875401:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8850 00000100:00100000:3.0:1746065081.875405:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+137:3759:x1830881262676352:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.875455:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+138:3759:x1830881262676352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 49us (250us total) trans 21474839933 rc 0/0 00000100:00100000:3.0:1746065081.875461:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8850 00000004:00080000:3.0:1746065081.875485:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85ed80/2, rc 0, transno 21474839932 00000100:00100000:3.0:1746065081.875489:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262676224:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.875504:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85dc00/2, rc 0, transno 21474839933 00000100:00100000:3.0:1746065081.875506:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262676352:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1746065081.875584:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.875592:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.875598:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.875617:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065081.875738:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+138:3761:x1830881262676096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1022us (1156us total) trans 21474839934 rc 0/0 00000100:00100000:2.0:1746065081.875743:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8847 00010000:00080000:1.0:1746065081.875843:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065081.875854:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27964:x1830881261544320:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 8787us (8967us total) trans 4294975814 rc 0/0 00000100:00100000:1.0:1746065081.875859:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12496 00010000:00010000:1.0:1746065081.875880:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.875886:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.875890:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.875895:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.875898:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.875902:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.875912:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:1.0:1746065081.875915:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.875917:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.875921:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad200/0xad6b7ddc146417e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.876012:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065081.876016:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.876022:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.876024:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.876030:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.876039:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.876044:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14641a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.876055:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.876056:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.876057:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065081.876088:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85d500/2, rc 0, transno 21474839934 00000100:00100000:3.0:1746065081.876092:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262676096:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.876976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.877010:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261544576 00000100:00100000:1.0:1746065081.877014:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261544576 00000100:00100000:1.0:1746065081.877047:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12498 00000100:00100000:1.0:1746065081.877053:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27966:x1830881261544576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.877064:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.877075:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc14641af lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2b0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.877121:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065081.877129:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877136:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877146:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065081.877151:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877155:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877178:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877183:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877188:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877192:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877196:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.877199:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877203:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877209:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34d00) 00010000:00010000:1.0:1746065081.877212:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.877215:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877218:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14641b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877225:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877230:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877234:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877237:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.877239:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877243:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877248:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34700) 00010000:00010000:1.0:1746065081.877250:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.877252:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877256:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14641bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.877277:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc14641af lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b0 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.877288:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc14641af lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b0 expref: 289 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.877294:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:1.0:1746065081.877321:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+288:27966:x1830881261544576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 268us (2413us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065081.877326:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12498 00000100:00100000:2.0:1746065081.878349:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c524380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881262676480:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.878372:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.878436:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881262675840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.878450:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.879011:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.879046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.880741:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261544832 00000100:00100000:1.0:1746065081.880752:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261544832 00010000:00010000:1.0:1746065081.880798:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 69 pid: 9549 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.880826:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261544704 00000100:00100000:1.0:1746065081.880828:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261544704 00010000:00010000:1.0:1746065081.880840:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 56 pid: 9548 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.880856:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3713 00000100:00100000:1.0:1746065081.880862:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261544832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.880873:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065081.880876:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3714 00010000:00010000:1.0:1746065081.880877:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 69 pid: 9549 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746065081.880883:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881261544704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.880885:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 69 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.880888:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065081.880892:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 56 pid: 9548 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.880899:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 56 pid: 9548 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.880907:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1463ed7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d1c9 expref: 69 pid: 9549 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746065081.880909:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc1464066 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d240 expref: 56 pid: 9548 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.880918:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.880918:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.880920:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065081.880920:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.880924:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.880924:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.880930:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.880930:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.880962:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.880963:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.880995:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+68:2005:x1830881261544832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.880995:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881261544704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 113us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.881001:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3714 00010000:00010000:3.0:1746065081.881037:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881044:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.881046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.881052:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881057:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881074:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.881078:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.881084:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881089:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091bae600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.881092:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881097:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881106:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881110:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc14641a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881122:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.881123:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.881125:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.881154:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.881314:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+138:3760:x1830881262675968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6588us (6703us total) trans 21474839935 rc 0/0 00000100:00100000:3.0:1746065081.881321:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8848 00010000:00010000:3.0:1746065081.881343:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881349:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881355:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881365:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.881385:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746065081.881402:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.881406:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881412:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.881414:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881420:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881429:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881434:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464193 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881446:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.881447:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.881448:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065081.881493:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3713 00000100:00100000:1.0:1746065081.881514:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261545088 00000100:00100000:1.0:1746065081.881517:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261545088 00000100:00100000:1.0:1746065081.881533:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261545216 00000100:00100000:1.0:1746065081.881535:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261545216 00000100:00100000:1.0:1746065081.881564:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12499 00000100:00100000:1.0:1746065081.881568:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+289:27966:x1830881261545088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.881580:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.881582:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065081.881595:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc146418c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2a9 expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.881605:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098c34d00) 00010000:00010000:1.0:1746065081.881611:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065081.881620:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc14641c4 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2b7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.881673:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12500 00000100:00100000:0.0:1746065081.881679:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+289:27964:x1830881261545216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.881684:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065081.881687:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.881693:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.881693:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2be expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.881699:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.881706:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065081.881711:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.881716:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.881716:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881723:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 290 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.881733:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065081.881736:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065081.881738:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf200, rc 0) 00000100:00100000:0.0:1746065081.881755:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27964:x1830881261545216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 76us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065081.881761:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12500 00010000:00010000:1.0:1746065081.881960:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065081.881966:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.881972:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065081.881979:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35c:0x0]: returning size 0 00010000:00010000:1.0:1746065081.881997:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882001:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882006:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882009:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882013:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7aca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.882015:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882019:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882025:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34300) 00010000:00010000:1.0:1746065081.882027:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065081.882029:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882032:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7aca00/0xad6b7ddc14641cb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:1.0:1746065081.882040:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c524700 reply state ffff88009ad3c000 transno 4294975815 ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882047:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.882052:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34800) 00010000:00010000:1.0:1746065081.882053:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065081.882055:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065081.882071:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad000/0xad6b7ddc14641c4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.882086:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.882091:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff880097e34100) 00010000:00010000:1.0:1746065081.882092:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065081.882094:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e200, rc 0) 00000100:00100000:1.0:1746065081.882111:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27966:x1830881261545088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 542us (1065us total) trans 4294975815 rc 0/0 00000100:00100000:1.0:1746065081.882116:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12499 00000100:00100000:3.0:1746065081.882172:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+171:3760:x1830881262675328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10309us (10436us total) trans 17179872658 rc 0/0 00000100:00100000:3.0:1746065081.882179:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8843 00000004:00080000:2.0:1746065081.882284:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008d85c000/2, rc 0, transno 21474839935 00000100:00100000:2.0:1746065081.882290:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008d85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262675968:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.882300:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009570c380/2, rc 0, transno 17179872658 00000100:00100000:2.0:1746065081.882303:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262675328:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.885241:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.885702:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261545600 00000100:00100000:3.0:1746065081.885710:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261545600 00000100:00100000:3.0:1746065081.885757:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12501 00000100:00100000:3.0:1746065081.885763:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+291:27966:x1830881261545600:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065081.894444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.894600:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261545344 00000100:00100000:1.0:1746065081.894610:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261545344 00000100:00100000:1.0:1746065081.894644:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12502 00000100:00100000:1.0:1746065081.894651:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27964:x1830881261545344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.900926:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.900950:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14641ee lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2cc expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.901043:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.901058:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.901064:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.901090:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.901102:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 293 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.901113:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262676608:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065081.901192:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065081.901383:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.901393:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14641fc lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2c5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.901426:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464203 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065081.901434:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464203 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.901442:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464203 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:1.0:1746065081.901461:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35a:0x0]: returning size 5 00000004:00200000:1.0:1746065081.901465:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065081.901476:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464203 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.901496:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14641fc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2c5 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.901507:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464203 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2c5 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.901513:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:1.0:1746065081.901515:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065081.901518:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:1.0:1746065081.901557:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27964:x1830881261545344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6905us (7120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.901565:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12502 00000100:00100000:0.0:1746065081.906191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.906275:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.906371:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262676608:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.906390:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065081.906735:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261545856 00000100:00100000:3.0:1746065081.906741:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261545856 00010000:00010000:3.0:1746065081.906764:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 294 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:3.0:1746065081.906808:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3715 00000100:00100000:3.0:1746065081.906814:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261545856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065081.906824:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.906828:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 294 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.906837:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 294 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.906854:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14641e0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2b7 expref: 294 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:3.0:1746065081.906864:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff880097e34100) 00010000:00010000:3.0:1746065081.906868:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.906878:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.906883:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.906897:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065081.906926:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+293:2004:x1830881261545856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.906931:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3715 00010000:00010000:3.0:1746065081.906948:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.906953:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.906971:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35c:0x0]: returning size 0 00000004:00080000:3.0:1746065081.907104:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x382:0x0], index 0: 0 00000004:00080000:3.0:1746065081.907109:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x383:0x0], index 1: 0 00000004:00080000:3.0:1746065081.907113:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x384:0x0], index 1: 0 00000004:00080000:3.0:1746065081.907115:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x383:0x0], index 0: 0 00010000:00010000:3.0:1746065081.907187:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907193:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907198:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907202:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.907206:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907211:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907219:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff880097e34100) 00010000:00010000:3.0:1746065081.907221:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.907223:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907228:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14641f5 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.907262:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14641ee lrc: 1/0,0 mode: --/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2cc expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.907268:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14641ee lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2cc expref: 293 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.907280:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ac00, rc 0) 00000100:00100000:3.0:1746065081.907302:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800982cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+292:27966:x1830881261545600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 21539us (22069us total) trans 4294975816 rc 301/301 00000100:00100000:3.0:1746065081.907308:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12501 00000100:00100000:1.0:1746065081.911671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.914987:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261545728 00000100:00100000:2.0:1746065081.914997:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261545728 00000100:00100000:2.0:1746065081.915037:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8851 00000100:00100000:2.0:1746065081.915043:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+68:2005:x1830881261545728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.915057:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.915073:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2d3 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065081.915091:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x381:0x0] initial LVB size: 5, mtime: 0x6812d6ba, atime: 0x0, ctime: 0x6812d6ba, blocks: 0x8 00010000:00010000:2.0:1746065081.915106:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.915107:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065081.915114:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 69 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.915126:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 69 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065081.915134:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44200, rc 0) 00000100:00100000:2.0:1746065081.915188:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261545728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 144us (9006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.915193:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8851 00000100:00100000:3.0:1746065081.915568:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261546112 00000100:00100000:3.0:1746065081.915573:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261546112 00000100:00100000:3.0:1746065081.915604:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4302 00000100:00100000:3.0:1746065081.915609:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27966:x1830881261546112:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065081.915770:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27966:x1830881261546112:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 159us (4105us total) trans 4294975817 rc 0/0 00000100:00100000:3.0:1746065081.915794:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4302 00000100:00100000:0.0:1746065081.920248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.920673:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261546368 00000100:00100000:2.0:1746065081.920681:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261546368 00000100:00100000:0.0:1746065081.921168:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.921274:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4303 00000100:00100000:2.0:1746065081.921282:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27966:x1830881261546368:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065081.921583:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261546496 00000100:00100000:3.0:1746065081.921587:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261546496 00000100:00100000:2.0:1746065081.921610:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27966:x1830881261546368:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 328us (1367us total) trans 4294975818 rc 0/0 00000100:00100000:2.0:1746065081.921617:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4303 00000100:00100000:3.0:1746065081.921646:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8852 00000100:00100000:3.0:1746065081.921651:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261546496:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065081.921704:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+69:2005:x1830881261546496:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 52us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.921709:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8852 00000100:00100000:0.0:1746065081.924939:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.924984:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261546624 00000100:00100000:2.0:1746065081.924993:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261546624 00000100:00100000:2.0:1746065081.925042:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8853 00000100:00100000:2.0:1746065081.925050:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+69:2004:x1830881261546624:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065081.925134:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+69:2004:x1830881261546624:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.925140:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8853 00000100:00100000:0.0:1746065081.929649:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.929692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.929892:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261546880 00000100:00100000:3.0:1746065081.929900:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261546880 00000100:00100000:3.0:1746065081.929936:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261547136 00000100:00100000:3.0:1746065081.929938:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261547136 00000100:00100000:3.0:1746065081.929951:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12503 00000100:00100000:3.0:1746065081.929958:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261546880:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065081.929980:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.929999:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464218 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2da expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.930106:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.930117:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930126:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930134:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.930140:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930145:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930182:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc146422d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.930187:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc146422d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930192:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc146422d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065081.930200:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35c:0x0]: returning size 0 00010000:00010000:3.0:1746065081.930257:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930263:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930267:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930272:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930276:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdbe00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.930279:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930283:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930293:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012c7abf00) 00010000:00010000:3.0:1746065081.930307:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.930310:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930314:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146421f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930329:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930333:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930337:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930340:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.930342:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930345:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930350:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34800) 00010000:00010000:3.0:1746065081.930352:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.930354:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930357:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb800/0xad6b7ddc1464226 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930382:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464218 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2da expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.930396:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc146422d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2da expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.930400:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:3.0:1746065081.930402:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.930404:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00000100:00100000:3.0:1746065081.930452:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261546880:12345-192.168.202.27@tcp:101:bash.0 Request processed in 494us (811us total) trans 4294975819 rc 0/0 00000100:00100000:3.0:1746065081.930457:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12503 00000100:00100000:3.0:1746065081.930471:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12504 00000100:00100000:3.0:1746065081.930477:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27964:x1830881261547136:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065081.930495:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065081.930504:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1464203 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2c5 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.930512:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.930514:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.930528:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065081.930534:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930548:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065081.930593:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c524380 reply state ffff88009a588000 transno 4294975820 ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930601:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065081.930605:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:3.0:1746065081.930607:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.930609:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065081.930642:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27964:x1830881261547136:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 165us (949us total) trans 4294975820 rc 0/0 00000100:00100000:3.0:1746065081.930646:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12504 00000100:00100000:0.0:1746065081.934219:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.934757:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261547392 00000100:00100000:3.0:1746065081.934764:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261547392 00000100:00100000:3.0:1746065081.934950:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8854 00000100:00100000:3.0:1746065081.934957:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+69:27964:x1830881261547392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.934971:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.934986:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2e8 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065081.935210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065081.935246:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.935254:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.935256:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065081.935259:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 70 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.935283:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065081.935296:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 777 lvb_type: 1 00000100:00100000:3.0:1746065081.935307:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262676736:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065081.935827:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261547264 00000100:00100000:1.0:1746065081.935831:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261547264 00000100:00100000:1.0:1746065081.935858:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12505 00000100:00100000:1.0:1746065081.935862:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:26180:x1830881261547264:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.935873:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.935881:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464249 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2e1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.935904:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e1400/0xad6b7ddc1464250 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065081.935913:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e1400/0xad6b7ddc1464250 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.935925:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e1400/0xad6b7ddc1464250 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065081.936003:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464249 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e1 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.936118:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065081.936233:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e1400/0xad6b7ddc1464250 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e1 expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.936242:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:1.0:1746065081.936244:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065081.936247:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0e1400, rc 0) 00000100:00100000:1.0:1746065081.936336:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261547264:12345-192.168.202.27@tcp:101:bash.0 Request processed in 473us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.936342:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12505 00000100:00100000:3.0:1746065081.938114:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262676736:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.938134:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 70 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.938147:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668600, rc 0) 00000100:00100000:3.0:1746065081.938174:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+70:27964:x1830881261547392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3217us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.938181:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8854 00000100:00100000:0.0:1746065081.938613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.938671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.938808:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261547520 00000100:00100000:1.0:1746065081.938813:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261547520 00010000:00010000:1.0:1746065081.938835:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746065081.938854:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3716 00000100:00100000:1.0:1746065081.938860:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+70:2005:x1830881261547520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.938869:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.938884:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.938893:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.938911:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc1464211 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2d3 expref: 70 pid: 10219 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746065081.938920:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.938922:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.938927:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 69 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.938935:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 69 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.938958:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 69 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.938968:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881262676864:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065081.939000:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261547776 00000100:00100000:2.0:1746065081.939004:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261547776 00000100:00100000:1.0:1746065081.939016:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065081.939026:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12506 00000100:00100000:2.0:1746065081.939030:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261547776:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:2.0:1746065081.939064:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065081.939076:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda800/0xad6b7ddc146422d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2da expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.939089:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:2.0:1746065081.939092:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.939630:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065081.940071:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.940078:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:2.0:1746065081.940109:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975821 00000004:00010000:2.0:1746065081.940123:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aed6a00 reply state ffff88009fade000 transno 4294975822 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.940130:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065081.940135:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:2.0:1746065081.940137:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.940139:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065081.940190:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261547776:12345-192.168.202.27@tcp:36:bash.0 Request processed in 1158us (1518us total) trans 4294975822 rc 0/0 00000100:00100000:2.0:1746065081.940196:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12506 00000020:00080000:2.0:1746065081.940199:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065081.942280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.942314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.942361:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261547904 00000100:00100000:3.0:1746065081.942367:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261547904 00000100:00100000:3.0:1746065081.942395:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8855 00000100:00100000:3.0:1746065081.942400:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+70:2004:x1830881261547904:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065081.942483:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065081.942485:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065081.942487:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb atime from disk: 0 -> 1746065081 00002000:00010000:3.0:1746065081.942489:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065081.942490:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065081.942517:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261547904:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 116us (241us total) trans 17179872659 rc 0/0 00000100:00100000:3.0:1746065081.942525:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8855 00000100:00100000:1.0:1746065081.942832:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881262676864:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065081.942836:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261548032 00000100:00100000:2.0:1746065081.942839:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261548032 00010000:00010000:1.0:1746065081.942845:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065081.942861:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12507 00000100:00100000:1.0:1746065081.942864:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+70:2005:x1830881261547520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4005us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.942865:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261548032:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:1.0:1746065081.942871:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3716 00010000:00010000:2.0:1746065081.942877:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.942888:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45600/0xad6b7ddc146425e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2ef expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.942922:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45600/0xad6b7ddc146425e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2ef expref: 301 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.942937:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45600/0xad6b7ddc146425e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2ef expref: 301 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.942950:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:2.0:1746065081.942952:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065081.942954:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45600, rc 0) 00000100:00100000:2.0:1746065081.942984:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+301:26180:x1830881261548032:12345-192.168.202.27@tcp:101:bash.0 Request processed in 117us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.942989:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12507 00000100:00100000:0.0:1746065081.944996:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.945124:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.945167:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261548288 00000100:00100000:2.0:1746065081.945177:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261548288 00000100:00100000:3.0:1746065081.945181:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261548544 00000100:00100000:3.0:1746065081.945184:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261548544 00000100:00100000:3.0:1746065081.945215:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12508 00000100:00100000:2.0:1746065081.945215:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4304 00000100:00100000:3.0:1746065081.945222:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261548544:12345-192.168.202.27@tcp:101:bash.0 00000100:00100000:2.0:1746065081.945222:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+302:27964:x1830881261548288:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065081.945342:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x35a:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1464123 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d28d expref: 302 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.945375:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065081.945386:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.945392:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.945415:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.945430:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 302 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:2.0:1746065081.945441:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262676992:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065081.945500:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065081.945532:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.945534:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.945555:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45600/0xad6b7ddc146425e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2ef expref: 302 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.945571:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:3.0:1746065081.945574:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.945580:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc146426c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2f6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.945605:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668400/0xad6b7ddc1464273 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065081.945612:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668400/0xad6b7ddc1464273 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065081.945619:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668400/0xad6b7ddc1464273 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:3.0:1746065081.946062:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2510, 88 off207504 00000004:00080000:3.0:1746065081.946068:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677964293851ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065081.946109:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2514, 88 off207944 00000004:00080000:3.0:1746065081.946112:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677964338702ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065081.946132:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2515, 88 off208032 00000004:00080000:3.0:1746065081.946136:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677964362212ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065081.946144:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2511, 88 off207592 00000004:00080000:3.0:1746065081.946147:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677964373301ns, next at 678738623360ns, rc = 0 00000100:00100000:2.0:1746065081.947811:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262676992:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065081.947831:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:2.0:1746065081.948566:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:3.0:1746065081.948881:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975823 is committed 00000004:00080000:3.0:1746065081.948887:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1689 committed 00000004:00080000:3.0:1746065081.948893:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1699 committed 00000004:00080000:3.0:1746065081.948901:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1698 committed 00000004:00080000:3.0:1746065081.948903:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1688 committed 00010000:00010000:3.0:1746065081.948955:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668400/0xad6b7ddc1464273 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2f6 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.948964:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:3.0:1746065081.948966:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.948976:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669e00/0xad6b7ddc146426c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2f6 expref: 295 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065081.948988:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668400/0xad6b7ddc1464273 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2f6 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.949008:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:3.0:1746065081.949010:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065081.949012:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668400, rc 0) 00000100:00100000:3.0:1746065081.949046:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261548544:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3825us (3925us total) trans 4294975823 rc 0/0 00000100:00100000:3.0:1746065081.949053:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12508 00010000:00010000:0.0:1746065081.949147:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949154:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949159:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949163:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019ec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.949166:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949175:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949182:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880097e34800) 00010000:00010000:0.0:1746065081.949184:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.949186:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949190:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14641d9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.949205:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949209:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949213:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949216:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.949217:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949221:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949225:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:0.0:1746065081.949227:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.949229:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949232:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc146423b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065081.949239:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.949243:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.949246:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.949249:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.949251:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.949254:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.949259:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:0.0:1746065081.949260:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.949262:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.949265:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464257 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x35c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065081.949320:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065081.949329:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262677248:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.949358:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.949384:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677248 00000100:00100000:0.0:1746065081.949389:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677248 00000100:00100000:0.0:1746065081.949412:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8856 00000100:00100000:0.0:1746065081.949417:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+138:3762:x1830881262677248:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.949520:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+139:3762:x1830881262677248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 102us (160us total) trans 21474839936 rc 0/0 00000100:00100000:0.0:1746065081.949525:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8856 00000004:00080000:0.0:1746065081.949559:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed5880/2, rc 0, transno 21474839936 00000100:00100000:0.0:1746065081.949563:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262677248:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.949771:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262677120:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065081.949805:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065081.949819:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065081.949823:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262677504:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.949839:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065081.949954:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261548672 00000100:00100000:1.0:1746065081.949958:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261548672 00010000:00010000:1.0:1746065081.949975:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 291 pid: 7204 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746065081.949996:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3717 00000100:00100000:1.0:1746065081.950000:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+291:2005:x1830881261548672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.950007:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.950012:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 291 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.950020:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 291 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.950031:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14641d2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2be expref: 291 pid: 7204 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746065081.950051:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:1.0:1746065081.950055:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.950062:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.950066:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.950079:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065081.950099:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+290:2005:x1830881261548672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.950104:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3717 00010000:00010000:2.0:1746065081.950199:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.950206:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:2.0:1746065081.950340:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2516, 88 off208120 00000004:00080000:2.0:1746065081.950345:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677968571142ns, next at 678738608678ns, rc = 0 00000040:00080000:2.0:1746065081.950367:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2512, 88 off207680 00000004:00080000:2.0:1746065081.950371:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677968597056ns, next at 678738623360ns, rc = 0 00000040:00080000:2.0:1746065081.950406:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2513, 88 off207768 00000004:00080000:2.0:1746065081.950410:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677968636093ns, next at 678738623360ns, rc = 0 00000040:00080000:2.0:1746065081.950426:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2517, 88 off208208 00000004:00080000:2.0:1746065081.950428:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 677968654635ns, next at 678738608678ns, rc = 0 00000100:00100000:3.0:1746065081.950598:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065081.950606:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262677376:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.950627:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.950930:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677120 00000100:00100000:0.0:1746065081.950934:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677120 00000100:00100000:0.0:1746065081.951119:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677504 00000100:00100000:0.0:1746065081.951122:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677504 00000100:00100000:2.0:1746065081.951148:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677376 00000100:00100000:2.0:1746065081.951151:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677376 00000100:00100000:2.0:1746065081.951244:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8857 00000100:00100000:2.0:1746065081.951251:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+139:3760:x1830881262677120:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065081.951386:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8858 00000100:00100000:0.0:1746065081.951392:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+172:3760:x1830881262677504:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.951570:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8859 00000100:00100000:1.0:1746065081.951577:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+173:3761:x1830881262677376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.951807:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+140:3760:x1830881262677120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 556us (2000us total) trans 21474839937 rc 0/0 00000100:00100000:2.0:1746065081.951814:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8857 00000100:00100000:0.0:1746065081.951989:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+174:3760:x1830881262677504:12345-0@lo:2:osp-syn-1-1.0 Request processed in 596us (2147us total) trans 17179872660 rc 0/0 00000100:00100000:0.0:1746065081.951995:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8858 00000100:00100000:1.0:1746065081.952004:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+173:3761:x1830881262677376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 429us (1376us total) trans 17179872661 rc 0/0 00000100:00100000:1.0:1746065081.952009:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8859 00000004:00080000:3.0:1746065081.952093:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880076cf4380/2, rc 0, transno 17179872660 00000100:00100000:3.0:1746065081.952106:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262677504:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.952114:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed7800/2, rc 0, transno 21474839937 00000100:00100000:3.0:1746065081.952119:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262677120:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065081.952132:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fe680/2, rc 0, transno 17179872661 00000100:00100000:3.0:1746065081.952134:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262677376:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.952169:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.952219:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261548800 00000100:00100000:1.0:1746065081.952222:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261548800 00000100:00100000:1.0:1746065081.952255:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8860 00000100:00100000:1.0:1746065081.952260:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+55:26180:x1830881261548800:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.952268:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.952278:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d2fd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.952290:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.952401:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.952404:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.952410:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 56 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.952422:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 56 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.952430:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6400, rc 0) 00000100:00100000:1.0:1746065081.952464:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+56:26180:x1830881261548800:12345-192.168.202.27@tcp:101:bash.0 Request processed in 203us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.952469:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8860 00000100:00100000:0.0:1746065081.953511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.953578:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261548928 00000100:00100000:1.0:1746065081.953582:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261548928 00000100:00100000:1.0:1746065081.953725:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8861 00000100:00100000:1.0:1746065081.953732:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+70:26180:x1830881261548928:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065081.953742:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.953752:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d304 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065081.953764:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065081.953796:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.953798:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065081.953802:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 71 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.953812:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 71 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.953819:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7200, rc 0) 00000100:00100000:1.0:1746065081.953870:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+71:26180:x1830881261548928:12345-192.168.202.27@tcp:101:bash.0 Request processed in 138us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.953876:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8861 00000100:00100000:2.0:1746065081.955290:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.955347:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.955408:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261549056 00000100:00100000:0.0:1746065081.955413:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261549056 00002000:00010000:0.0:1746065081.955436:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/898 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.955440:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cd180 with x1830881261549056 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.955448:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cd180. 00000100:00100000:0.0:1746065081.955465:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261549184 00000100:00100000:0.0:1746065081.955467:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261549184 00000100:00100000:2.0:1746065081.955476:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1297 00002000:00010000:0.0:1746065081.955476:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/899 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.955478:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cdf80 with x1830881261549184 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.955482:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925cdf80. 00000100:00100000:2.0:1746065081.955483:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881261549056:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:0.0:1746065081.955504:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1298 00000100:00100000:0.0:1746065081.955508:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261549184:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065081.955603:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.955603:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065081.955605:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:0.0:1746065081.955605:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x383:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:2.0:1746065081.955607:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.955607:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x383:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065081.955609:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:0.0:1746065081.955609:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x383:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:2.0:1746065081.955611:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x382:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746065081.955611:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x383:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065081.955638:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261549056:12345-192.168.202.27@tcp:10:bash.0 Request processed in 156us (351us total) trans 21474839938 rc 0/0 00000100:00100000:2.0:1746065081.955643:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1297 00002000:00010000:2.0:1746065081.955646:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/898 (0->18446744073709551615) 00002000:00100000:2.0:1746065081.955647:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cd180 with x1830881261549056 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065081.955652:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cd180. 00000100:00100000:0.0:1746065081.955870:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261549184:12345-192.168.202.27@tcp:10:bash.0 Request processed in 360us (522us total) trans 17179872662 rc 0/0 00000100:00100000:0.0:1746065081.955875:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1298 00002000:00010000:0.0:1746065081.955878:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/899 (0->18446744073709551615) 00002000:00100000:0.0:1746065081.955879:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cdf80 with x1830881261549184 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065081.955883:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925cdf80. 00000001:00080000:3.0:1746065081.956412:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975824 is committed 00000004:00080000:3.0:1746065081.956417:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1701 committed 00000004:00080000:3.0:1746065081.956433:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1691 committed 00000100:00100000:2.0:1746065081.956722:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262677760:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1746065081.956756:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1690 committed 00000004:00080000:3.0:1746065081.956759:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1700 committed 00000100:00100000:3.0:1746065081.956786:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065081.956795:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262677632:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065081.956825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.956865:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677632 00000100:00100000:3.0:1746065081.956869:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677632 00000100:00100000:3.0:1746065081.956888:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8862 00000100:00100000:3.0:1746065081.956893:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+173:3759:x1830881262677632:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1746065081.956957:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065081.956960:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065081.956962:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb atime from disk: 1746065081 -> 1746065081 00002000:00010000:3.0:1746065081.956963:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065081.956965:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x381:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065081.956988:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+174:3759:x1830881262677632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (163us total) trans 17179872663 rc 0/0 00000100:00100000:3.0:1746065081.956995:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8862 00000004:00080000:3.0:1746065081.957023:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecb800/2, rc 0, transno 17179872663 00000100:00100000:3.0:1746065081.957027:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262677632:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065081.957074:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746065081.957114:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b26050 reply state ffff880098589400 transno 4294975824 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.957127:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.957134:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.957136:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065081.957139:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065081.957143:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:2.0:1746065081.957145:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065081.957149:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1464123 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d28d expref: 289 pid: 7203 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746065081.957202:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065081.957210:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27964:x1830881261548288:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 11990us (12220us total) trans 4294975824 rc 0/0 00010000:00010000:1.0:1746065081.957215:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00000100:00100000:2.0:1746065081.957217:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4304 00010000:00010000:1.0:1746065081.957222:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.957227:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.957231:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065081.957235:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.957240:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.957248:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88008c512700) 00010000:00010000:1.0:1746065081.957249:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065081.957252:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:1.0:1746065081.957256:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464265 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:1.0:1746065081.957277:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677760 00000100:00100000:1.0:1746065081.957279:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677760 00000100:00100000:1.0:1746065081.957317:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8863 00000100:00100000:1.0:1746065081.957322:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+174:3761:x1830881262677760:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.957379:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+175:3761:x1830881262677760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 57us (304us total) trans 17179872664 rc 0/0 00000100:00100000:1.0:1746065081.957384:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8863 00000100:00100000:1.0:1746065081.957397:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262677888:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065081.957412:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065081.957421:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262677888 00000100:00100000:0.0:1746065081.957424:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262677888 00000100:00100000:0.0:1746065081.957439:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8864 00000100:00100000:0.0:1746065081.957444:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+140:3762:x1830881262677888:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1746065081.957485:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065081.957486:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:0.0:1746065081.957488:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065081.957490:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:0.0:1746065081.957491:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x380:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065081.957520:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+141:3762:x1830881262677888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 76us (106us total) trans 21474839939 rc 0/0 00000100:00100000:0.0:1746065081.957524:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8864 00000100:00100000:3.0:1746065081.957577:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262678016:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.957595:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065081.957614:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262678016 00000100:00100000:3.0:1746065081.957617:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262678016 00000100:00100000:3.0:1746065081.957630:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8865 00000100:00100000:3.0:1746065081.957633:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+141:3759:x1830881262678016:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.957692:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+142:3759:x1830881262678016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 57us (94us total) trans 21474839940 rc 0/0 00000100:00100000:3.0:1746065081.957696:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8865 00000004:00080000:3.0:1746065081.957716:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed5c00/2, rc 0, transno 21474839940 00000100:00100000:3.0:1746065081.957720:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262678016:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1746065081.957868:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec9500/2, rc 0, transno 17179872664 00000004:00080000:1.0:1746065081.957868:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aed7100/2, rc 0, transno 21474839939 00000100:00100000:2.0:1746065081.957872:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262677760:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065081.957872:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262677888:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065081.958183:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.958250:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261549440 00000100:00100000:2.0:1746065081.958253:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261549440 00000100:00100000:2.0:1746065081.958279:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4305 00000100:00100000:2.0:1746065081.958284:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+288:26180:x1830881261549440:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065081.958400:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+289:26180:x1830881261549440:12345-192.168.202.27@tcp:35:bash.0 Request processed in 115us (218us total) trans 4294975825 rc 0/0 00000100:00100000:2.0:1746065081.958406:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4305 00000100:00100000:0.0:1746065081.959451:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.959560:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261549568 00000100:00100000:3.0:1746065081.959564:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261549568 00000100:00100000:3.0:1746065081.959603:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12509 00000100:00100000:3.0:1746065081.959610:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27964:x1830881261549568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.959623:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.959637:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1464288 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d30b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.959677:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1464288 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d30b expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.959691:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091a96000/0xad6b7ddc1464288 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d30b expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.959703:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:3.0:1746065081.959706:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065081.959708:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96000, rc 0) 00000100:00100000:3.0:1746065081.959733:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27964:x1830881261549568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.959738:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12509 00000100:00100000:2.0:1746065081.962329:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.962582:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261549824 00000100:00100000:0.0:1746065081.962590:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261549824 00000100:00100000:0.0:1746065081.962684:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4306 00000100:00100000:0.0:1746065081.962691:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27964:x1830881261549824:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065081.963002:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x35a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065081.963049:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2518, 64 off208272 00000040:00080000:0.0:1746065081.963069:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2514, 64 off207832 00000040:00080000:0.0:1746065081.963078:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2515, 64 off207896 00000040:00080000:0.0:1746065081.963085:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2519, 64 off208336 00010000:00010000:0.0:1746065081.963124:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:0.0:1746065081.963137:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.963145:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.963151:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.963156:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.963161:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:0.0:1746065081.963206:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065081.963278:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065081.963283:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.963289:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ada00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065081.963291:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.963297:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.963306:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35a:0x0].0x0 (ffff88012ef2a500) 00010000:00010000:2.0:1746065081.963308:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065081.963312:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 1/0,0 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.963316:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146428f lrc: 0/0,0 mode: --/PW res: [0x240000403:0x35a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065081.963326:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.963327:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065081.963328:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065081.963759:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27964:x1830881261549824:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1066us (1434us total) trans 4294975826 rc 0/0 00000100:00100000:0.0:1746065081.963766:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4306 00000100:00100000:0.0:1746065081.964480:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.964550:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261549952 00000100:00100000:2.0:1746065081.964554:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261549952 00000100:00100000:2.0:1746065081.964716:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12510 00000100:00100000:2.0:1746065081.964722:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27967:x1830881261549952:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:2.0:1746065081.964734:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.964747:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464296 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d312 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.965060:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.965070:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965078:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965095:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.965100:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965105:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965155:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.965160:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965165:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065081.965189:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35c:0x0]: returning size 5 00000004:00200000:2.0:1746065081.965193:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065081.965202:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965208:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965214:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965221:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965226:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965230:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965234:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.965236:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965241:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965247:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:2.0:1746065081.965250:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.965252:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965256:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45a00/0xad6b7ddc146429d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965265:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965269:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965272:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965276:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.965278:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965281:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965286:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88009aa6a300) 00010000:00010000:2.0:1746065081.965288:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.965289:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965293:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc14642a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.965313:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464296 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d312 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.965324:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d312 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.965330:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:2.0:1746065081.965331:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065081.965333:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45000, rc 0) 00000100:00100000:2.0:1746065081.965363:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27967:x1830881261549952:12345-192.168.202.27@tcp:101:rm.0 Request processed in 640us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065081.965369:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12510 00000100:00100000:0.0:1746065081.967465:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.968057:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261550208 00000100:00100000:2.0:1746065081.968064:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261550208 00000100:00100000:2.0:1746065081.968139:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12511 00000100:00100000:2.0:1746065081.968146:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27967:x1830881261550208:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065081.968188:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065081.968209:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668400/0xad6b7ddc1464273 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2f6 expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.968225:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45000/0xad6b7ddc14642ab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d312 expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.968236:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0e1400/0xad6b7ddc1464250 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e1 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.968245:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7abe00) 00010000:00010000:2.0:1746065081.968252:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065081.968268:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.968276:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968284:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968293:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.968297:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968302:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968357:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.968366:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968372:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000040:00080000:2.0:1746065081.968555:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2516, 64 off207960 00000040:00080000:2.0:1746065081.968573:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2520, 64 off208400 00000040:00080000:2.0:1746065081.968582:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2521, 64 off208464 00000040:00080000:2.0:1746065081.968589:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2517, 64 off208024 00010000:00010000:2.0:1746065081.968623:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.968629:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968635:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968641:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968646:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.968651:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969269:0:7231:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065081.969284:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969291:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969299:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969304:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.969307:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969312:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969319:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7ab500) 00010000:00010000:2.0:1746065081.969322:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065081.969324:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969328:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf600/0xad6b7ddc14642c0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969416:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969422:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969426:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969430:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969433:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.969435:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969443:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969449:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88009aa6a700) 00010000:00010000:2.0:1746065081.969451:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.969453:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969457:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf200/0xad6b7ddc14642b2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065081.969466:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ed08700 reply state ffff880097df0000 transno 4294975827 ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969473:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.969477:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:2.0:1746065081.969480:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065081.969482:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065081.969752:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065081.969757:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.969763:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065081.969765:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.969769:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.969789:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35c:0x0].0x0 (ffff88012c7ab500) 00010000:00010000:0.0:1746065081.969791:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1746065081.969793:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.969796:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc14642c7 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x35c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065081.969806:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.969807:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065081.969809:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065081.969907:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27967:x1830881261550208:12345-192.168.202.27@tcp:36:rm.0 Request processed in 1760us (2446us total) trans 4294975827 rc 0/0 00000100:00100000:2.0:1746065081.969914:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12511 00000100:00100000:0.0:1746065081.971675:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.971728:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261550464 00000100:00100000:2.0:1746065081.971735:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261550464 00000100:00100000:2.0:1746065081.971770:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12512 00000100:00100000:2.0:1746065081.971793:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27968:x1830881261550464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.971810:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.971825:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc14642ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d319 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.971892:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.971901:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971908:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971916:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.971921:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971925:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971952:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971957:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971961:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971966:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971970:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.971973:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971980:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971988:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34100) 00010000:00010000:2.0:1746065081.971990:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.971992:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.971996:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14642d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972004:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972008:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972012:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972015:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.972017:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972021:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972026:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:2.0:1746065081.972027:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.972029:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972032:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc14642dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.972050:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc14642ce lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d319 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.972056:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc14642ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d319 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.972065:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:2.0:1746065081.972248:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27968:x1830881261550464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 455us (577us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.972254:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12512 00000100:00100000:0.0:1746065081.974236:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.974285:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261550592 00000100:00100000:2.0:1746065081.974290:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261550592 00000100:00100000:2.0:1746065081.974333:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12513 00000100:00100000:2.0:1746065081.974340:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27968:x1830881261550592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.974352:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.974365:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14642e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d320 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.974407:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.974416:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974424:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974431:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.974440:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974445:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974470:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974476:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974481:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974486:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974490:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.974493:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974498:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974506:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065081.974509:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.974512:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974516:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ba00/0xad6b7ddc14642ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974524:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974528:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974532:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974535:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.974547:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974551:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974557:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:2.0:1746065081.974558:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.974560:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974564:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14642f1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.974588:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14642e3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d320 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.974595:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577a200/0xad6b7ddc14642e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d320 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.974604:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:2.0:1746065081.974650:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27968:x1830881261550592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 310us (419us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.974656:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12513 00000100:00100000:0.0:1746065081.976737:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.977178:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261550720 00000100:00100000:2.0:1746065081.977185:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261550720 00000100:00100000:2.0:1746065081.977218:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12514 00000100:00100000:2.0:1746065081.977225:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27969:x1830881261550720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.977238:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.977251:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc14642f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d327 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.977297:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.977306:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977314:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977321:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.977326:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977331:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977357:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977362:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977366:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977374:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977378:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.977381:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977386:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977394:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34800) 00010000:00010000:2.0:1746065081.977397:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.977399:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977403:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc14642ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977412:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977417:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977420:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977424:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.977426:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977429:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977437:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:2.0:1746065081.977439:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.977440:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977444:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1464306 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.977463:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc14642f8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d327 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.977469:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc14642f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d327 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.977478:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:2.0:1746065081.977524:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27969:x1830881261550720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 299us (792us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.977529:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12514 00000100:00100000:0.0:1746065081.979207:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.979290:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261550848 00000100:00100000:2.0:1746065081.979697:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261550848 00000100:00100000:2.0:1746065081.979732:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12515 00000100:00100000:2.0:1746065081.979738:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27969:x1830881261550848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065081.979751:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065081.979763:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146430d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d32e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.980182:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.980197:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980205:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980212:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065081.980218:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980222:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980246:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980251:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980256:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980261:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980266:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.980269:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980274:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980282:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34300) 00010000:00010000:2.0:1746065081.980285:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.980288:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980292:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464314 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980301:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980305:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980309:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980313:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065081.980434:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980441:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980448:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:2.0:1746065081.980450:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065081.980452:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980456:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc146431b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065081.980477:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146430d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d32e expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.980488:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146430d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d32e expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065081.980498:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:2.0:1746065081.980551:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27969:x1830881261550848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 812us (1348us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065081.980557:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12515 00000100:00100000:0.0:1746065081.982420:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.982656:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261551232 00000100:00100000:3.0:1746065081.982663:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261551232 00000100:00100000:3.0:1746065081.982698:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12516 00000100:00100000:3.0:1746065081.982706:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27969:x1830881261551232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.982721:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.982736:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464322 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d33c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.982816:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1464329 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.982826:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1464329 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.982838:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1464329 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065081.982872:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065081.982876:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065081.982902:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464322 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d33c expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.982924:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1464329 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d33c expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.982930:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065081.982932:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065081.982934:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67a00, rc 0) 00000100:00100000:3.0:1746065081.982964:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27969:x1830881261551232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 259us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065081.982969:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12516 00000100:00100000:2.0:1746065081.983450:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.983506:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261551104 00000100:00100000:0.0:1746065081.983509:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261551104 00000100:00100000:0.0:1746065081.983529:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12517 00000100:00100000:0.0:1746065081.983534:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27970:x1830881261551104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065081.983550:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065081.983557:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464330 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d335 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.983593:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.983600:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983606:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983614:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065081.983618:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983623:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983648:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983653:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983658:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983663:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983667:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.983670:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983675:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983682:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:0.0:1746065081.983684:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.983687:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983691:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464337 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983702:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983706:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983710:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983713:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.983715:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983719:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983724:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:0.0:1746065081.983726:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065081.983728:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983732:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc146433e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.983748:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464330 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d335 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.983754:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464330 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d335 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.983761:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:0.0:1746065081.983811:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27970:x1830881261551104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 276us (362us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065081.983817:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12517 00000100:00100000:0.0:1746065081.986953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.987085:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261551488 00000100:00100000:3.0:1746065081.987092:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261551488 00000100:00100000:3.0:1746065081.987127:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12518 00000100:00100000:3.0:1746065081.987133:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27969:x1830881261551488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065081.987146:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.987149:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065081.987268:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc1464329 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d33c expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.987293:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a200) 00010000:00010000:3.0:1746065081.987302:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065081.987312:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464345 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d343 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.987389:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.987402:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987409:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987417:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.987422:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987425:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987689:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.987695:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987701:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065081.987708:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00010000:00010000:3.0:1746065081.987726:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987731:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987735:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987740:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987746:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.987748:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987753:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987759:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a300) 00010000:00010000:3.0:1746065081.987761:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065081.987763:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987767:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e600/0xad6b7ddc146434c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065081.987802:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ed0b100 reply state ffff88009a7d8000 transno 4294975828 ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987809:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.987814:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:3.0:1746065081.987816:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065081.987818:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065081.988728:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464345 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.988745:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.988751:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:3.0:1746065081.988754:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065081.988756:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669800, rc 0) 00000100:00100000:3.0:1746065081.988944:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27969:x1830881261551488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1809us (1995us total) trans 4294975828 rc 0/0 00000100:00100000:3.0:1746065081.988950:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12518 00000100:00100000:0.0:1746065081.991991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065081.992039:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065081.992056:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261551744 00000100:00100000:3.0:1746065081.992064:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261551744 00000100:00100000:3.0:1746065081.992155:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261552000 00000100:00100000:3.0:1746065081.992158:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261552000 00000100:00100000:1.0:1746065081.992208:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12519 00000100:00100000:1.0:1746065081.992215:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27969:x1830881261551744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.992232:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065081.992246:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1464368 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d34a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.992331:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065081.992343:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065081.992348:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 4/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.992373:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 296 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065081.992375:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12520 00000100:00100000:3.0:1746065081.992380:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:27971:x1830881261552000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065081.992383:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 296 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065081.992387:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065081.992393:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464376 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d351 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065081.992393:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262678144:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065081.992423:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065081.992429:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992437:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065081.992445:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00010000:00010000:3.0:1746065081.992552:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992558:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992563:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992568:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd80800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065081.992571:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992577:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992585:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:3.0:1746065081.992587:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065081.992589:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992593:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012fd80800/0xad6b7ddc146437d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065081.992618:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464376 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d351 expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.992624:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464376 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d351 expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065081.992632:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1d1000, rc 0) 00000100:00100000:3.0:1746065081.992652:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:27971:x1830881261552000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 271us (613us total) trans 4294975829 rc 301/301 00000100:00100000:3.0:1746065081.992658:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12520 00000100:00100000:1.0:1746065081.992838:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065081.994320:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262678144:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065081.994335:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065081.995528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065081.995598:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261552128 00000100:00100000:1.0:1746065081.995603:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261552128 00010000:00010000:1.0:1746065081.995627:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 297 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065081.995658:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3718 00000100:00100000:1.0:1746065081.995665:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+297:2005:x1830881261552128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065081.995675:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065081.995680:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 297 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065081.995689:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 297 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065081.995705:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc146435a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d343 expref: 297 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065081.995732:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:1.0:1746065081.995736:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.995816:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.995822:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065081.995916:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065081.995924:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.995929:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065081.995945:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00000100:00100000:1.0:1746065081.995977:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+296:2005:x1830881261552128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 312us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065081.995983:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3718 00000004:00080000:0.0:1746065081.996065:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x385:0x0], index 1: 0 00000004:00080000:0.0:1746065081.996070:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x384:0x0], index 0: 0 00000004:00080000:0.0:1746065081.996074:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x385:0x0], index 0: 0 00000004:00080000:0.0:1746065081.996077:0:7205:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x386:0x0], index 1: 0 00010000:00010000:0.0:1746065081.996163:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996170:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996175:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996180:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065081.996182:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996187:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996194:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff88012ef2a600) 00010000:00010000:0.0:1746065081.996196:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065081.996199:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996203:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f01400/0xad6b7ddc146436f lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065081.996232:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1464368 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d34a expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.996239:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc1464368 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d34a expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065081.996249:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa51400, rc 0) 00000100:00100000:0.0:1746065081.996282:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27969:x1830881261551744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4067us (4297us total) trans 4294975830 rc 301/301 00000100:00100000:0.0:1746065081.996288:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12519 00000100:00100000:0.0:1746065081.997764:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065081.998022:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261552384 00000100:00100000:2.0:1746065081.998028:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261552384 00000100:00100000:2.0:1746065081.998058:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4307 00000100:00100000:2.0:1746065081.998064:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27969:x1830881261552384:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065081.998552:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27969:x1830881261552384:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 486us (789us total) trans 4294975831 rc 0/0 00000100:00100000:2.0:1746065081.998558:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4307 00000100:00100000:1.0:1746065082.002656:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.002930:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261552640 00000100:00100000:2.0:1746065082.002938:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261552640 00000100:00100000:2.0:1746065082.002983:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4308 00000100:00100000:2.0:1746065082.002990:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27969:x1830881261552640:12345-192.168.202.27@tcp:35:lfs.0 00000100:00080000:0.0:1746065082.003062:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746065082.003279:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.003362:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261552768 00000100:00100000:0.0:1746065082.003366:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261552768 00000100:00100000:0.0:1746065082.003401:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12521 00000100:00100000:0.0:1746065082.003407:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27971:x1830881261552768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065082.003415:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.003430:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1464392 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d358 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.003482:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464399 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065082.003493:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464399 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.003502:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464399 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065082.003518:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00000004:00200000:0.0:1746065082.003522:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065082.003530:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464399 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.003556:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad400/0xad6b7ddc1464392 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d358 expref: 300 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.003567:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464399 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d358 expref: 299 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.003577:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:0.0:1746065082.003579:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065082.003581:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:2.0:1746065082.003869:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+299:27969:x1830881261552640:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 879us (1219us total) trans 4294975832 rc 0/0 00000100:00100000:2.0:1746065082.003878:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4308 00000100:00100000:0.0:1746065082.005186:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+298:27971:x1830881261552768:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1776us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.005194:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12521 00000100:00100000:0.0:1746065082.007724:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.007975:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261553024 00000100:00100000:2.0:1746065082.007983:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261553024 00000100:00100000:2.0:1746065082.008018:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12522 00000100:00100000:2.0:1746065082.008024:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+298:26180:x1830881261553024:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.008041:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.008056:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc14643a0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d35f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.008156:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065082.008167:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008176:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008184:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065082.008190:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008194:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008227:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14643b5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065082.008233:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14643b5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008238:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14643b5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:2.0:1746065082.008243:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00010000:00010000:2.0:1746065082.008301:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008305:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008310:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008315:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008319:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.008322:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008327:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008335:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800929fd700) 00010000:00010000:2.0:1746065082.008337:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.008340:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008344:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b000/0xad6b7ddc14643a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008352:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008356:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.008360:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.009877:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.009880:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.009886:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.009894:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:2.0:1746065082.009896:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.009899:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.009903:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14643ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.009939:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc14643a0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d35f expref: 301 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.009952:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14643b5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d35f expref: 300 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.009957:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.009959:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065082.009961:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:2.0:1746065082.011489:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261553024:12345-192.168.202.27@tcp:101:bash.0 Request processed in 3460us (3766us total) trans 4294975833 rc 0/0 00000100:00100000:2.0:1746065082.011496:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12522 00000100:00100000:1.0:1746065082.012021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.012059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.012102:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261553152 00000100:00100000:0.0:1746065082.012108:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261553152 00000100:00100000:0.0:1746065082.012146:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261553280 00000100:00100000:0.0:1746065082.012148:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261553280 00000100:00100000:0.0:1746065082.012161:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8866 00000100:00100000:0.0:1746065082.012166:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261553152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065082.012178:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.012190:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d366 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065082.012205:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065082.012217:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.012218:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.012224:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 58 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065082.012236:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 58 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065082.012242:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac800, rc 0) 00000100:00100000:0.0:1746065082.012267:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881261553152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.012273:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8866 00000100:00100000:0.0:1746065082.012282:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8867 00000100:00100000:0.0:1746065082.012286:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261553280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065082.012292:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.012302:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d36d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065082.012312:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065082.012318:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.012319:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.012323:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 73 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065082.012331:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 73 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065082.012336:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:0.0:1746065082.012349:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261553280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.012353:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8867 00000100:00080000:1.0:1746065082.012881:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065082.012884:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065082.015329:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.015961:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.016007:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261553536 00000100:00100000:2.0:1746065082.016013:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261553536 00000100:00100000:2.0:1746065082.016064:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12523 00000100:00100000:2.0:1746065082.016070:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+300:26180:x1830881261553536:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.016085:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.016097:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc14643d1 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d374 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.016121:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14643d8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065082.016131:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14643d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.016139:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14643d8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.016210:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009aa51400/0xad6b7ddc14643d1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d374 expref: 302 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.016222:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14643d8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d374 expref: 301 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.016228:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.016230:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065082.016232:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ac00, rc 0) 00000100:00100000:0.0:1746065082.016659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.017038:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261553408 00000100:00100000:1.0:1746065082.017043:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261553408 00000100:00100000:1.0:1746065082.017068:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 565 00000100:00100000:1.0:1746065082.017073:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+302:2005:x1830881261553408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.017080:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065082.017096:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc14643b5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d35f expref: 302 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.017113:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:1.0:1746065082.017116:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065082.017229:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261553792 00000100:00100000:3.0:1746065082.017233:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261553792 00000100:00100000:3.0:1746065082.017254:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4309 00000100:00100000:3.0:1746065082.017259:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+302:27971:x1830881261553792:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065082.017381:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+303:26180:x1830881261553536:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1309us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.017386:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12523 00000100:00100000:1.0:1746065082.017462:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+302:2005:x1830881261553408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 387us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.017467:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 565 00000100:00100000:3.0:1746065082.017633:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+301:27971:x1830881261553792:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 372us (1629us total) trans 4294975834 rc 0/0 00000100:00100000:3.0:1746065082.017638:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4309 00000100:00100000:0.0:1746065082.019347:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.019405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.019418:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261554304 00000100:00100000:3.0:1746065082.019422:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261554304 00000100:00100000:3.0:1746065082.019450:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261554048 00000100:00100000:3.0:1746065082.019452:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261554048 00000100:00100000:3.0:1746065082.019469:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12524 00000100:00100000:3.0:1746065082.019475:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+302:26180:x1830881261554304:12345-192.168.202.27@tcp:36:bash.0 00000100:00100000:0.0:1746065082.019493:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12525 00000100:00100000:0.0:1746065082.019499:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+302:27971:x1830881261554048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.019505:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.019506:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.019517:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14643df lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d37b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.019519:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1464399 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d358 expref: 302 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.019529:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065082.019531:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065082.019576:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14643e6 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065082.019585:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14643e6 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.019592:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14643e6 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065082.019599:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00010000:00010000:0.0:1746065082.019656:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14643df lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d37b expref: 305 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.019671:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14643e6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d37b expref: 304 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.019677:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:0.0:1746065082.019680:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065082.019681:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ada00, rc 0) 00000100:00100000:0.0:1746065082.019719:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+304:27971:x1830881261554048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 220us (313us total) trans 4294975836 rc 0/0 00000100:00100000:0.0:1746065082.019724:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12525 00010000:00010000:3.0:1746065082.020225:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065082.020232:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.020238:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000001:00080000:3.0:1746065082.020266:0:7205:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975835 00000004:00010000:3.0:1746065082.020282:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f0d0700 reply state ffff88009a58c000 transno 4294975837 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.020289:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.020298:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065082.020300:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065082.020302:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065082.020577:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261554304:12345-192.168.202.27@tcp:36:bash.0 Request processed in 1097us (1228us total) trans 4294975837 rc 0/0 00000100:00100000:3.0:1746065082.020582:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12524 00000020:00080000:3.0:1746065082.020585:0:7205:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065082.021498:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.021739:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261554432 00000100:00100000:3.0:1746065082.021747:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261554432 00000100:00100000:3.0:1746065082.021802:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12526 00000100:00100000:3.0:1746065082.021808:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+305:27971:x1830881261554432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.021822:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.021830:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc14643fb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d382 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.021872:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065082.021880:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.021885:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065082.021897:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 0 00000004:00200000:3.0:1746065082.021900:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065082.021908:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.021922:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc14643fb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 307 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.021932:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 306 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.021938:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065082.021940:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.021942:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4800, rc 0) 00000100:00100000:3.0:1746065082.021976:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+306:27971:x1830881261554432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 167us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.021981:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12526 00000100:00100000:0.0:1746065082.022145:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.022186:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261554688 00000100:00100000:2.0:1746065082.022189:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261554688 00000100:00100000:2.0:1746065082.022220:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12527 00000100:00100000:2.0:1746065082.022227:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+306:26180:x1830881261554688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.022235:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.022238:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065082.022248:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14643e6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d37b expref: 306 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.022256:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.022258:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065082.022263:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464409 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d389 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.022283:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065082.022291:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 306 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.022298:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.022320:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 306 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.022330:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 306 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.022340:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262678272:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.022397:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.023850:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262678272:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.023866:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065082.023877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.023895:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261554816 00000100:00100000:2.0:1746065082.023898:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261554816 00010000:00010000:2.0:1746065082.023913:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 307 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.023944:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3719 00000100:00100000:2.0:1746065082.023950:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+307:2005:x1830881261554816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.023958:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.023962:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 307 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.023969:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 307 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.023981:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1464402 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d382 expref: 307 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.023991:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.023994:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.024000:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.024005:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.024260:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065082.024270:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.024275:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065082.024289:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+306:2005:x1830881261554816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 339us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.024294:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3719 00000100:00100000:0.0:1746065082.024415:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000040:00080000:3.0:1746065082.024464:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2522, 88 off208552 00000004:00080000:3.0:1746065082.024471:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678042696387ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065082.024495:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2518, 88 off208112 00000004:00080000:3.0:1746065082.024499:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678042725799ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065082.024511:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2519, 88 off208200 00000004:00080000:3.0:1746065082.024514:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678042740337ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065082.024527:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2523, 88 off208640 00000004:00080000:3.0:1746065082.024530:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678042756844ns, next at 678738608678ns, rc = 0 00000100:00100000:2.0:1746065082.024563:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261554944 00000100:00100000:2.0:1746065082.024566:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261554944 00000100:00100000:2.0:1746065082.024586:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12528 00000100:00100000:2.0:1746065082.024591:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+307:27971:x1830881261554944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.024599:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.024606:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d390 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.024626:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 2/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.024633:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 4/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 308 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.024642:0:7203:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.024649:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 308 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.024657:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.024659:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065082.024661:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 308 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.024666:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:2.0:1746065082.024683:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+308:27971:x1830881261554944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 92us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.024688:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12528 00000001:00080000:3.0:1746065082.025810:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975838 is committed 00000004:00080000:3.0:1746065082.025816:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1703 committed 00000004:00080000:3.0:1746065082.025828:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1693 committed 00000004:00080000:3.0:1746065082.025831:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1692 committed 00000004:00080000:3.0:1746065082.025834:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1702 committed 00010000:00010000:3.0:1746065082.025879:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d389 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.025887:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:1.0:1746065082.025887:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.025888:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065082.025891:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.025894:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.025898:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.025899:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.025903:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.025904:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091bae600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.025907:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025912:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025920:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:1.0:1746065082.025922:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.025923:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 294 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.025925:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025930:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091bae600/0xad6b7ddc14642b9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065082.025932:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009858ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262678400:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065082.025945:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025949:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025954:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025958:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019ec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.025960:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025963:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025968:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012c7abf00) 00010000:00010000:1.0:1746065082.025970:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.025972:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065082.025976:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065082.025976:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc1464353 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.025987:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.025992:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.026000:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.026003:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.026005:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.026009:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.026014:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:1.0:1746065082.026016:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.026018:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.026021:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f67a00/0xad6b7ddc14643f4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00000100:00100000:2.0:1746065082.026093:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262678656:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.026122:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.026138:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262679168:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065082.026147:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262678784:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.026153:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.026167:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262679680:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.026171:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.026188:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262678656 00000100:00100000:2.0:1746065082.026191:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262678656 00000100:00100000:0.0:1746065082.026192:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679168 00000100:00100000:0.0:1746065082.026194:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679168 00000100:00100000:1.0:1746065082.026199:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262679296:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.026212:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262678784 00000100:00100000:2.0:1746065082.026213:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262678784 00000100:00100000:1.0:1746065082.026213:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065082.026217:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8868 00000100:00100000:0.0:1746065082.026223:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+177:3761:x1830881262678656:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.026224:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679296 00000100:00100000:2.0:1746065082.026225:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679296 00000100:00100000:1.0:1746065082.026226:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262679808:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.026237:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8869 00002000:00080000:0.0:1746065082.026237:0:10219:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:898 count 1 00000100:00100000:1.0:1746065082.026239:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.026240:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+177:3761:x1830881262679168:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065082.026255:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1746065082.026259:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679808 00010000:00010000:0.0:1746065082.026259:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.026262:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679808 00010000:00010000:0.0:1746065082.026267:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.026269:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.026272:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.026279:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8870 00010000:00010000:0.0:1746065082.026280:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.026283:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+177:3762:x1830881262678784:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1746065082.026286:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.026291:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.026296:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8871 00000100:00100000:1.0:1746065082.026299:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+143:3762:x1830881262679296:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1746065082.026302:0:10219:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1746065082.026305:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065082.026307:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x386:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.026309:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x386:0x0] updating lvb atime from disk: 0 -> 0 00002000:00080000:1.0:1746065082.026309:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:896 count 1 00002000:00010000:2.0:1746065082.026310:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x386:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.026312:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065082.026321:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.026332:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+178:3761:x1830881262679168:12345-0@lo:2:osp-syn-1-1.0 Request processed in 90us (177us total) trans 17179872665 rc 0/0 00010000:00010000:1.0:1746065082.026332:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 57 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.026338:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8869 00010000:00010000:1.0:1746065082.026338:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.026339:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.026341:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.026347:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8872 00000100:00100000:2.0:1746065082.026351:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+143:3762:x1830881262679808:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065082.026357:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 57 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.026366:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 57 pid: 10219 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.026374:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262680064:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065082.026393:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.026405:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+144:3762:x1830881262679808:12345-0@lo:2:osp-syn-0-1.0 Request processed in 54us (166us total) trans 21474839941 rc 0/0 00002000:00080000:1.0:1746065082.026405:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:899 count 1 00000100:00100000:0.0:1746065082.026405:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+178:3761:x1830881262678656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 182us (281us total) trans 17179872666 rc 0/0 00000100:00100000:2.0:1746065082.026410:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8872 00000100:00100000:0.0:1746065082.026412:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8868 00010000:00010000:1.0:1746065082.026413:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.026422:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 72 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.026424:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746065082.026429:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.026430:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.026430:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.026432:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.026434:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.026438:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd80a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065082.026441:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.026447:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.026448:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 72 pid: 9549 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746065082.026449:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acefb80/2, rc 0, transno 17179872666 00000100:00100000:2.0:1746065082.026452:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262678656:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065082.026455:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 72 pid: 9549 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746065082.026456:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746065082.026459:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c526300/2, rc 0, transno 17179872665 00000100:00100000:2.0:1746065082.026461:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262679168:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065082.026461:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146441e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.026464:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262680192:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.026472:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679680 00010000:00010000:0.0:1746065082.026473:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065082.026474:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679680 00010000:00010000:0.0:1746065082.026474:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065082.026475:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065082.026480:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.026487:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8873 00000100:00100000:2.0:1746065082.026491:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+144:3761:x1830881262679680:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1746065082.026495:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10000/2, rc 0, transno 21474839941 00000100:00100000:1.0:1746065082.026499:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262679808:0@lo:2:osp-syn-0-1.0 00002000:00080000:2.0:1746065082.026500:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:899 count 1 00000100:00080000:1.0:1746065082.026508:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746065082.026510:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:1.0:1746065082.026510:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746065082.026514:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026520:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.026521:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.026523:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026530:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026548:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026554:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026565:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065082.026642:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262678528:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.026648:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+145:3761:x1830881262679680:12345-0@lo:6:osp-syn-0-1.0 Request processed in 156us (217us total) trans 21474839942 rc 0/0 00000100:00100000:2.0:1746065082.026652:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8873 00000100:00100000:3.0:1746065082.026660:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065082.026663:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065082.026667:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.026671:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679040:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1746065082.026673:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.026675:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026681:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.026682:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.026690:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679552:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065082.026690:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026695:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1464433 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.026704:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065082.026704:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.026705:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.026707:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065082.026724:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262678528 00000100:00100000:2.0:1746065082.026727:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262678528 00000100:00100000:3.0:1746065082.026730:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746065082.026735:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262678912:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.026738:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679040 00000100:00100000:2.0:1746065082.026740:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679040 00000100:00100000:3.0:1746065082.026752:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.026752:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679552 00000100:00100000:2.0:1746065082.026754:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679552 00000100:00100000:3.0:1746065082.026759:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679424:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.026760:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262678912 00000100:00100000:2.0:1746065082.026761:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262678912 00000100:00100000:2.0:1746065082.026768:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8874 00000100:00100000:3.0:1746065082.026770:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.026786:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+180:3760:x1830881262678528:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.026793:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679936:0@lo:2:osp-syn-0-1.0 00002000:00080000:2.0:1746065082.026796:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:897 count 1 00010000:00010000:2.0:1746065082.026804:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.026806:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065082.026813:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026817:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065082.026819:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065082.026820:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.026821:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679424 00000100:00100000:3.0:1746065082.026823:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679424 00000100:00100000:3.0:1746065082.026833:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262679936 00010000:00010000:2.0:1746065082.026833:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.026834:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262679936 00000100:00100000:3.0:1746065082.026841:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8875 00010000:00010000:2.0:1746065082.026841:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.026845:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+180:3760:x1830881262679040:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.026849:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009835a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262680320:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.026876:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.026887:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8876 00000100:00100000:2.0:1746065082.026892:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+147:3760:x1830881262679552:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065082.026901:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:898 count 1 00010000:00010000:2.0:1746065082.026910:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026918:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026923:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065082.026924:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065082.026926:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026938:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.026945:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.026952:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262680448:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.026971:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00000004:00080000:2.0:1746065082.026985:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12680/2, rc 0, transno 21474839942 00000100:00100000:2.0:1746065082.026988:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262679680:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.026999:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8877 00000100:00100000:2.0:1746065082.027004:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+181:3760:x1830881262678912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065082.027012:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:900 count 1 00000100:00100000:1.0:1746065082.027021:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8878 00002000:00010000:2.0:1746065082.027022:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065082.027026:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.027027:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+147:3760:x1830881262679424:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065082.027032:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.027033:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1746065082.027035:0:9549:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:897 count 1 00010000:00010000:2.0:1746065082.027036:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.027042:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065082.027044:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065082.027047:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.027048:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.027053:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027053:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.027055:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.027057:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.027061:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1746065082.027063:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027068:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027074:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027082:0:9549:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065082.027129:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+182:3760:x1830881262678912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 125us (376us total) trans 17179872668 rc 0/0 00000100:00100000:2.0:1746065082.027134:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8877 00000100:00100000:1.0:1746065082.027141:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+148:3760:x1830881262679424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 115us (370us total) trans 21474839943 rc 0/0 00000100:00100000:2.0:1746065082.027143:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8879 00000100:00100000:1.0:1746065082.027146:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8878 00000100:00100000:2.0:1746065082.027147:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+148:3760:x1830881262679936:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065082.027156:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065082.027159:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027165:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065082.027167:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027173:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027181:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065082.027183:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x385:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065082.027184:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x385:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.027186:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x385:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1746065082.027187:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464448 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065082.027188:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x385:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.027190:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x385:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065082.027196:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065082.027198:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027203:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44400 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:2.0:1746065082.027205:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+148:3760:x1830881262679936:12345-0@lo:2:osp-syn-0-1.0 Request processed in 58us (398us total) trans 21474839944 rc 0/0 00010000:00010000:1.0:1746065082.027205:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.027210:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8879 00010000:00010000:1.0:1746065082.027211:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027217:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027222:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc146444f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.027231:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.027232:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.027233:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065082.027308:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+181:3760:x1830881262679040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 462us (624us total) trans 17179872667 rc 0/0 00000100:00100000:3.0:1746065082.027313:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8875 00000004:00080000:3.0:1746065082.027334:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c526680/2, rc 0, transno 17179872668 00000100:00100000:3.0:1746065082.027337:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262678912:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1746065082.027344:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12300/2, rc 0, transno 21474839943 00000100:00100000:3.0:1746065082.027346:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679424:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1746065082.027351:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10a80/2, rc 0, transno 21474839944 00000100:00100000:3.0:1746065082.027353:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679936:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065082.027359:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c526a00/2, rc 0, transno 17179872667 00000100:00100000:3.0:1746065082.027361:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679040:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1746065082.027426:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065082.028948:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009858ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262678400:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065082.028978:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577b600/0xad6b7ddc1464409 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d389 expref: 291 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065082.028993:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d389 expref: 290 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.029013:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:1.0:1746065082.029189:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881262680064:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065082.029202:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.029400:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261554688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 7172us (7254us total) trans 4294975838 rc 0/0 00000100:00100000:3.0:1746065082.029408:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12527 00000100:00100000:0.0:1746065082.029730:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.029752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.029765:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555072 00000100:00100000:0.0:1746065082.029769:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555072 00010000:00010000:0.0:1746065082.029798:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 58 pid: 10219 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746065082.029813:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555200 00000100:00100000:0.0:1746065082.029815:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555200 00010000:00010000:0.0:1746065082.029824:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 73 pid: 9549 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746065082.029835:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3720 00000100:00100000:0.0:1746065082.029840:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881261555072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065082.029848:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.029852:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 58 pid: 10219 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746065082.029860:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 58 pid: 10219 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746065082.029874:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baf400/0xad6b7ddc14640ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d26a expref: 58 pid: 10219 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746065082.029883:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.029885:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.029888:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.029895:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.029908:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065082.029924:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261555072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.029928:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3720 00000100:00100000:0.0:1746065082.029937:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3721 00000100:00100000:0.0:1746065082.029941:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261555200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065082.029947:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.029950:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 73 pid: 9549 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746065082.029958:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 73 pid: 9549 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746065082.029967:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.029968:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.029971:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.029977:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.029984:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065082.029993:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261555200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.029997:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3721 00000100:00100000:0.0:1746065082.030024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.030131:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262680448:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.030142:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.030157:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009835a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262680320:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.030165:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.030388:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555328 00000100:00100000:3.0:1746065082.030391:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555328 00000100:00100000:3.0:1746065082.030421:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4310 00000100:00100000:3.0:1746065082.030426:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27971:x1830881261555328:12345-192.168.202.27@tcp:49:lfs.0 00000100:00100000:3.0:1746065082.030478:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27971:x1830881261555328:12345-192.168.202.27@tcp:49:lfs.0 Request processed in 52us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.030483:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4310 00010000:00010000:1.0:1746065082.030896:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7200/0xad6b7ddc1464281 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d304 expref: 72 pid: 9549 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.030906:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262680192:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065082.030915:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.030921:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.030927:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.030935:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.030942:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.030960:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065082.031096:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+181:3762:x1830881262678784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4812us (4924us total) trans 17179872669 rc 0/0 00000100:00100000:1.0:1746065082.031103:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8870 00000004:00080000:1.0:1746065082.031129:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c527100/2, rc 0, transno 17179872669 00000100:00100000:1.0:1746065082.031133:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262678784:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1746065082.031145:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031151:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031157:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031163:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031172:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1746065082.031245:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+148:3762:x1830881262679296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4944us (5030us total) trans 21474839945 rc 0/0 00000100:00100000:1.0:1746065082.031249:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8871 00010000:00010000:1.0:1746065082.031261:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065082.031265:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031271:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065082.031274:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031281:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031291:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031297:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146442c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031308:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065082.031311:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031316:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065082.031318:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031324:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031330:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031335:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc1464425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.031344:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.031345:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.031346:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065082.031357:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e11c00/2, rc 0, transno 21474839945 00000100:00100000:1.0:1746065082.031360:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262679296:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1746065082.031555:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065082.032413:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.032438:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.032484:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.032532:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555584 00000100:00100000:3.0:1746065082.032544:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555584 00010000:00010000:3.0:1746065082.032563:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.032579:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555456 00000100:00100000:3.0:1746065082.032581:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555456 00010000:00010000:3.0:1746065082.032589:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.032601:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3722 00000100:00100000:3.0:1746065082.032606:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881261555584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065082.032614:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065082.032618:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.032625:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.032639:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6400/0xad6b7ddc146427a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2fd expref: 57 pid: 9549 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.032648:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.032650:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.032654:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032661:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032678:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065082.032701:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881261555584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.032706:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3722 00000100:00100000:3.0:1746065082.032716:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3723 00000100:00100000:3.0:1746065082.032720:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261555456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065082.032725:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065082.032728:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.032736:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.032746:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095668600/0xad6b7ddc1464242 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d2e8 expref: 72 pid: 9550 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.032752:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.032753:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.032756:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032761:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032770:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065082.032800:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261555456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.032805:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3723 00010000:00010000:3.0:1746065082.032817:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032823:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032830:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032840:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032850:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065082.032967:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+148:3760:x1830881262679552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6075us (6262us total) trans 21474839946 rc 0/0 00000100:00100000:3.0:1746065082.032973:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8876 00010000:00010000:3.0:1746065082.032986:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065082.032990:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.032996:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065082.032999:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.033005:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.033013:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.033018:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc1464441 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.033029:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.033031:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.033032:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065082.033052:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e13100/2, rc 0, transno 21474839946 00000100:00100000:3.0:1746065082.033056:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262679552:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1746065082.033106:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.033113:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.033119:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.033124:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.033133:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065082.033263:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009858c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+181:3760:x1830881262678528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6490us (6602us total) trans 17179872670 rc 0/0 00000100:00100000:2.0:1746065082.033268:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8874 00000100:00100000:2.0:1746065082.033346:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555712 00000100:00100000:2.0:1746065082.033349:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555712 00000100:00100000:2.0:1746065082.033363:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4311 00000100:00100000:2.0:1746065082.033367:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261555712:12345-192.168.202.27@tcp:49:bash.0 00000100:00100000:2.0:1746065082.033417:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:26180:x1830881261555712:12345-192.168.202.27@tcp:49:bash.0 Request processed in 49us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.033422:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4311 00010000:00010000:1.0:1746065082.033744:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065082.033749:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.033755:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065082.033758:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.033764:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.033800:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.033806:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146443a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.033816:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.033817:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.033819:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065082.034311:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acedc00/2, rc 0, transno 17179872670 00000100:00100000:3.0:1746065082.034317:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262678528:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.035768:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.036013:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555840 00000100:00100000:2.0:1746065082.036018:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555840 00000100:00100000:2.0:1746065082.036050:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8880 00000100:00100000:2.0:1746065082.036056:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261555840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.036068:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.036081:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d397 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065082.036099:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065082.036114:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.036115:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.036122:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 72 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.036133:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 72 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.036141:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2c00, rc 0) 00000100:00100000:2.0:1746065082.036172:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261555840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 116us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.036178:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8880 00000100:00100000:0.0:1746065082.036320:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.036402:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261555968 00000100:00100000:3.0:1746065082.036405:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261555968 00000100:00100000:3.0:1746065082.036424:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8881 00000100:00100000:3.0:1746065082.036428:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+72:26180:x1830881261555968:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065082.036434:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.036439:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d39e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.036452:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065082.036457:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.036458:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.036461:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 73 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.036479:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065082.036488:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746065082.036498:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262680576:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.036547:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.038379:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.038515:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262680576:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.038534:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 73 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.038557:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67a00, rc 0) 00000100:00100000:0.0:1746065082.038631:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261556224 00000100:00100000:0.0:1746065082.038635:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261556224 00000100:00100000:0.0:1746065082.038673:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4312 00000100:00100000:0.0:1746065082.038682:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+290:27971:x1830881261556224:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065082.039112:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+73:26180:x1830881261555968:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2682us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.039118:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8881 00000100:00100000:0.0:1746065082.039481:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+291:27971:x1830881261556224:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 798us (1105us total) trans 4294975839 rc 0/0 00000100:00100000:0.0:1746065082.039487:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4312 00000100:00100000:2.0:1746065082.039571:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.039808:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261556352 00000100:00100000:0.0:1746065082.039811:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261556352 00010000:00010000:0.0:1746065082.039825:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746065082.039983:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3724 00000100:00100000:0.0:1746065082.039989:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261556352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065082.039997:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.040001:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746065082.040011:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746065082.040027:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2c00/0xad6b7ddc1464456 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d397 expref: 73 pid: 3067 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746065082.040037:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.040039:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.040044:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 72 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.040051:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 72 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.040073:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 72 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065082.040082:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881262680704:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065082.040732:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.042321:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.042414:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881262680704:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065082.042429:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065082.042432:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.042576:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261556736 00000100:00100000:3.0:1746065082.042581:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261556736 00000100:00100000:3.0:1746065082.042613:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8882 00000100:00100000:3.0:1746065082.042619:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+56:26180:x1830881261556736:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065082.042632:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.042644:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3ac expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065082.042661:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065082.042675:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.042676:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.042682:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 57 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.042693:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 57 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.042700:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4800, rc 0) 00000100:00100000:1.0:1746065082.042869:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261556352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2879us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.042879:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3724 00000100:00100000:3.0:1746065082.043025:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+57:26180:x1830881261556736:12345-192.168.202.27@tcp:101:bash.0 Request processed in 405us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.043031:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8882 00000100:00100000:3.0:1746065082.043047:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261556608 00000100:00100000:3.0:1746065082.043049:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261556608 00000100:00100000:3.0:1746065082.043068:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12529 00000100:00100000:3.0:1746065082.043072:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27971:x1830881261556608:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.043083:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.043093:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc146446b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3a5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.043146:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065082.043155:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043162:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043174:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065082.043184:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043189:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043268:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464480 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065082.043275:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464480 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043281:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464480 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065082.043289:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 2 00010000:00010000:3.0:1746065082.043850:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043857:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043862:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043867:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043871:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c5c5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.043875:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043879:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043888:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b48d2100) 00010000:00010000:3.0:1746065082.043890:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.043893:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043897:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1464472 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043914:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043922:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043927:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043931:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800929fa000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.043933:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043937:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043942:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880099caf000) 00010000:00010000:3.0:1746065082.043944:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.043945:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043949:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800929fa000/0xad6b7ddc1464479 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.043974:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4200/0xad6b7ddc146446b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3a5 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.043985:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464480 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3a5 expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.043990:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065082.043991:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.043993:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66e00, rc 0) 00000100:00100000:3.0:1746065082.044626:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27971:x1830881261556608:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1550us (2190us total) trans 4294975840 rc 0/0 00000100:00100000:3.0:1746065082.044633:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12529 00000100:00100000:0.0:1746065082.044753:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.044894:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.044943:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261556864 00000100:00100000:1.0:1746065082.044948:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261556864 00000100:00100000:2.0:1746065082.044966:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261556992 00002000:00010000:1.0:1746065082.044967:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/901 (0->18446744073709551615) 00000100:00100000:2.0:1746065082.044969:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261556992 00002000:00100000:1.0:1746065082.044970:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13800 with x1830881261556864 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065082.044978:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e13800. 00002000:00010000:2.0:1746065082.044979:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/900 (0->18446744073709551615) 00002000:00100000:2.0:1746065082.044981:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11f80 with x1830881261556992 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065082.044986:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11f80. 00000100:00100000:1.0:1746065082.045001:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1299 00000100:00100000:2.0:1746065082.045004:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1300 00000100:00100000:1.0:1746065082.045007:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+72:2004:x1830881261556864:12345-192.168.202.27@tcp:10:bash.0 00000100:00100000:2.0:1746065082.045009:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261556992:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:2.0:1746065082.045097:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065082.045098:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x385:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065082.045100:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x384:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:1.0:1746065082.045100:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x385:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:2.0:1746065082.045102:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065082.045102:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x385:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.045104:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x384:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:1.0:1746065082.045104:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x385:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:2.0:1746065082.045105:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x384:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1746065082.045105:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x385:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065082.045180:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261556864:12345-192.168.202.27@tcp:10:bash.0 Request processed in 172us (426us total) trans 17179872671 rc 0/0 00000100:00100000:1.0:1746065082.045186:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1299 00002000:00010000:1.0:1746065082.045188:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/901 (0->18446744073709551615) 00002000:00100000:1.0:1746065082.045190:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13800 with x1830881261556864 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065082.045194:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e13800. 00000100:00100000:2.0:1746065082.045796:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881261556992:12345-192.168.202.27@tcp:10:bash.0 Request processed in 784us (901us total) trans 21474839947 rc 0/0 00000100:00100000:2.0:1746065082.045801:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1300 00002000:00010000:2.0:1746065082.045804:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/900 (0->18446744073709551615) 00002000:00100000:2.0:1746065082.045806:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11f80 with x1830881261556992 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065082.045810:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11f80. 00000100:00100000:0.0:1746065082.046127:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.046162:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261557248 00000100:00100000:2.0:1746065082.046166:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261557248 00000100:00100000:2.0:1746065082.046187:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4313 00000100:00100000:2.0:1746065082.046192:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27971:x1830881261557248:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065082.046320:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261557248:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 126us (193us total) trans 4294975841 rc 0/0 00000100:00100000:2.0:1746065082.046327:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4313 00000100:00100000:0.0:1746065082.047863:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.047965:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261557376 00000100:00100000:2.0:1746065082.047970:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261557376 00000100:00100000:2.0:1746065082.047992:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4314 00000100:00100000:2.0:1746065082.047997:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261557376:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:2.0:1746065082.048084:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261557376:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.048090:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4314 00000100:00100000:0.0:1746065082.056234:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.057614:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.057631:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261557632 00000100:00100000:3.0:1746065082.057639:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261557632 00000100:00100000:3.0:1746065082.057677:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12530 00000100:00100000:3.0:1746065082.057683:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261557632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.057697:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.057711:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc146448e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3b3 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.057795:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464495 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065082.057806:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464495 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.057815:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464495 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065082.057824:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x35e:0x0]: returning size 2 00010000:00010000:3.0:1746065082.057887:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc146448e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3b3 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.057969:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261557888 00000100:00100000:2.0:1746065082.057972:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261557888 00000100:00100000:2.0:1746065082.057989:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12531 00000100:00100000:2.0:1746065082.057993:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27972:x1830881261557888:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065082.058010:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1746065082.058020:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1464410 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d389 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.058035:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1464417 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d390 expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.058044:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f66e00/0xad6b7ddc1464480 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3a5 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.058052:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009577ac00/0xad6b7ddc14643d8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x35e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d374 expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.058063:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.058066:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065082.058079:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.058085:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058090:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058099:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.058103:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058107:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058158:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.058163:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058168:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:2.0:1746065082.058293:0:7203:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x35e:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1746065082.058333:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058343:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058348:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058352:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.058355:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058360:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058366:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.058368:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065082.058370:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058375:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644b1 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058383:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058387:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058392:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058396:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.058399:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.058401:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.059249:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464495 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3b3 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.059256:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:3.0:1746065082.059258:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065082.059260:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4600, rc 0) 00000100:00100000:3.0:1746065082.059955:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261557632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2268us (3722us total) trans 4294975842 rc 0/0 00000100:00100000:3.0:1746065082.059963:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12530 00010000:00010000:2.0:1746065082.060032:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.060040:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9600) 00010000:00010000:2.0:1746065082.060042:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.060045:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.060049:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644a3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:2.0:1746065082.060061:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098359500 reply state ffff880097df2000 transno 4294975843 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.060067:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.060072:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.060073:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065082.060075:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065082.060117:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:27972:x1830881261557888:12345-192.168.202.27@tcp:36:rm.0 Request processed in 2122us (2506us total) trans 4294975843 rc 0/0 00000100:00100000:2.0:1746065082.060122:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12531 00000100:00100000:0.0:1746065082.063380:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.063455:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261558144 00000100:00100000:2.0:1746065082.063463:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261558144 00000100:00100000:2.0:1746065082.063497:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4315 00000100:00100000:2.0:1746065082.063503:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261558144:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065082.063564:0:16721:0:(mdt_open.c:2285:mdt_close_handle_layouts()) ### [0x240000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464495 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3b3 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.063594:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065082.063603:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063610:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000004:00020000:2.0:1746065082.063700:0:16721:0:(lod_lov.c:1538:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000403:0x35e:0x0]: rc = -1 00010000:00010000:2.0:1746065082.063718:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063724:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063729:0:16721:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063733:0:16721:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.063736:0:16721:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063741:0:16721:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063749:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.063751:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1746065082.063754:0:16721:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063759:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc14644b8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x35e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.063766:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff8800929a3200) 00010000:00010000:2.0:1746065082.063768:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065082.063771:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464495 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3b3 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.063908:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27971:x1830881261558144:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 404us (534us total) trans 4294975844 rc -1/-1 00000100:00100000:2.0:1746065082.063915:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4315 00000100:00100000:0.0:1746065082.067094:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.067980:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.068099:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261558272 00000100:00100000:2.0:1746065082.068107:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261558272 00000100:00100000:3.0:1746065082.068132:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261558400 00000100:00100000:3.0:1746065082.068135:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261558400 00000100:00100000:2.0:1746065082.068152:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12532 00000100:00100000:2.0:1746065082.068159:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27973:x1830881261558272:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065082.068160:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12533 00000100:00100000:3.0:1746065082.068164:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+295:27971:x1830881261558400:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.068178:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.068185:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.068193:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc14644c6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3c1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.068193:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc14644bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3ba expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.068230:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc14644c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3c1 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.068239:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.068240:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552ea00/0xad6b7ddc14644c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3c1 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.068245:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068251:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.068253:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff88012f854e00) 00010000:00010000:3.0:1746065082.068255:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065082.068258:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552ea00, rc 0) 00010000:00010000:2.0:1746065082.068258:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.068263:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068267:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065082.068290:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:27971:x1830881261558400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 125us (311us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065082.068294:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065082.068295:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12533 00010000:00010000:2.0:1746065082.068299:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068303:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068308:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068312:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.068315:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068321:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068396:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065082.068398:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.068401:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068406:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14644cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068415:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068419:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068423:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068427:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.068429:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068433:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068438:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.068440:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.068442:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068446:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14644d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.068466:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc14644bf lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ba expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.068472:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc14644bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ba expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.068481:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3200, rc 0) 00000100:00100000:2.0:1746065082.068511:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+295:27973:x1830881261558272:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 353us (1425us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065082.068516:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12532 00000100:00100000:0.0:1746065082.071115:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.071888:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261558656 00000100:00100000:2.0:1746065082.071896:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261558656 00000100:00100000:2.0:1746065082.071930:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4316 00000100:00100000:2.0:1746065082.071935:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27971:x1830881261558656:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:2.0:1746065082.072117:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x35e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1746065082.072172:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2524, 64 off208704 00000040:00080000:2.0:1746065082.072194:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2520, 64 off208264 00000040:00080000:2.0:1746065082.072202:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2521, 64 off208328 00000040:00080000:2.0:1746065082.072209:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2525, 64 off208768 00010000:00010000:2.0:1746065082.072248:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 3/0,1 mode: --/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:2.0:1746065082.072258:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.072267:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.072273:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.072278:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.072282:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00000100:00100000:1.0:1746065082.072530:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065082.073194:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1746065082.073459:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065082.073464:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065082.073470:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065082.073473:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065082.073479:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065082.073488:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x35e:0x0].0x0 (ffff88012f854e00) 00010000:00010000:3.0:1746065082.073490:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746065082.073493:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 1/0,0 mode: --/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065082.073498:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14644db lrc: 0/0,0 mode: --/PW res: [0x240000403:0x35e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:3.0:1746065082.073508:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.073509:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.073511:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065082.073654:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27971:x1830881261558656:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1717us (2544us total) trans 4294975845 rc 0/0 00000100:00100000:2.0:1746065082.073661:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4316 00000100:00100000:2.0:1746065082.073684:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261558784 00000100:00100000:2.0:1746065082.073687:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261558784 00000100:00100000:2.0:1746065082.073710:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12534 00000100:00100000:2.0:1746065082.073715:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27973:x1830881261558784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.073724:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.073735:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644e2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3c8 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.073784:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.073791:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073798:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073805:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.073810:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073815:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073836:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073841:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073845:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073850:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073857:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.073860:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073864:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073870:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9600) 00010000:00010000:2.0:1746065082.073871:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.073874:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073877:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d44a00/0xad6b7ddc14644e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073884:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073888:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073893:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073896:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019ec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.073898:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073902:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073906:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.073908:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.073910:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073914:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14644f0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.073930:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644e2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3c8 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.073935:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14644e2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3c8 expref: 297 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.073944:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:2.0:1746065082.073960:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+296:27973:x1830881261558784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 245us (1432us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065082.073965:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12534 00000100:00100000:0.0:1746065082.079353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.081286:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261558912 00000100:00100000:1.0:1746065082.081297:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261558912 00000100:00100000:1.0:1746065082.081352:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12535 00000100:00100000:1.0:1746065082.081359:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27973:x1830881261558912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.081377:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.081393:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14644f7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3cf expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.081439:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc14644fe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.081450:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc14644fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.081460:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc14644fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065082.081497:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1746065082.081501:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1746065082.081523:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14644f7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3cf expref: 298 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.081548:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc14644fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3cf expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.081554:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.081556:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1746065082.081559:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f182e00, rc 0) 00000100:00100000:1.0:1746065082.081604:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:27973:x1830881261558912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 245us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.081609:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12535 00000100:00100000:2.0:1746065082.087004:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.089868:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261559040 00000100:00100000:3.0:1746065082.089883:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261559040 00000100:00100000:3.0:1746065082.089943:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12536 00000100:00100000:3.0:1746065082.089951:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27973:x1830881261559040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.089971:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.089991:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e000/0xad6b7ddc1464505 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3d6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.090053:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.090064:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090073:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090080:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.090086:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090089:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090119:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090124:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090128:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090132:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090137:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552e400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.090140:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090145:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090153:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.090156:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.090159:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090163:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e400/0xad6b7ddc146450c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090188:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090193:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090197:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090201:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.090203:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090207:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090212:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:3.0:1746065082.090213:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.090215:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090219:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e600/0xad6b7ddc1464513 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.090239:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e000/0xad6b7ddc1464505 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3d6 expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.090245:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552e000/0xad6b7ddc1464505 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3d6 expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.090252:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e000, rc 0) 00000100:00100000:3.0:1746065082.090314:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27973:x1830881261559040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 363us (3317us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065082.090320:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12536 00000100:00100000:0.0:1746065082.092666:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.094012:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261559296 00000100:00100000:3.0:1746065082.094020:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261559296 00000100:00100000:3.0:1746065082.094066:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12537 00000100:00100000:3.0:1746065082.094073:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+297:27973:x1830881261559296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.094088:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.094091:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065082.094110:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f182e00/0xad6b7ddc14644fe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3cf expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.094125:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.094134:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065082.094142:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146451a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3dd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.094214:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.094223:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094230:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094238:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.094243:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094248:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094485:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.094491:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094496:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.094503:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00010000:00010000:3.0:1746065082.094519:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094524:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094529:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094534:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094548:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552f600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.094551:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094556:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094562:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065082.094564:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.094566:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094574:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552f600/0xad6b7ddc1464521 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065082.094585:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011dad7b80 reply state ffff88012b05a000 transno 4294975846 ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094591:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.094596:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:3.0:1746065082.094598:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065082.094600:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065082.094616:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009552fa00/0xad6b7ddc146451a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.094627:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 298 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.094632:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854800) 00010000:00010000:3.0:1746065082.094634:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.094635:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04a000, rc 0) 00000100:00100000:3.0:1746065082.096085:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27973:x1830881261559296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2008us (3420us total) trans 4294975846 rc 0/0 00000100:00100000:3.0:1746065082.096094:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12537 00000100:00100000:2.0:1746065082.098497:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.098549:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.098575:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261559552 00000100:00100000:3.0:1746065082.098583:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261559552 00000100:00100000:0.0:1746065082.098590:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261559808 00000100:00100000:0.0:1746065082.098594:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261559808 00000100:00100000:3.0:1746065082.098618:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12538 00000100:00100000:0.0:1746065082.098623:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12539 00000100:00100000:3.0:1746065082.098625:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+300:27973:x1830881261559552:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065082.098628:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+300:27974:x1830881261559808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.098646:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.098659:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc146453d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3e4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.098727:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.098738:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.098744:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.098767:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.098807:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 301 pid: 7203 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.098817:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262680832:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.098888:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065082.098899:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.098904:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146454b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3eb expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.099337:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065082.099346:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099354:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:3.0:1746065082.099365:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00010000:00010000:3.0:1746065082.099416:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099421:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099426:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099430:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131055600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.099433:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099439:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099448:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854800) 00010000:00010000:3.0:1746065082.099450:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065082.099453:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099459:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131055600/0xad6b7ddc1464552 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:3.0:1746065082.099486:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146454b lrc: 1/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3eb expref: 303 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.099493:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f0ba200/0xad6b7ddc146454b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3eb expref: 303 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.099499:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0ba200, rc 0) 00000100:00100000:3.0:1746065082.100121:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+302:27974:x1830881261559808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 903us (983us total) trans 4294975847 rc 301/301 00000100:00100000:3.0:1746065082.100128:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12539 00000100:00100000:0.0:1746065082.101573:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.101645:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261559936 00000100:00100000:1.0:1746065082.101651:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261559936 00010000:00010000:1.0:1746065082.101677:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 302 pid: 7203 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.101699:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3725 00000100:00100000:1.0:1746065082.101705:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+302:2004:x1830881261559936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.101716:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065082.101720:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 302 pid: 7203 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.101732:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 302 pid: 7203 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.101746:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854800) 00010000:00010000:1.0:1746065082.101750:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.101756:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.101761:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.101792:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065082.101821:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+302:2004:x1830881261559936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.101826:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3725 00010000:00010000:3.0:1746065082.102022:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f04a000/0xad6b7ddc146452f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3dd expref: 301 pid: 7203 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.102034:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262680832:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.102048:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102054:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102057:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.102073:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00000004:00080000:3.0:1746065082.102192:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x386:0x0], index 0: 0 00000004:00080000:3.0:1746065082.102197:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x387:0x0], index 1: 0 00000004:00080000:3.0:1746065082.102200:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x388:0x0], index 1: 0 00000004:00080000:3.0:1746065082.102204:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x387:0x0], index 0: 0 00010000:00010000:3.0:1746065082.102267:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102274:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102279:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102284:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.102288:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102294:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102301:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854800) 00010000:00010000:3.0:1746065082.102304:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065082.102306:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102311:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc1464544 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.102342:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc146453d lrc: 1/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3e4 expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.102349:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc146453d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3e4 expref: 301 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.102360:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8a00, rc 0) 00000100:00100000:3.0:1746065082.102395:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+300:27973:x1830881261559552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3770us (3903us total) trans 4294975848 rc 301/301 00000100:00100000:3.0:1746065082.102400:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12538 00000100:00100000:0.0:1746065082.105089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.105167:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261560192 00000100:00100000:2.0:1746065082.105174:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261560192 00000100:00100000:2.0:1746065082.105212:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4317 00000100:00100000:2.0:1746065082.105218:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+300:27973:x1830881261560192:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065082.105401:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+301:27973:x1830881261560192:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 183us (319us total) trans 4294975849 rc 0/0 00000100:00100000:2.0:1746065082.105407:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4317 00000100:00100000:0.0:1746065082.107133:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.107312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.107362:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261560576 00000100:00100000:2.0:1746065082.107362:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261560448 00000100:00100000:3.0:1746065082.107367:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261560576 00000100:00100000:2.0:1746065082.107367:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261560448 00000100:00100000:2.0:1746065082.107398:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4318 00000100:00100000:3.0:1746065082.107402:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12540 00000100:00100000:2.0:1746065082.107404:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+302:27973:x1830881261560448:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065082.107408:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:27974:x1830881261560576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.107438:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.107453:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc1464567 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3f2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.107502:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc146456e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.107511:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc146456e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.107520:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc146456e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065082.107523:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+304:27973:x1830881261560448:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 118us (393us total) trans 4294975850 rc 0/0 00000100:00100000:2.0:1746065082.107529:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4318 00000004:00200000:3.0:1746065082.107550:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00000004:00200000:3.0:1746065082.107554:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065082.107564:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc146456e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.107581:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc1464567 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f2 expref: 304 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.107609:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc146456e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f2 expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.107615:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065082.107618:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.107620:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8e00, rc 0) 00000100:00100000:3.0:1746065082.107652:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+303:27974:x1830881261560576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 244us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.107657:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12540 00000100:00100000:0.0:1746065082.114965:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.115040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.115352:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261560960 00000100:00100000:3.0:1746065082.115359:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261560960 00000100:00100000:3.0:1746065082.115408:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12541 00000100:00100000:3.0:1746065082.115416:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+303:26180:x1830881261560960:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065082.115438:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.115454:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1464575 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d400 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.115556:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.115567:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115576:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115584:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.115589:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115594:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115629:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146458a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.115635:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146458a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115641:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146458a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.115648:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00010000:00010000:3.0:1746065082.115704:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115712:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115716:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115721:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115725:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.115727:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115733:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115741:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854d00) 00010000:00010000:3.0:1746065082.115744:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.115747:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115752:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146457c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115760:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115764:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115768:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115803:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.115806:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.115810:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00000100:00100000:1.0:1746065082.115891:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261560704 00000100:00100000:1.0:1746065082.115895:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261560704 00000100:00100000:1.0:1746065082.115933:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8883 00000100:00100000:1.0:1746065082.115938:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+58:2007:x1830881261560704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.115946:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.115956:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d3f9 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065082.115971:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065082.115981:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.115983:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.115990:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 59 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.116001:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 59 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.116009:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:1.0:1746065082.116048:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+59:2007:x1830881261560704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 110us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.116053:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8883 00010000:00010000:3.0:1746065082.117180:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:3.0:1746065082.117183:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.117186:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.117192:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464583 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.117226:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be400/0xad6b7ddc1464575 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d400 expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.117242:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146458a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d400 expref: 305 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.117248:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065082.117250:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.117252:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfe00, rc 0) 00000100:00100000:3.0:1746065082.117287:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261560960:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1872us (2246us total) trans 4294975851 rc 0/0 00000100:00100000:3.0:1746065082.117293:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12541 00000100:00100000:0.0:1746065082.118284:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.118393:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261561216 00000100:00100000:2.0:1746065082.118399:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261561216 00000100:00100000:2.0:1746065082.118425:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4319 00000100:00100000:2.0:1746065082.118430:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+305:27974:x1830881261561216:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065082.118570:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+306:27974:x1830881261561216:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 139us (289us total) trans 4294975852 rc 0/0 00000100:00100000:2.0:1746065082.118576:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4319 00000100:00100000:0.0:1746065082.120322:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.120361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.120759:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261561472 00000100:00100000:1.0:1746065082.120765:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261561472 00000100:00100000:1.0:1746065082.120836:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 566 00000100:00100000:1.0:1746065082.120842:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+306:2006:x1830881261561472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.120851:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065082.120875:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146458a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d400 expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.120902:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065082.120906:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065082.120934:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+305:2006:x1830881261561472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.120940:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 566 00000100:00100000:3.0:1746065082.121002:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261561344 00000100:00100000:3.0:1746065082.121006:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261561344 00000100:00100000:3.0:1746065082.121035:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12542 00000100:00100000:3.0:1746065082.121040:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+305:26180:x1830881261561344:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065082.121057:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.121066:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146459f lrc: 2/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d407 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.121088:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14645a6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.121096:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14645a6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.121103:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14645a6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.121172:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146459f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d407 expref: 307 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.121183:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14645a6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d407 expref: 306 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.121189:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065082.121191:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065082.121193:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8a00, rc 0) 00000100:00100000:3.0:1746065082.121213:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+306:26180:x1830881261561344:12345-192.168.202.27@tcp:101:bash.0 Request processed in 173us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.121218:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12542 00000100:00100000:0.0:1746065082.122238:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.122279:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261561728 00000100:00100000:3.0:1746065082.122284:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261561728 00000100:00100000:3.0:1746065082.122314:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12543 00000100:00100000:3.0:1746065082.122320:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+306:27974:x1830881261561728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.122332:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.122340:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc14645ad lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d40e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.122391:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14645b4 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.122398:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14645b4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.122404:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14645b4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.122412:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00010000:00010000:3.0:1746065082.122472:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc14645ad lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d40e expref: 309 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.122483:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14645b4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d40e expref: 308 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.122488:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:3.0:1746065082.122490:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065082.122492:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112800, rc 0) 00000100:00100000:3.0:1746065082.122523:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+308:27974:x1830881261561728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 204us (287us total) trans 4294975853 rc 0/0 00000100:00100000:3.0:1746065082.122527:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12543 00000100:00100000:1.0:1746065082.125300:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.125548:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261561984 00000100:00100000:0.0:1746065082.125555:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261561984 00000100:00100000:0.0:1746065082.125602:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12544 00000100:00100000:0.0:1746065082.125608:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+308:26180:x1830881261561984:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:0.0:1746065082.125647:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.125666:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc146456e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f2 expref: 308 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.125691:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065082.125695:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065082.125831:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065082.125841:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.125848:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000001:00080000:0.0:1746065082.125877:0:7204:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975854 00000004:00010000:0.0:1746065082.125892:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012dc3f480 reply state ffff88009ae65000 transno 4294975855 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.125899:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.125905:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065082.125907:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065082.125909:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065082.125971:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+310:26180:x1830881261561984:12345-192.168.202.27@tcp:36:bash.0 Request processed in 363us (677us total) trans 4294975855 rc 0/0 00000100:00100000:0.0:1746065082.125977:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12544 00000020:00080000:0.0:1746065082.125980:0:7204:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746065082.126048:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.126253:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261562112 00000100:00100000:0.0:1746065082.126256:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261562112 00000100:00100000:0.0:1746065082.126283:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12545 00000100:00100000:0.0:1746065082.126289:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+310:27974:x1830881261562112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065082.126300:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.126307:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14645c9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d415 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.126349:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065082.126356:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.126361:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:0.0:1746065082.126374:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 0 00000004:00200000:0.0:1746065082.126377:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065082.126384:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.126399:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc14645c9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 312 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.126409:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 311 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.126649:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065082.126652:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065082.126654:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019ec00, rc 0) 00000100:00100000:0.0:1746065082.126817:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+311:27974:x1830881261562112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 527us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.126823:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12545 00000100:00100000:0.0:1746065082.128602:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.128641:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261562368 00000100:00100000:2.0:1746065082.128646:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261562368 00000100:00100000:2.0:1746065082.128679:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12546 00000100:00100000:2.0:1746065082.128685:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+311:26180:x1830881261562368:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.128700:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.128703:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065082.128718:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130112800/0xad6b7ddc14645b4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d40e expref: 311 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.128737:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065082.128740:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065082.128746:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc14645d7 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d41c expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.128791:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065082.128800:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 311 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.128806:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 4/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.128827:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 311 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.128836:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 311 pid: 7204 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.128846:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262680960:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.128909:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065082.129570:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.129729:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261562624 00000100:00100000:0.0:1746065082.129733:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261562624 00000100:00100000:0.0:1746065082.129756:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4320 00000100:00100000:0.0:1746065082.129761:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+312:27974:x1830881261562624:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065082.129899:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+313:27974:x1830881261562624:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 137us (329us total) trans 4294975856 rc 0/0 00000100:00100000:0.0:1746065082.129905:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4320 00000100:00100000:0.0:1746065082.131287:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262680960:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065082.131304:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065082.131838:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.131909:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261562752 00000100:00100000:2.0:1746065082.131913:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261562752 00010000:00010000:2.0:1746065082.131936:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 313 pid: 7204 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.131964:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3726 00000100:00100000:2.0:1746065082.131970:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+313:2005:x1830881261562752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.131980:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.131985:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 313 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.131993:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 313 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.132012:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019ec00/0xad6b7ddc14645d0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d415 expref: 313 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.132022:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065082.132026:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.132172:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.132177:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00000100:00100000:0.0:1746065082.132223:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065082.132294:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065082.132322:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+312:2005:x1830881261562752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 352us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.132327:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3726 00010000:00010000:1.0:1746065082.132404:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.132410:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000040:00080000:1.0:1746065082.132676:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2522, 88 off208416 00000004:00080000:1.0:1746065082.132681:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678150907496ns, next at 678738623360ns, rc = 0 00000040:00080000:1.0:1746065082.132711:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2526, 88 off208856 00000004:00080000:1.0:1746065082.132857:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678151083309ns, next at 678738608678ns, rc = 0 00000100:00100000:3.0:1746065082.132927:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563008 00000100:00100000:3.0:1746065082.132931:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563008 00000100:00100000:3.0:1746065082.133125:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12547 00000100:00100000:3.0:1746065082.133132:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+312:27974:x1830881261563008:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.133144:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.133156:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14645e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d423 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.133220:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.133227:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.133234:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.133241:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.133246:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00000040:00080000:1.0:1746065082.133246:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2527, 88 off208944 00010000:00010000:3.0:1746065082.133250:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00080000:1.0:1746065082.133251:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678151477054ns, next at 678738608678ns, rc = 0 00000040:00080000:1.0:1746065082.133262:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2523, 88 off208504 00000004:00080000:1.0:1746065082.133265:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678151491446ns, next at 678738623360ns, rc = 0 00010000:00010000:3.0:1746065082.133304:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.133312:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.133317:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.133594:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 2 00010000:00010000:0.0:1746065082.134423:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134431:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134436:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134440:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065082.134443:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134448:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134456:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065082.134458:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065082.134461:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 2/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134465:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cd2800/0xad6b7ddc14645fa lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134475:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134479:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134483:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134487:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134490:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065082.134492:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134498:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134503:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012f854800) 00010000:00010000:0.0:1746065082.134505:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065082.134507:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134511:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8e00/0xad6b7ddc14645ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134518:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134522:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134526:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134530:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065082.134532:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134547:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134553:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:0.0:1746065082.134555:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065082.134557:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134561:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d9400/0xad6b7ddc14645f3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.134587:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14645e5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d423 expref: 315 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.134594:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099d47600/0xad6b7ddc14645e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d423 expref: 315 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.134605:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47600, rc 0) 00000100:00100000:0.0:1746065082.134648:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+314:27974:x1830881261563008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1516us (2425us total) trans 4294975858 rc 301/301 00000100:00100000:0.0:1746065082.134654:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12547 00000001:00080000:3.0:1746065082.137480:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975857 is committed 00000004:00080000:3.0:1746065082.137488:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1695 committed 00010000:00010000:2.0:1746065082.137704:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137714:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137720:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137725:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.137728:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137733:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137747:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.137749:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.137753:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137757:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc14644aa lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137771:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137791:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137795:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137798:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c5c4600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.137800:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137804:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137810:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.137812:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.137813:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137817:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1464528 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.137831:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.137836:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.137840:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.137843:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.137845:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.137849:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.137854:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065082.137856:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.137858:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.137862:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac600/0xad6b7ddc14645c2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00080000:3.0:1746065082.137996:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1705 committed 00000004:00080000:3.0:1746065082.138003:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1704 committed 00000004:00080000:3.0:1746065082.138004:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1694 committed 00000100:00100000:1.0:1746065082.138346:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262681344:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.138395:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065082.138428:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065082.138433:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262681216:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.138447:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.138492:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d41c expref: 292 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.138500:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065082.138502:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065082.138512:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3200/0xad6b7ddc14645d7 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d41c expref: 292 pid: 7204 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746065082.138522:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262681088:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065082.138523:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d41c expref: 291 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.138553:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.138556:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065082.138558:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065082.138560:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:3.0:1746065082.138568:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065082.138571:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262681472:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065082.138583:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065082.138603:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+291:26180:x1830881261562368:12345-192.168.202.27@tcp:101:bash.0 Request processed in 9917us (10003us total) trans 4294975857 rc 0/0 00000100:00100000:3.0:1746065082.138609:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262681344 00000100:00100000:1.0:1746065082.138610:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12546 00000100:00100000:3.0:1746065082.138614:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262681344 00000100:00100000:1.0:1746065082.138631:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262681216 00000100:00100000:1.0:1746065082.138634:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262681216 00000100:00100000:3.0:1746065082.138636:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262681088 00000100:00100000:3.0:1746065082.138638:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262681088 00000100:00100000:1.0:1746065082.138648:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262681472 00000100:00100000:1.0:1746065082.138650:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262681472 00000100:00100000:3.0:1746065082.138651:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8884 00000100:00100000:3.0:1746065082.138655:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+151:3762:x1830881262681344:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.138661:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8885 00000100:00100000:1.0:1746065082.138665:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+151:3762:x1830881262681216:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065082.138677:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:901 count 1 00010000:00010000:1.0:1746065082.138690:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.138702:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 58 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.138708:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.138710:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.138712:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.138730:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 58 pid: 9549 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065082.138739:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065082.138741:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.138743:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1746065082.138743:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 58 pid: 9549 timeout: 778 lvb_type: 1 00002000:00010000:3.0:1746065082.138745:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.138747:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065082.138751:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262681600:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065082.138796:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e240 going to sleep for 11 seconds 00000004:00080000:1.0:1746065082.138818:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9f80/2, rc 0, transno 21474839948 00000100:00100000:1.0:1746065082.138822:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262681344:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.138870:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8886 00000100:00100000:2.0:1746065082.138876:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262681088:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1746065082.138886:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:900 count 1 00010000:00010000:2.0:1746065082.138895:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.138905:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 58 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.138911:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065082.138913:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065082.138915:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.138929:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 58 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.138936:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 58 pid: 12258 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.138944:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262681728:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065082.139038:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8887 00000100:00100000:0.0:1746065082.139045:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262681472:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065082.139411:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+153:3762:x1830881262681344:12345-0@lo:2:osp-syn-0-1.0 Request processed in 755us (1016us total) trans 21474839948 rc 0/0 00000100:00100000:3.0:1746065082.139416:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8884 00000100:00100000:2.0:1746065082.139461:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.139514:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262681984:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.139532:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.139555:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065082.139559:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262682112:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.139571:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.139583:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262681984 00000100:00100000:2.0:1746065082.139585:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262681984 00000100:00100000:2.0:1746065082.139598:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262682112 00000100:00100000:2.0:1746065082.139599:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262682112 00000100:00100000:2.0:1746065082.139608:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8888 00000100:00100000:2.0:1746065082.139611:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+182:3761:x1830881262681984:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1746065082.139621:0:9550:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:902 count 1 00010000:00010000:2.0:1746065082.139634:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.139644:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 72 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.139650:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.139651:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.139654:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.139667:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 72 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.139674:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 72 pid: 9549 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746065082.139682:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c524e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262682368:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.139698:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.139708:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8889 00000100:00100000:2.0:1746065082.139712:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+182:3761:x1830881262682112:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.139790:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+183:3761:x1830881262682112:12345-0@lo:2:osp-syn-1-1.0 Request processed in 61us (201us total) trans 17179872672 rc 0/0 00000100:00100000:2.0:1746065082.139795:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8889 00000004:00080000:2.0:1746065082.139813:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c525500/2, rc 0, transno 17179872672 00000100:00100000:2.0:1746065082.139817:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262682112:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.139880:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262682240:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.139898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.139909:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065082.139912:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262681856:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.139923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.139937:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262682240 00000100:00100000:3.0:1746065082.139940:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262682240 00000100:00100000:3.0:1746065082.139951:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262681856 00000100:00100000:3.0:1746065082.139952:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262681856 00000100:00100000:3.0:1746065082.139961:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8890 00000100:00100000:3.0:1746065082.139964:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+184:3759:x1830881262682240:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.140012:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+185:3759:x1830881262682240:12345-0@lo:2:osp-syn-1-1.0 Request processed in 47us (113us total) trans 17179872673 rc 0/0 00000100:00100000:3.0:1746065082.140017:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8890 00000100:00100000:3.0:1746065082.140024:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8891 00000100:00100000:3.0:1746065082.140028:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+184:3759:x1830881262681856:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1746065082.140035:0:3067:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:901 count 1 00010000:00010000:3.0:1746065082.140042:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.140051:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 72 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.140057:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065082.140058:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065082.140060:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.140072:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 72 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.140079:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 72 pid: 12258 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.140091:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262682496:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.140111:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00000004:00080000:3.0:1746065082.140126:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c527480/2, rc 0, transno 17179872673 00000100:00100000:3.0:1746065082.140129:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262682240:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.140198:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262681472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1154us (1613us total) trans 21474839949 rc 0/0 00000100:00100000:0.0:1746065082.140203:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8887 00000100:00100000:1.0:1746065082.140225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.140245:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563264 00000100:00100000:0.0:1746065082.140247:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563264 00000100:00100000:0.0:1746065082.140262:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4321 00000100:00100000:0.0:1746065082.140266:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27974:x1830881261563264:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065082.140350:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27974:x1830881261563264:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 82us (125us total) trans 4294975859 rc 0/0 00000100:00100000:0.0:1746065082.140355:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4321 00000004:00080000:3.0:1746065082.140503:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da680/2, rc 0, transno 21474839949 00000100:00100000:3.0:1746065082.140507:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262681472:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1746065082.143924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.144128:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563392 00000100:00100000:2.0:1746065082.144135:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563392 00000100:00100000:2.0:1746065082.144170:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8892 00000100:00100000:2.0:1746065082.144176:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+59:26180:x1830881261563392:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.144192:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.144207:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d42a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.144230:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 60 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.144236:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.144238:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.144240:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 60 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.144263:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 60 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.144273:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 60 pid: 11461 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746065082.144283:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262682624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.144354:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065082.146336:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.146409:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.146417:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881262681600:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065082.146428:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563648 00000100:00100000:0.0:1746065082.146432:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563648 00010000:00010000:1.0:1746065082.146433:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065082.146459:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4322 00000100:00100000:0.0:1746065082.146464:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27974:x1830881261563648:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:3.0:1746065082.146506:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563520 00000100:00100000:3.0:1746065082.146509:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563520 00010000:00010000:3.0:1746065082.146525:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 61 pid: 12258 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.146560:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3727 00000100:00100000:3.0:1746065082.146565:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+61:2004:x1830881261563520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065082.146574:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065082.146578:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 61 pid: 12258 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.146619:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c524e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881262682368:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.146632:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.146651:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262681728:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.146660:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.146675:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c527800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881262682624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.146685:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 61 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.146694:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019ec00, rc 0) 00000100:00100000:2.0:1746065082.146725:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+61:26180:x1830881261563392:12345-192.168.202.27@tcp:101:bash.0 Request processed in 2549us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.146730:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8892 00010000:00010000:3.0:1746065082.147103:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 60 pid: 12258 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.147120:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc1464464 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3ac expref: 60 pid: 12258 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.147132:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.147134:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.147138:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.147146:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.147160:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065082.147190:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881261563520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 625us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.147196:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3727 00000100:00100000:3.0:1746065082.147220:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262682496:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.147230:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065082.147405:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27974:x1830881261563648:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 941us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.147410:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4322 00010000:00010000:2.0:1746065082.148305:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.148313:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.148321:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.148327:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.148353:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1746065082.148548:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+152:3760:x1830881262681088:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9672us (9993us total) trans 21474839950 rc 0/0 00000100:00100000:2.0:1746065082.148555:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8886 00010000:00010000:3.0:1746065082.148715:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065082.148720:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.148727:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065082.148730:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.148737:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.148748:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.148757:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146460f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.148796:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.148797:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.148798:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065082.148823:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957db100/2, rc 0, transno 21474839950 00000100:00100000:3.0:1746065082.148828:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262681088:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.149807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.150080:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.150107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.150137:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.150273:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563776 00000100:00100000:1.0:1746065082.150279:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563776 00000100:00100000:0.0:1746065082.150293:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261563904 00010000:00010000:1.0:1746065082.150303:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 59 pid: 9549 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746065082.150322:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261564032 00000100:00100000:1.0:1746065082.150323:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261564032 00010000:00010000:1.0:1746065082.150331:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 73 pid: 12258 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.150340:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261564160 00000100:00100000:1.0:1746065082.150341:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261564160 00010000:00010000:1.0:1746065082.150347:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 60 pid: 11461 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746065082.150356:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3728 00000100:00100000:1.0:1746065082.150361:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+60:2005:x1830881261563776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065082.150370:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3729 00010000:00010000:1.0:1746065082.150370:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065082.150374:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 60 pid: 9549 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746065082.150377:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261564032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.150382:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 60 pid: 9549 timeout: 778 lvb_type: 1 00010000:00010000:3.0:1746065082.150385:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065082.150389:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 73 pid: 12258 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.150397:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14643c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d366 expref: 60 pid: 9549 timeout: 778 lvb_type: 1 00010000:00010000:3.0:1746065082.150398:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 73 pid: 12258 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.150409:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.150410:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67a00/0xad6b7ddc146445d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d39e expref: 73 pid: 12258 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.150410:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.150414:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150419:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.150420:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.150420:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150423:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150429:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.150435:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065082.150442:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065082.150463:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261563904 00000100:00100000:1.0:1746065082.150464:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881261563776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.150469:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3728 00010000:00010000:0.0:1746065082.150476:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 73 pid: 9549 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746065082.150479:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3730 00000100:00100000:1.0:1746065082.150483:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881261564160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.150488:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065082.150488:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3731 00010000:00010000:1.0:1746065082.150491:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 58 pid: 11461 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746065082.150492:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261563904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.150497:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 58 pid: 11461 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746065082.150497:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.150500:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 73 pid: 9549 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746065082.150505:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464598 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d3f9 expref: 58 pid: 11461 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746065082.150508:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 73 pid: 9549 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746065082.150512:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.150513:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.150517:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 57 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.150518:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14643ca lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d36d expref: 73 pid: 9549 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746065082.150523:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 57 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.150526:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.150527:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.150530:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.150545:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.150549:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 57 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.150557:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065082.150558:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881262682752:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065082.150587:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.150594:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.150602:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.150607:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.150619:0:9550:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065082.150765:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+72:2005:x1830881261564032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 388us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.150771:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3729 00010000:00010000:3.0:1746065082.150803:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150810:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150815:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150821:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.150829:0:3067:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1746065082.150934:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+71:2004:x1830881261563904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 440us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.150940:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3731 00000100:00100000:1.0:1746065082.151502:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.151506:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+186:3761:x1830881262681984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11893us (11972us total) trans 17179872674 rc 0/0 00000100:00100000:2.0:1746065082.151514:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8888 00010000:00010000:1.0:1746065082.151518:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151527:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1746065082.151528:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151532:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.151543:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151549:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130112800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065082.151550:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151553:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.151560:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1746065082.151561:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151572:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151578:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc1464616 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151591:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1746065082.151593:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151599:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.151602:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151607:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151613:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151618:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146461d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151626:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065082.151629:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151636:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.151638:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151643:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151650:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151655:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8600/0xad6b7ddc1464608 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.151664:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.151665:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.151666:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065082.151675:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+152:3762:x1830881262681216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13008us (13226us total) trans 21474839951 rc 0/0 00000100:00100000:1.0:1746065082.151682:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8885 00000004:00080000:2.0:1746065082.151696:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c525f80/2, rc 0, transno 17179872674 00010000:00010000:1.0:1746065082.151696:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065082.151702:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262681984:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1746065082.151715:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957dbb80/2, rc 0, transno 21474839951 00000100:00100000:1.0:1746065082.151721:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262681216:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1746065082.151761:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+185:3759:x1830881262681856:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11732us (11836us total) trans 17179872675 rc 0/0 00000100:00100000:3.0:1746065082.151767:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8891 00000004:00080000:3.0:1746065082.151809:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aceed80/2, rc 0, transno 17179872675 00000100:00100000:3.0:1746065082.151812:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262681856:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065082.151822:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065082.157654:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881262682752:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065082.157672:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065082.157715:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881261564160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7230us (7576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.157724:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3730 00000100:00100000:1.0:1746065082.160643:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.160839:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261564288 00000100:00100000:3.0:1746065082.160847:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261564288 00000100:00100000:3.0:1746065082.160881:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8893 00000100:00100000:3.0:1746065082.160888:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+71:26180:x1830881261564288:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:3.0:1746065082.160902:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.160916:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d431 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065082.160933:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065082.160948:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.160950:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.160956:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 72 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.160968:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 72 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.160976:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3200, rc 0) 00000100:00100000:3.0:1746065082.161007:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+72:26180:x1830881261564288:12345-192.168.202.27@tcp:101:bash.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.161013:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8893 00000100:00100000:0.0:1746065082.161184:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.161474:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261564544 00000100:00100000:1.0:1746065082.161479:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261564544 00000100:00100000:1.0:1746065082.161507:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12548 00000100:00100000:1.0:1746065082.161513:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+292:27975:x1830881261564544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.161521:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.161531:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464632 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d438 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.161598:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.161607:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161615:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161625:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.161630:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161635:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161816:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc1464647 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.161823:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc1464647 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161830:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc1464647 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065082.161837:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 2 00010000:00010000:1.0:1746065082.161894:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161900:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161906:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161911:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161916:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.161919:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161925:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161934:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973700) 00010000:00010000:1.0:1746065082.161936:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.161939:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161944:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab2c400/0xad6b7ddc1464639 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161965:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161970:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161974:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161979:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.161981:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161985:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.161991:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.161993:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.161995:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.162000:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad200/0xad6b7ddc1464640 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.162028:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464632 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d438 expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.162040:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc1464647 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d438 expref: 294 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.162045:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065082.162047:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065082.162049:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:1.0:1746065082.162083:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27975:x1830881261564544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 570us (898us total) trans 4294975860 rc 0/0 00000100:00100000:1.0:1746065082.162089:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12548 00000100:00100000:1.0:1746065082.169619:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.169698:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.169872:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261564672 00000100:00100000:3.0:1746065082.169879:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261564672 00002000:00010000:3.0:1746065082.169907:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/902 (0->18446744073709551615) 00002000:00100000:3.0:1746065082.169910:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800727a1180 with x1830881261564672 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065082.169918:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800727a1180. 00000100:00100000:3.0:1746065082.169935:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261564800 00000100:00100000:3.0:1746065082.169937:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261564800 00002000:00010000:3.0:1746065082.169943:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/903 (0->18446744073709551615) 00002000:00100000:3.0:1746065082.169945:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800727a0380 with x1830881261564800 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065082.169950:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800727a0380. 00000100:00100000:3.0:1746065082.169960:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1301 00000100:00100000:3.0:1746065082.169966:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881261564672:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065082.170082:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065082.170085:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.170087:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.170088:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.170090:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065082.170122:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+58:2005:x1830881261564672:12345-192.168.202.27@tcp:10:bash.0 Request processed in 156us (509us total) trans 21474839952 rc 0/0 00000100:00100000:3.0:1746065082.170128:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1301 00002000:00010000:3.0:1746065082.170130:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/902 (0->18446744073709551615) 00002000:00100000:3.0:1746065082.170132:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800727a1180 with x1830881261564672 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065082.170136:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800727a1180. 00000100:00100000:3.0:1746065082.170147:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1302 00000100:00100000:3.0:1746065082.170151:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+72:2005:x1830881261564800:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065082.170205:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x387:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065082.170207:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x387:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.170209:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x387:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.170211:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x387:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.170213:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x387:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065082.170225:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261564800:12345-192.168.202.27@tcp:10:bash.0 Request processed in 73us (527us total) trans 17179872676 rc 0/0 00000100:00100000:3.0:1746065082.170229:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1302 00002000:00010000:3.0:1746065082.170231:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/903 (0->18446744073709551615) 00002000:00100000:3.0:1746065082.170233:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800727a0380 with x1830881261564800 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065082.170236:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800727a0380. 00000100:00100000:1.0:1746065082.170429:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.170468:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261565056 00000100:00100000:0.0:1746065082.170471:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261565056 00000100:00100000:0.0:1746065082.170490:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4323 00000100:00100000:0.0:1746065082.170494:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:27975:x1830881261565056:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065082.170592:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+295:27975:x1830881261565056:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 97us (164us total) trans 4294975861 rc 0/0 00000100:00100000:0.0:1746065082.170597:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4323 00000100:00100000:0.0:1746065082.178389:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.180684:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261565312 00000100:00100000:1.0:1746065082.180695:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261565312 00000100:00100000:1.0:1746065082.180738:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4324 00000100:00100000:1.0:1746065082.180744:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261565312:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:1.0:1746065082.180960:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:26180:x1830881261565312:12345-192.168.202.27@tcp:35:bash.0 Request processed in 215us (2579us total) trans 4294975862 rc 0/0 00000100:00100000:1.0:1746065082.180966:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4324 00000100:00100000:0.0:1746065082.185041:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.188608:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261565568 00000100:00100000:1.0:1746065082.188619:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261565568 00000100:00100000:1.0:1746065082.188672:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12549 00000100:00100000:1.0:1746065082.188680:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27976:x1830881261565568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.188702:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.188719:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1464655 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d43f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.188816:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 3/1,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.188827:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.188837:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065082.188845:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 5 00010000:00010000:1.0:1746065082.188920:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1464655 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 299 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.189431:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 298 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.189439:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065082.189442:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065082.189445:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9eb7000, rc 0) 00000100:00100000:1.0:1746065082.189570:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+298:27976:x1830881261565568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 890us (4535us total) trans 4294975863 rc 0/0 00000100:00100000:1.0:1746065082.189576:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12549 00000100:00100000:1.0:1746065082.190600:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.191378:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261565824 00000100:00100000:2.0:1746065082.191384:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261565824 00000100:00100000:2.0:1746065082.191419:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12550 00000100:00100000:2.0:1746065082.191425:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+298:27977:x1830881261565824:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065082.191455:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065082.191470:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14645de lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d41c expref: 298 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.192389:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009abad600/0xad6b7ddc1464647 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d438 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.192508:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc14645a6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d407 expref: 296 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.192517:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:2.0:1746065082.192520:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065082.192548:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065082.192558:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.192565:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.192573:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065082.192578:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.192582:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.192643:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065082.192650:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.192659:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.192684:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 295 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.192694:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 295 pid: 7204 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.192705:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262682880:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.192804:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2db000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.197790:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.198710:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880076cf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7204:1830881262682880:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065082.198731:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000100:00100000:1.0:1746065082.199670:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261565952 00000100:00100000:1.0:1746065082.199677:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261565952 00010000:00010000:1.0:1746065082.199702:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 296 pid: 7204 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.199723:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3732 00000100:00100000:1.0:1746065082.199728:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261565952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.199738:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065082.199742:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 296 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.199749:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 296 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.199764:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a9eb7000/0xad6b7ddc146465c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d43f expref: 296 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.199789:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:1.0:1746065082.199793:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.199800:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.199808:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.199822:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065082.199856:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261565952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 128us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.199861:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3732 00010000:00010000:0.0:1746065082.200008:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200014:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00080000:0.0:1746065082.200188:0:7204:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x360:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1746065082.200239:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200245:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200250:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200254:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065082.200257:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200261:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200268:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012f854200) 00010000:00010000:0.0:1746065082.200270:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746065082.200272:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.200275:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc1464678 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207025:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207037:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207042:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207050:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207054:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065082.207057:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207063:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207077:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:0.0:1746065082.207080:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065082.207083:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207087:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091baf400/0xad6b7ddc146466a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:0.0:1746065082.207104:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800727a3800 reply state ffff880097df3000 transno 4294975864 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207112:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:0.0:1746065082.207118:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:0.0:1746065082.207119:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065082.207122:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065082.207222:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27977:x1830881261565824:12345-192.168.202.27@tcp:36:rm.0 Request processed in 15793us (16619us total) trans 4294975864 rc 0/0 00000100:00100000:0.0:1746065082.207229:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12550 00000100:00100000:0.0:1746065082.210397:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.210442:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261566080 00000100:00100000:2.0:1746065082.210449:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261566080 00000100:00100000:2.0:1746065082.210501:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12551 00000100:00100000:2.0:1746065082.210508:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+296:27976:x1830881261566080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.210526:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.210570:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146467f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d446 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.210623:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464686 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065082.210633:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464686 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.210642:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464686 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:2.0:1746065082.210682:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x360:0x0]: returning size 5 00000004:00200000:2.0:1746065082.210686:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065082.210697:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464686 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:2.0:1746065082.210717:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc146467f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x360:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d446 expref: 298 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.210743:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bec00/0xad6b7ddc1464686 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x360:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d446 expref: 297 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.210750:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012e3d9d00) 00010000:00010000:2.0:1746065082.210752:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065082.210754:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bec00, rc 0) 00000100:00100000:2.0:1746065082.210809:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+297:27976:x1830881261566080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 300us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.210814:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12551 00000100:00100000:1.0:1746065082.213609:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.213670:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261566336 00000100:00100000:0.0:1746065082.213678:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261566336 00000100:00100000:0.0:1746065082.213724:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4325 00000100:00100000:0.0:1746065082.213732:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+297:27976:x1830881261566336:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:0.0:1746065082.213923:0:7207:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x360:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1746065082.213972:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2524, 64 off208568 00000040:00080000:0.0:1746065082.213991:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2528, 64 off209008 00000040:00080000:0.0:1746065082.213999:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2529, 64 off209072 00000040:00080000:0.0:1746065082.214005:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2525, 64 off208632 00010000:00010000:0.0:1746065082.214043:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 3/0,1 mode: --/PW res: [0x240000403:0x360:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065082.214055:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065082.214064:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065082.214071:0:7207:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065082.214076:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065082.214081:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065082.214852:0:7207:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065082.215946:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065082.215955:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.215964:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.215967:0:7194:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.215974:0:7194:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.215987:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x360:0x0].0x0 (ffff88012e3d9d00) 00010000:00010000:2.0:1746065082.215989:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065082.215993:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 1/0,0 mode: --/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.215996:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc146468d lrc: 0/0,0 mode: --/PW res: [0x240000403:0x360:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065082.216008:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.216009:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.216010:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065082.216393:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+298:27976:x1830881261566336:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2657us (2786us total) trans 4294975865 rc 0/0 00000100:00100000:0.0:1746065082.216402:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4325 00000100:00100000:0.0:1746065082.224121:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.226242:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261566464 00000100:00100000:2.0:1746065082.226253:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261566464 00000100:00100000:2.0:1746065082.226299:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12552 00000100:00100000:2.0:1746065082.226305:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27978:x1830881261566464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.226325:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.226341:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1464694 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d44d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.226399:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.226409:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226418:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226425:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.226429:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226433:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226463:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226467:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226472:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226476:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226480:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.226483:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226488:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226495:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.226497:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.226500:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.226504:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf400/0xad6b7ddc146469b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228003:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228012:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228017:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228022:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.228025:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228029:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228038:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065082.228040:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.228043:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228046:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646a2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.228079:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1464694 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d44d expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.228085:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc1464694 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d44d expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.228094:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:2.0:1746065082.228142:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27978:x1830881261566464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1837us (4030us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065082.228148:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12552 00000100:00100000:0.0:1746065082.232245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.233208:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261566592 00000100:00100000:2.0:1746065082.233217:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261566592 00000100:00100000:2.0:1746065082.233263:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12553 00000100:00100000:2.0:1746065082.233271:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27976:x1830881261566592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.233289:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.233303:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14646a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d454 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.233349:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.233358:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233366:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233374:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.233378:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233382:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233408:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233413:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233417:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233421:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233426:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.233429:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233434:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233442:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9400) 00010000:00010000:2.0:1746065082.233444:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.233447:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.233450:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835dc00/0xad6b7ddc14646b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234023:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234029:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234034:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234038:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.234040:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234044:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234051:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065082.234052:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.234054:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234063:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646b7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.234083:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14646a9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d454 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.234090:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009835ce00/0xad6b7ddc14646a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d454 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.234098:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00000100:00100000:2.0:1746065082.235897:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27976:x1830881261566592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2617us (3649us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065082.235906:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12553 00000100:00100000:0.0:1746065082.243055:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.243563:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261566720 00000100:00100000:2.0:1746065082.243571:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261566720 00000100:00100000:2.0:1746065082.243727:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12554 00000100:00100000:2.0:1746065082.243735:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27978:x1830881261566720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.243750:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.243764:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc14646be lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d45b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.243838:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.243848:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243857:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243869:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065082.243875:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243880:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243908:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243913:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243918:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243923:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243928:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.243930:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243936:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243943:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e3d9900) 00010000:00010000:2.0:1746065082.243946:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.243948:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.243952:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996bf800/0xad6b7ddc14646c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244577:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244583:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244586:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244589:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.244592:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244596:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244602:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:2.0:1746065082.244604:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.244606:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244611:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be000/0xad6b7ddc14646cc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.244635:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc14646be lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d45b expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.244641:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800996be200/0xad6b7ddc14646be lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d45b expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.244649:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:3.0:1746065082.247048:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27978:x1830881261566720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3306us (3993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065082.247057:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12554 00000100:00100000:0.0:1746065082.256097:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.256220:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261566848 00000100:00100000:3.0:1746065082.256228:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261566848 00000100:00100000:3.0:1746065082.256271:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12555 00000100:00100000:3.0:1746065082.256279:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+298:27978:x1830881261566848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.256294:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.256310:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14646d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d462 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.256353:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14646da lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.256363:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14646da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.256372:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14646da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.256410:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1746065082.256415:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1746065082.256438:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14646d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d462 expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.256471:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14646da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d462 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.256478:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098ce5100) 00010000:00010000:3.0:1746065082.256481:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1746065082.256484:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2200, rc 0) 00000100:00100000:3.0:1746065082.257006:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27978:x1830881261566848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 727us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.257012:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12555 00000100:00100000:0.0:1746065082.257154:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.257619:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261567104 00000100:00100000:3.0:1746065082.257623:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261567104 00000100:00100000:3.0:1746065082.258143:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12556 00000100:00100000:3.0:1746065082.258150:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27979:x1830881261567104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.258160:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.258168:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14646e1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d469 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.258207:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.258215:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258221:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258229:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.258234:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258238:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258264:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258269:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258274:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258279:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258284:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.258287:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258291:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258299:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098ce5100) 00010000:00010000:3.0:1746065082.258301:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.258303:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258306:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2a00/0xad6b7ddc14646e8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258314:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258318:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258322:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258325:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.258328:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258331:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258335:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:3.0:1746065082.258337:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.258340:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258344:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2c00/0xad6b7ddc14646ef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.258360:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14646e1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d469 expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.258367:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14646e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d469 expref: 300 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.258373:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:3.0:1746065082.258394:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+299:27979:x1830881261567104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 244us (1240us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065082.258399:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12556 00000100:00100000:2.0:1746065082.266284:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.266362:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261567360 00000100:00100000:1.0:1746065082.266370:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261567360 00000100:00100000:1.0:1746065082.266415:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12557 00000100:00100000:1.0:1746065082.266422:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+299:27978:x1830881261567360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.266438:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.266440:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065082.266461:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc14646da lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d462 expref: 299 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.266486:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880098ce5100) 00010000:00010000:1.0:1746065082.266494:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065082.266503:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14646f6 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d470 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.266604:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.266613:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266620:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266628:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.266633:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266638:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266917:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.266924:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266929:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065082.266935:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 0 00010000:00010000:1.0:1746065082.266950:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266956:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266960:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266965:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266969:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b49f6a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.266972:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266980:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266986:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800b2154800) 00010000:00010000:1.0:1746065082.266988:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.266990:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.266994:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc14646fd lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000004:00010000:1.0:1746065082.267001:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aec9180 reply state ffff880098350000 transno 4294975866 ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.267007:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.267011:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065082.267013:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065082.267015:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065082.267034:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099524200/0xad6b7ddc14646f6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 301 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.267047:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 300 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.267053:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff880097e34300) 00010000:00010000:1.0:1746065082.267054:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065082.267056:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104000, rc 0) 00000100:00100000:1.0:1746065082.267094:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+301:27978:x1830881261567360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 673us (818us total) trans 4294975866 rc 0/0 00000100:00100000:1.0:1746065082.267103:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12557 00000100:00100000:0.0:1746065082.271352:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.271437:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261567616 00000100:00100000:3.0:1746065082.271445:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261567616 00000100:00100000:3.0:1746065082.271888:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12558 00000100:00100000:3.0:1746065082.271895:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+301:27978:x1830881261567616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.271914:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.271926:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1464719 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d477 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.272001:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.272012:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.272017:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.272039:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 302 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.272048:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 302 pid: 7204 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.272058:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009570ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262683008:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.274300:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065082.281680:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.281752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.281891:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261567872 00000100:00100000:1.0:1746065082.281899:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261567872 00000100:00100000:3.0:1746065082.282090:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009570ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:7203:1830881262683008:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.282109:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000100:00100000:2.0:1746065082.282301:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261568000 00000100:00100000:2.0:1746065082.282305:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261568000 00010000:00010000:2.0:1746065082.282321:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 304 pid: 7204 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.282338:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3733 00000100:00100000:2.0:1746065082.282343:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+304:2005:x1830881261568000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.282353:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.282358:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 304 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.282367:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 304 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.282385:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880130104000/0xad6b7ddc146470b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d470 expref: 304 pid: 7204 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.282407:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff880097e34300) 00010000:00010000:2.0:1746065082.282411:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.282418:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.282423:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT1 00010000:00010000:2.0:1746065082.282443:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065082.282474:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+303:2005:x1830881261568000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 130us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.282483:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3733 00010000:00010000:3.0:1746065082.282914:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.282920:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.282939:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 0 00000004:00080000:3.0:1746065082.283060:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x389:0x0], index 1: 0 00000004:00080000:3.0:1746065082.283066:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x388:0x0], index 0: 0 00000004:00080000:3.0:1746065082.283069:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x389:0x0], index 0: 0 00000004:00080000:3.0:1746065082.283072:0:7203:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x38a:0x0], index 1: 0 00010000:00010000:3.0:1746065082.283146:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283151:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283156:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283161:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.283165:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283170:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283178:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff880097e34300) 00010000:00010000:3.0:1746065082.283180:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065082.283183:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283186:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc1464720 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.283220:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1464719 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d477 expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.283226:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3c00/0xad6b7ddc1464719 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d477 expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.283240:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3c00, rc 0) 00000100:00100000:3.0:1746065082.283953:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+302:27978:x1830881261567616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 12057us (12608us total) trans 4294975867 rc 301/301 00000100:00100000:3.0:1746065082.283959:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12558 00000100:00100000:3.0:1746065082.283975:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12559 00000100:00100000:3.0:1746065082.283981:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+301:27980:x1830881261567872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.283992:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.284000:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc146472e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d47e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.284059:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464735 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.284066:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464735 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.284072:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464735 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.284115:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2000/0xad6b7ddc146472e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d47e expref: 304 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.284125:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464735 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d47e expref: 303 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.284130:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.284133:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.284134:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2200, rc 0) 00000100:00100000:3.0:1746065082.284152:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+303:27980:x1830881261567872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 172us (2480us total) trans 4294975868 rc 0/0 00000100:00100000:3.0:1746065082.284157:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12559 00000100:00100000:1.0:1746065082.287904:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.287969:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261568256 00000100:00100000:0.0:1746065082.287976:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261568256 00000100:00100000:0.0:1746065082.288010:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4326 00000100:00100000:0.0:1746065082.288017:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+303:27978:x1830881261568256:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065082.290207:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+304:27978:x1830881261568256:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2185us (2303us total) trans 4294975869 rc 0/0 00000100:00100000:3.0:1746065082.290216:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4326 00000100:00100000:3.0:1746065082.296096:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.296123:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.296165:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.296226:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261568640 00000100:00100000:1.0:1746065082.296233:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261568640 00000100:00100000:1.0:1746065082.296263:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261568768 00000100:00100000:1.0:1746065082.296264:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261568768 00000100:00100000:1.0:1746065082.296277:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8894 00000100:00100000:1.0:1746065082.296282:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881261568640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.296297:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.296312:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1464743 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d485 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065082.296330:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065082.296343:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.296345:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.296350:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1464743 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d485 expref: 59 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.296363:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc1464743 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d485 expref: 59 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.296371:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524200, rc 0) 00000100:00100000:1.0:1746065082.296403:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881261568640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.296408:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8894 00000100:00100000:1.0:1746065082.296422:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8895 00000100:00100000:1.0:1746065082.296426:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+73:2005:x1830881261568768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.296431:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.296439:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146474a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d48c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065082.296450:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x38a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065082.296457:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.296458:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.296461:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146474a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d48c expref: 74 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.296469:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146474a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d48c expref: 74 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065082.296475:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524000, rc 0) 00000100:00100000:1.0:1746065082.296488:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009570ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261568768:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 62us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.296493:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8895 00000100:00100000:0.0:1746065082.296808:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261568512 00000100:00100000:0.0:1746065082.296812:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261568512 00000100:00100000:0.0:1746065082.296835:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4327 00000100:00100000:0.0:1746065082.296839:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+304:27978:x1830881261568512:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065082.296956:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+305:27978:x1830881261568512:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 116us (869us total) trans 4294975870 rc 0/0 00000100:00100000:0.0:1746065082.296961:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4327 00000100:00100000:0.0:1746065082.302386:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.302478:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261569024 00000100:00100000:1.0:1746065082.302495:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261569024 00000100:00100000:1.0:1746065082.302548:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4328 00000100:00100000:1.0:1746065082.302556:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+305:27980:x1830881261569024:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065082.303376:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+306:27980:x1830881261569024:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 818us (996us total) trans 4294975871 rc 0/0 00000100:00100000:1.0:1746065082.303383:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4328 00000100:00100000:0.0:1746065082.306130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.306258:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261569280 00000100:00100000:1.0:1746065082.306265:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261569280 00000100:00100000:1.0:1746065082.307124:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12560 00000100:00100000:1.0:1746065082.307132:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+306:26180:x1830881261569280:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065082.307148:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.307166:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccde00/0xad6b7ddc1464751 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d493 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.307260:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.307270:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307278:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307284:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.307289:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307294:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307323:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc000/0xad6b7ddc1464766 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.307328:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc000/0xad6b7ddc1464766 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307333:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc000/0xad6b7ddc1464766 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065082.307344:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 0 00010000:00010000:1.0:1746065082.307390:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307395:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307400:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307404:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307408:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.307411:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307416:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307424:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065082.307426:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.307429:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307432:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd400/0xad6b7ddc1464758 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307440:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307444:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307451:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307454:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccd200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.307456:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307460:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307464:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065082.307465:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.307467:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307471:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccd200/0xad6b7ddc146475f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.307493:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccde00/0xad6b7ddc1464751 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d493 expref: 309 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.307503:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc000/0xad6b7ddc1464766 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d493 expref: 308 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.307507:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.307509:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065082.307510:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc000, rc 0) 00000100:00100000:1.0:1746065082.308604:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800727a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+308:26180:x1830881261569280:12345-192.168.202.27@tcp:101:bash.0 Request processed in 1470us (2476us total) trans 4294975872 rc 0/0 00000100:00100000:1.0:1746065082.308612:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12560 00000100:00100000:0.0:1746065082.318620:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.318672:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.318719:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.318741:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261569792 00000100:00100000:0.0:1746065082.318749:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261569792 00000100:00100000:0.0:1746065082.318803:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 567 00000100:00100000:0.0:1746065082.318811:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+308:2004:x1830881261569792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065082.318823:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065082.318842:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc000/0xad6b7ddc1464766 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d493 expref: 308 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.318859:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:0.0:1746065082.318863:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065082.318893:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+307:2004:x1830881261569792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.318897:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 567 00000100:00100000:2.0:1746065082.319008:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261569408 00000100:00100000:2.0:1746065082.319012:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261569408 00000100:00100000:2.0:1746065082.319666:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261569664 00000100:00100000:2.0:1746065082.319670:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261569664 00000100:00100000:1.0:1746065082.319705:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12561 00000100:00100000:1.0:1746065082.319712:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+308:26180:x1830881261569408:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065082.319728:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.319737:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccce00/0xad6b7ddc1464774 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d49a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.319761:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146477b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.319771:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146477b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.319798:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146477b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.319876:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccce00/0xad6b7ddc1464774 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d49a expref: 310 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.319891:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146477b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d49a expref: 309 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.319897:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.319899:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1746065082.319901:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc600, rc 0) 00000100:00100000:1.0:1746065082.319925:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+309:26180:x1830881261569408:12345-192.168.202.27@tcp:101:bash.0 Request processed in 214us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.319931:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12561 00000100:00100000:1.0:1746065082.319944:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12562 00000100:00100000:1.0:1746065082.319948:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+308:27980:x1830881261569664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.319957:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.319962:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1464782 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4a1 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.320001:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464789 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065082.320007:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464789 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.320012:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464789 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT1 00000004:00200000:1.0:1746065082.320019:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 0 00010000:00010000:1.0:1746065082.320081:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc800/0xad6b7ddc1464782 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a1 expref: 311 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.320090:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464789 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a1 expref: 310 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.320095:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.320097:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065082.320098:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cccc00, rc 0) 00000100:00100000:1.0:1746065082.320114:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+310:27980:x1830881261569664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 165us (1443us total) trans 4294975873 rc 0/0 00000100:00100000:1.0:1746065082.320119:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12562 00000100:00100000:0.0:1746065082.323814:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.323863:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.323916:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261570048 00000100:00100000:3.0:1746065082.323927:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261570048 00000100:00100000:3.0:1746065082.323960:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261570176 00000100:00100000:3.0:1746065082.323962:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261570176 00000100:00100000:3.0:1746065082.323979:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12563 00000100:00100000:3.0:1746065082.323985:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+311:26180:x1830881261570048:12345-192.168.202.27@tcp:36:bash.0 00010000:00010000:3.0:1746065082.324022:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065082.324042:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2200/0xad6b7ddc1464735 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d47e expref: 311 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.324061:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.324065:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065082.324120:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12564 00000100:00100000:0.0:1746065082.324132:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+310:27980:x1830881261570176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065082.324154:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.324170:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464797 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4a8 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.324198:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.324210:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.324218:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.324261:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000001:00080000:3.0:1746065082.324269:0:7203:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975874 00010000:00010000:0.0:1746065082.324272:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 2/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.324277:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.324294:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00000004:00010000:3.0:1746065082.324301:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077ca80 reply state ffff88012be10000 transno 4294975875 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.324307:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.324310:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.324317:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.324320:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.324328:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.324339:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.324344:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065082.324497:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065082.324577:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+314:26180:x1830881261570048:12345-192.168.202.27@tcp:36:bash.0 Request processed in 591us (803us total) trans 4294975875 rc 0/0 00000100:00100000:3.0:1746065082.324583:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12563 00000020:00080000:3.0:1746065082.324587:0:7203:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1746065082.324650:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.324656:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065082.324675:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 0 00000004:00200000:0.0:1746065082.324679:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065082.324688:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.324710:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464797 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 314 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.324725:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 313 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.324732:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:0.0:1746065082.324734:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065082.324736:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:0.0:1746065082.324757:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+313:27980:x1830881261570176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 631us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.324763:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12564 00000100:00100000:0.0:1746065082.329770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.332668:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261570688 00000100:00100000:1.0:1746065082.332677:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261570688 00000100:00100000:1.0:1746065082.333608:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12565 00000100:00100000:1.0:1746065082.333618:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+313:26180:x1830881261570688:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:1.0:1746065082.333639:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.333642:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065082.333662:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464789 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a1 expref: 313 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.333685:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.333689:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065082.333697:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccce00/0xad6b7ddc14647ac lrc: 2/0,0 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4af expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.333734:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065082.333743:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 313 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.333749:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.333770:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 313 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.333793:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 313 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.333803:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262683136:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065082.333877:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065082.333964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.334056:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261570560 00000100:00100000:0.0:1746065082.334059:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261570560 00000100:00100000:0.0:1746065082.334082:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4329 00000100:00100000:0.0:1746065082.334087:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+314:27980:x1830881261570560:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065082.334228:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+315:27980:x1830881261570560:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 139us (264us total) trans 4294975876 rc 0/0 00000100:00100000:0.0:1746065082.334234:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4329 00000100:00100000:0.0:1746065082.340697:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.340765:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.340835:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261570816 00000100:00100000:2.0:1746065082.340845:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261570816 00000100:00100000:0.0:1746065082.340857:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262683136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.340909:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 315 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.340952:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3734 00000100:00100000:2.0:1746065082.340959:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+315:2006:x1830881261570816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.340972:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.340977:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 315 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.340987:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 315 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.341004:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc14647a5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4a8 expref: 315 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.341020:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:2.0:1746065082.341024:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.341031:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.341040:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.341054:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065082.341120:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+314:2006:x1830881261570816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.341126:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3734 00000100:00100000:3.0:1746065082.341212:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571072 00000100:00100000:3.0:1746065082.341216:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571072 00000100:00100000:3.0:1746065082.341245:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12566 00000100:00100000:3.0:1746065082.341250:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+314:27980:x1830881261571072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.341265:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.341278:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc14647ba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4b6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.341353:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.341361:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341367:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341374:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.341379:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341384:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341502:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065082.341508:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341514:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00000004:00200000:3.0:1746065082.341521:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 0 00010000:00010000:3.0:1746065082.341588:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341594:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341602:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341607:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.341610:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341616:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341622:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.341624:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746065082.341627:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 2/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341632:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14647cf lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341649:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341654:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341658:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341662:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341665:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.341667:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341674:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.341674:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.341680:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800a9973100) 00010000:00010000:3.0:1746065082.341681:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.341684:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.341686:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.341687:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8a00/0xad6b7ddc14647c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:0.0:1746065082.341691:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.341694:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341698:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341701:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341704:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.341706:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341710:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341714:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:3.0:1746065082.341716:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.341718:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341721:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe9600/0xad6b7ddc14647c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:3.0:1746065082.341748:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc14647ba lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4b6 expref: 316 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.341754:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc14647ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4b6 expref: 316 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.341765:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8e00, rc 0) 00000100:00100000:3.0:1746065082.341811:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+315:27980:x1830881261571072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 560us (1137us total) trans 4294975877 rc 301/301 00000100:00100000:3.0:1746065082.341816:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12566 00000100:00100000:2.0:1746065082.350088:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.350679:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571328 00000100:00100000:0.0:1746065082.350688:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571328 00000100:00100000:0.0:1746065082.350723:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4330 00000100:00100000:0.0:1746065082.350730:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+315:27980:x1830881261571328:12345-192.168.202.27@tcp:35:lfs.0 00000040:00080000:1.0:1746065082.350767:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2530, 88 off209160 00000004:00080000:1.0:1746065082.350803:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678369028037ns, next at 678738608678ns, rc = 0 00000040:00080000:1.0:1746065082.352523:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2526, 88 off208720 00000004:00080000:1.0:1746065082.352548:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678370774132ns, next at 678738623360ns, rc = 0 00000040:00080000:1.0:1746065082.352596:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2527, 88 off208808 00000004:00080000:1.0:1746065082.352600:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678370825798ns, next at 678738623360ns, rc = 0 00000040:00080000:1.0:1746065082.352619:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2531, 88 off209248 00000004:00080000:1.0:1746065082.352622:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678370848800ns, next at 678738608678ns, rc = 0 00000100:00100000:1.0:1746065082.353273:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009abc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+317:27980:x1830881261571328:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 2537us (3186us total) trans 4294975879 rc 0/0 00000100:00100000:1.0:1746065082.353283:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4330 00000001:00080000:0.0:1746065082.356418:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975878 is committed 00000004:00080000:0.0:1746065082.356428:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1707 committed 00010000:00010000:1.0:1746065082.356695:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00000004:00080000:0.0:1746065082.356922:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1697 committed 00000004:00080000:0.0:1746065082.356929:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1696 committed 00000004:00080000:0.0:1746065082.356936:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1706 committed 00000100:00100000:2.0:1746065082.357104:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262683648:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.357175:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.357241:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357249:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357254:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.357259:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357265:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357287:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065082.357290:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.357294:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357303:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc1464671 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357323:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357327:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357331:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357335:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b49f7400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.357337:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357342:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357347:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e3d9b00) 00010000:00010000:1.0:1746065082.357348:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.357350:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00010000:00010000:1.0:1746065082.357354:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1464704 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT1 00000100:00100000:3.0:1746065082.357366:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262683264:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1746065082.357373:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.357378:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.357385:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.357389:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.357391:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.357395:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.357401:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.357402:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.357404:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00010000:00010000:1.0:1746065082.357408:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc146479e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT1 00000100:00100000:3.0:1746065082.357421:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.357448:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262683648 00000100:00100000:3.0:1746065082.357454:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262683648 00010000:00010000:1.0:1746065082.357464:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4af expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.357472:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.357474:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1746065082.357486:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262683264 00010000:00010000:1.0:1746065082.357487:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccce00/0xad6b7ddc14647ac lrc: 0/0,0 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4af expref: 293 pid: 7205 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746065082.357488:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262683264 00010000:00010000:1.0:1746065082.357498:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4af expref: 292 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.357499:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8896 00000100:00100000:3.0:1746065082.357504:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+153:3759:x1830881262683648:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.357531:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8897 00000100:00100000:1.0:1746065082.357548:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+153:3760:x1830881262683264:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1746065082.357569:0:12258:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:902 count 1 00010000:00010000:1.0:1746065082.357587:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.357602:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 58 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.357609:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.357611:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.357613:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.357617:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+154:3759:x1830881262683648:12345-0@lo:2:osp-syn-0-1.0 Request processed in 112us (441us total) trans 21474839953 rc 0/0 00000100:00100000:3.0:1746065082.357622:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8896 00000004:00080000:2.0:1746065082.358589:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc1c00/2, rc 0, transno 21474839953 00000100:00100000:2.0:1746065082.358597:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262683648:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.358611:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262684160:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.358644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.358682:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262683520:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1746065082.358694:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262683392:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.358702:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.358717:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ed09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262683904:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.358727:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.358740:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262684160 00000100:00100000:2.0:1746065082.358744:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262684160 00000100:00100000:0.0:1746065082.358754:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ed0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262684032:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.358767:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.359081:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 58 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.359093:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 58 pid: 12260 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.359104:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262684288:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065082.359315:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262683520 00000100:00100000:0.0:1746065082.359319:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262683520 00000100:00100000:0.0:1746065082.359345:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262683392 00000100:00100000:0.0:1746065082.359347:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262683392 00000100:00100000:0.0:1746065082.359357:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262684032 00000100:00100000:0.0:1746065082.359359:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262684032 00000100:00100000:0.0:1746065082.359368:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8898 00000100:00100000:0.0:1746065082.359374:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+187:3759:x1830881262684160:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1746065082.359517:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065082.359520:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065082.359522:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065082.359523:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065082.359525:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065082.360186:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8899 00000100:00100000:3.0:1746065082.360193:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+154:3761:x1830881262683520:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.360197:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065082.360223:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8900 00002000:00080000:3.0:1746065082.360225:0:1880:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:903 count 1 00000100:00100000:1.0:1746065082.360237:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+188:3762:x1830881262683392:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:3.0:1746065082.360245:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065082.360251:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.360262:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.360264:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065082.360268:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.360278:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.360285:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.360290:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.360303:0:1880:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1746065082.360344:0:9548:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:903 count 1 00010000:00010000:1.0:1746065082.360361:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.360375:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 73 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.360381:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.360383:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065082.360385:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.360402:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 73 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.360410:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 73 pid: 3067 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.360419:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262684416:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065082.360450:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065082.360464:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8901 00000100:00100000:3.0:1746065082.360468:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+155:3761:x1830881262683520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 275us (1765us total) trans 21474839954 rc 0/0 00000100:00100000:1.0:1746065082.360470:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+188:3762:x1830881262684032:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.360475:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8899 00000100:00100000:3.0:1746065082.360499:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262683776:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065082.360521:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.360558:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262683776 00000100:00100000:3.0:1746065082.360562:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262683776 00000100:00100000:3.0:1746065082.360577:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8902 00000100:00100000:3.0:1746065082.360581:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+155:3760:x1830881262683776:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.360591:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+189:3762:x1830881262684032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 121us (1822us total) trans 17179872678 rc 0/0 00000100:00100000:1.0:1746065082.360597:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8901 00010000:00010000:1.0:1746065082.360614:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065082.360620:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065082.360624:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1746065082.360626:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2c00 already unused, calling callback (ffffffffa086fd70) 00002000:00010000:3.0:1746065082.360627:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.360629:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1746065082.360630:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065082.360631:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.360632:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1746065082.360641:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.360654:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+156:3760:x1830881262683776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 72us (132us total) trans 21474839955 rc 0/0 00010000:00010000:1.0:1746065082.360655:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.360660:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8902 00010000:00010000:1.0:1746065082.360660:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc14647e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.360678:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.360679:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065082.360681:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065082.360690:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc3480/2, rc 0, transno 21474839955 00000100:00100000:3.0:1746065082.360695:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262683776:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1746065082.360703:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed0aa00/2, rc 0, transno 17179872678 00000100:00100000:1.0:1746065082.360708:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262684032:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.360856:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+188:3759:x1830881262684160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1480us (2210us total) trans 17179872677 rc 0/0 00000100:00100000:0.0:1746065082.360862:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8898 00000100:00100000:2.0:1746065082.360921:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065082.360936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:2.0:1746065082.360961:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc1500/2, rc 0, transno 21474839954 00000100:00100000:2.0:1746065082.360965:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262683520:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1746065082.361863:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d180/2, rc 0, transno 17179872677 00000100:00100000:2.0:1746065082.362512:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262684160:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.362541:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262683904 00000100:00100000:0.0:1746065082.362550:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262683904 00000100:00100000:0.0:1746065082.362640:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8903 00000100:00100000:0.0:1746065082.362648:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+188:3761:x1830881262683904:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1746065082.362669:0:11461:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:904 count 1 00002000:00010000:0.0:1746065082.362691:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1746065082.362697:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.362707:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.362710:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065082.362713:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.362722:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.362730:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.362736:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.362806:0:11461:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746065082.362816:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571456 00000100:00100000:1.0:1746065082.362823:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571456 00000100:00100000:1.0:1746065082.362860:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4331 00000100:00100000:1.0:1746065082.362866:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27980:x1830881261571456:12345-192.168.202.27@tcp:33:lfs.0 00000100:00100000:1.0:1746065082.362989:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+293:27980:x1830881261571456:12345-192.168.202.27@tcp:33:lfs.0 Request processed in 123us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.362995:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4331 00000100:00100000:0.0:1746065082.363008:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+189:3761:x1830881262683904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 361us (2085us total) trans 17179872679 rc 0/0 00000100:00100000:0.0:1746065082.363014:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8903 00010000:00010000:1.0:1746065082.363035:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:1.0:1746065082.363038:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065082.363042:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccc200, rc 0) 00000100:00100000:1.0:1746065082.363062:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:26180:x1830881261570688:12345-192.168.202.27@tcp:101:bash.0 Request processed in 29446us (33300us total) trans 4294975878 rc 0/0 00000100:00100000:1.0:1746065082.363069:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12565 00000004:00080000:2.0:1746065082.363178:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ed09500/2, rc 0, transno 17179872679 00000100:00100000:2.0:1746065082.363183:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ed09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262683904:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1746065082.363196:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746065082.363204:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.363211:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065082.363215:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.363222:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.363235:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.363241:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c800/0xad6b7ddc14647f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.363254:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.363255:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065082.363256:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065082.369461:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262684288:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065082.369490:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065082.370649:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.371317:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262684416:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.371341:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065082.372949:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.372999:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.373004:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571584 00000100:00100000:2.0:1746065082.373013:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571584 00010000:00010000:2.0:1746065082.373053:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 59 pid: 12260 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.373087:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571712 00000100:00100000:2.0:1746065082.373090:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571712 00010000:00010000:2.0:1746065082.373101:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 74 pid: 3067 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.373117:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3735 00000100:00100000:2.0:1746065082.373123:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881261571584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.373135:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.373140:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 59 pid: 12260 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.373149:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 59 pid: 12260 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746065082.373162:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3736 00000100:00100000:1.0:1746065082.373172:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+74:2004:x1830881261571712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065082.373187:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065082.373194:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 74 pid: 3067 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.373206:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 74 pid: 3067 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.373213:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc1464624 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d42a expref: 59 pid: 12260 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.373223:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3200/0xad6b7ddc146462b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d431 expref: 74 pid: 3067 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746065082.373240:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.373243:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065082.373247:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.373255:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.373284:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065082.373331:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+73:2004:x1830881261571712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.373337:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3736 00010000:00010000:2.0:1746065082.373966:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.373970:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.373974:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.373983:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374005:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065082.374018:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.374027:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.374036:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.374045:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.374047:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881261571584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 922us (3402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.374054:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3735 00010000:00010000:1.0:1746065082.374061:0:12258:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065082.374104:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374111:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374119:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374126:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374139:0:9548:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1746065082.374764:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+189:3762:x1830881262683392:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14533us (16035us total) trans 17179872680 rc 0/0 00000100:00100000:2.0:1746065082.374793:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8900 00000100:00100000:2.0:1746065082.374810:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571840 00000100:00100000:2.0:1746065082.374813:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571840 00000100:00100000:2.0:1746065082.374833:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8904 00000100:00100000:2.0:1746065082.374837:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+73:26180:x1830881261571840:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.374849:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.374862:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4bd expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065082.374875:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065082.374887:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.374888:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.374893:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 74 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374902:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 74 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.374909:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00000100:00100000:2.0:1746065082.374926:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+74:26180:x1830881261571840:12345-192.168.202.27@tcp:101:bash.0 Request processed in 88us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.374931:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8904 00010000:00010000:2.0:1746065082.375048:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1746065082.375054:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375060:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccc000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.375064:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375070:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375080:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375085:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ccc000/0xad6b7ddc14647dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375099:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065082.375101:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375106:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccda00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.375108:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375114:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375121:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375126:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ccda00/0xad6b7ddc14647eb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.375142:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.375143:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.375145:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1746065082.375177:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45aa00/2, rc 0, transno 17179872680 00000100:00100000:2.0:1746065082.375182:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262683392:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1746065082.376451:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+156:3760:x1830881262683264:12345-0@lo:6:osp-syn-0-1.0 Request processed in 18895us (19020us total) trans 21474839956 rc 0/0 00000100:00100000:1.0:1746065082.376464:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8897 00010000:00010000:1.0:1746065082.376498:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1746065082.376787:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009abc0380/2, rc 0, transno 21474839956 00000100:00100000:3.0:1746065082.376794:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009abc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262683264:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1746065082.381334:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.381582:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261571968 00000100:00100000:2.0:1746065082.381593:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261571968 00000100:00100000:2.0:1746065082.381738:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8905 00000100:00100000:2.0:1746065082.381745:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+58:26180:x1830881261571968:12345-192.168.202.27@tcp:101:bash.0 00010000:00010000:2.0:1746065082.381759:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.381804:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1464800 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4c4 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065082.381823:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065082.381839:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.381841:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.381851:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1464800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4c4 expref: 59 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.381864:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc1464800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4c4 expref: 59 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.381873:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:2.0:1746065082.381929:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+59:26180:x1830881261571968:12345-192.168.202.27@tcp:101:bash.0 Request processed in 185us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.381935:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8905 00000100:00100000:1.0:1746065082.386574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.386684:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.386739:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.386924:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261572480 00000100:00100000:1.0:1746065082.386934:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261572480 00000100:00100000:0.0:1746065082.386942:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261572224 00000100:00100000:0.0:1746065082.386946:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261572224 00002000:00010000:1.0:1746065082.386980:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/904 (0->18446744073709551615) 00002000:00100000:1.0:1746065082.386984:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed6680 with x1830881261572480 ext(0->18446744073709551615) 00000100:00100000:3.0:1746065082.386987:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261572352 00000100:00100000:3.0:1746065082.386996:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261572352 00002000:00010000:1.0:1746065082.386998:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aed6680. 00000100:00100000:0.0:1746065082.387008:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12567 00000100:00100000:1.0:1746065082.387014:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1303 00000100:00100000:0.0:1746065082.387015:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+292:27981:x1830881261572224:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065082.387019:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881261572480:12345-192.168.202.27@tcp:10:bash.0 00002000:00010000:3.0:1746065082.387028:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/905 (0->18446744073709551615) 00002000:00100000:3.0:1746065082.387032:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098359f80 with x1830881261572352 ext(0->18446744073709551615) 00010000:00010000:0.0:1746065082.387037:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746065082.387040:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098359f80. 00010000:00010000:0.0:1746065082.387056:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c200/0xad6b7ddc1464807 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4cb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.387061:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1304 00000100:00100000:3.0:1746065082.387068:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+74:2005:x1830881261572352:12345-192.168.202.27@tcp:10:bash.0 00010000:00010000:0.0:1746065082.387148:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065082.387164:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.387175:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.387186:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065082.387190:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.387195:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00002000:00010000:1.0:1746065082.387196:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065082.387198:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:1.0:1746065082.387200:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065082.387201:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:1.0:1746065082.387203:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1746065082.387231:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065082.387235:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb mtime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.387237:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.387238:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb ctime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.387240:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065082.387251:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+60:2005:x1830881261572480:12345-192.168.202.27@tcp:10:bash.0 Request processed in 231us (575us total) trans 21474839957 rc 0/0 00000100:00100000:1.0:1746065082.387258:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1303 00002000:00010000:1.0:1746065082.387261:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/904 (0->18446744073709551615) 00002000:00100000:1.0:1746065082.387263:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aed6680 with x1830881261572480 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065082.387267:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aed6680. 00000100:00100000:3.0:1746065082.387278:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+75:2005:x1830881261572352:12345-192.168.202.27@tcp:10:bash.0 Request processed in 210us (538us total) trans 17179872681 rc 0/0 00000100:00100000:3.0:1746065082.387285:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1304 00002000:00010000:3.0:1746065082.387288:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/905 (0->18446744073709551615) 00010000:00010000:0.0:1746065082.387288:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00002000:00100000:3.0:1746065082.387290:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098359f80 with x1830881261572352 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065082.387294:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098359f80. 00010000:00010000:0.0:1746065082.387294:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:0.0:1746065082.387299:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:0.0:1746065082.387308:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 2 00010000:00010000:3.0:1746065082.387558:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387567:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387572:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387581:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387586:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.387589:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387594:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387606:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012e1fcf00) 00010000:00010000:3.0:1746065082.387609:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.387612:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387616:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146480e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387647:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387652:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387656:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387660:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.387662:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387665:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.387674:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012e1fc300) 00010000:00010000:3.0:1746065082.387676:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065082.387678:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.388345:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46800/0xad6b7ddc1464815 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.388395:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c200/0xad6b7ddc1464807 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.388409:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 294 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.388414:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.388417:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065082.388419:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:3.0:1746065082.388458:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:27981:x1830881261572224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1443us (1899us total) trans 4294975880 rc 0/0 00000100:00100000:3.0:1746065082.388465:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12567 00000100:00100000:0.0:1746065082.390898:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.391511:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261572736 00000100:00100000:2.0:1746065082.391523:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261572736 00000100:00100000:2.0:1746065082.391598:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4332 00000100:00100000:2.0:1746065082.391605:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+294:26180:x1830881261572736:12345-192.168.202.27@tcp:35:bash.0 00000100:00100000:2.0:1746065082.391944:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+295:26180:x1830881261572736:12345-192.168.202.27@tcp:35:bash.0 Request processed in 338us (1056us total) trans 4294975881 rc 0/0 00000100:00100000:2.0:1746065082.391951:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4332 00000100:00100000:0.0:1746065082.398026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.398133:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261572992 00000100:00100000:2.0:1746065082.398141:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261572992 00000100:00100000:2.0:1746065082.398183:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4333 00000100:00100000:2.0:1746065082.398189:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+295:27981:x1830881261572992:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065082.399524:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27981:x1830881261572992:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1329us (1500us total) trans 4294975882 rc 0/0 00000100:00100000:2.0:1746065082.399540:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4333 00000100:00100000:0.0:1746065082.405977:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.406047:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261573248 00000100:00100000:3.0:1746065082.406055:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261573248 00000100:00100000:3.0:1746065082.406875:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12568 00000100:00100000:3.0:1746065082.406883:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27981:x1830881261573248:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.406904:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.406919:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146482a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4d2 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.407002:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065082.407012:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.407018:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.407040:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.407049:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 297 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.407059:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262684544:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.408560:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065082.413677:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.414197:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261573504 00000100:00100000:2.0:1746065082.414205:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261573504 00000100:00100000:2.0:1746065082.414249:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12569 00000100:00100000:2.0:1746065082.414257:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:27982:x1830881261573504:12345-192.168.202.27@tcp:36:rm.0 00010000:00010000:2.0:1746065082.414296:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746065082.414317:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc200/0xad6b7ddc14647b3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4af expref: 298 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.414489:0:7205:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from blocking AST (req@ffff88009577ca80 x1830881262684544) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 297 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.414500:0:7205:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 297 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746065082.414509:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f46000/0xad6b7ddc146481c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4cb expref: 297 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.414667:0:7231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc146481c) 00010000:00010000:2.0:1746065082.414676:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccc600/0xad6b7ddc146477b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d49a expref: 296 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.414684:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:2.0:1746065082.414688:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.414694:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.414700:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT1 00010000:00010000:2.0:1746065082.414719:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065082.414735:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065082.414742:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.414747:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.414754:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065082.414758:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.414762:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065082.414927:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7205:1830881262684544:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.414943:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.414947:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.415433:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.415439:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065082.415452:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 5 00010000:00010000:3.0:1746065082.415566:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146482a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 297 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.415580:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 296 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.415586:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:3.0:1746065082.415588:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065082.415589:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac800, rc 0) 00000100:00100000:3.0:1746065082.415640:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+296:27981:x1830881261573248:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8758us (9669us total) trans 4294975883 rc 0/0 00000100:00100000:3.0:1746065082.415647:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12568 00010000:00010000:3.0:1746065082.416282:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065082.416292:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.416298:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 4/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065082.416321:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 295 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.416330:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 295 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.416340:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262684672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.416400:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065082.418306:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262684672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.418328:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065082.433324:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.433395:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261573632 00000100:00100000:2.0:1746065082.433404:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261573632 00010000:00010000:2.0:1746065082.433440:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 296 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.433487:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3737 00000100:00100000:2.0:1746065082.433495:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+296:2004:x1830881261573632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.433507:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.433512:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 296 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.433522:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 296 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.433551:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac800/0xad6b7ddc1464831 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x362:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d2 expref: 296 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.433583:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:2.0:1746065082.433587:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.433595:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.433601:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.433618:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065082.433664:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261573632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 170us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.433671:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3737 00010000:00010000:2.0:1746065082.433700:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.433710:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:2.0:1746065082.433924:0:7231:0:(mdd_dir.c:1921:mdd_finish_unlink()) Object [0x240000403:0x362:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1746065082.433988:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.433995:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434000:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434005:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.434009:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434014:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434021:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff8800a9973c00) 00010000:00010000:2.0:1746065082.434024:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746065082.434027:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434031:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146484d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434047:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434052:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434059:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434063:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434066:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.434068:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434071:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434076:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065082.434077:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.434079:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434082:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73600/0xad6b7ddc1464838 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065082.434090:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077ed80 reply state ffff880097df5000 transno 4294975884 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434097:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.434102:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a200) 00010000:00010000:2.0:1746065082.434103:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065082.434105:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065082.434144:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:27982:x1830881261573504:12345-192.168.202.27@tcp:36:rm.0 Request processed in 19888us (20474us total) trans 4294975884 rc 0/0 00000100:00100000:2.0:1746065082.434153:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12569 00000100:00100000:0.0:1746065082.441293:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.441555:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261573760 00000100:00100000:2.0:1746065082.441563:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261573760 00000100:00100000:2.0:1746065082.441614:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12570 00000100:00100000:2.0:1746065082.441621:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:27981:x1830881261573760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.441642:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.441662:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc1464854 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4d9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.441713:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc146485b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065082.441723:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc146485b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.441732:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc146485b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065082.441762:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 5 00000004:00200000:2.0:1746065082.441765:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065082.441803:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc146485b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.441823:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc1464854 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d9 expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.441840:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc146485b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d9 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.441847:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065082.441850:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065082.441853:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:2.0:1746065082.441901:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:27981:x1830881261573760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 280us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.441906:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12570 00000100:00100000:0.0:1746065082.447264:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.448790:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574016 00000100:00100000:3.0:1746065082.448803:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574016 00000100:00100000:3.0:1746065082.448961:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12571 00000100:00100000:3.0:1746065082.448971:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+297:27981:x1830881261574016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065082.448993:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065082.449014:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464862 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4e0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.449123:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc1464869 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065082.449136:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc1464869 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.449147:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc1464869 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000004:00200000:3.0:1746065082.449163:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 5 00010000:00010000:3.0:1746065082.449266:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464862 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e0 expref: 300 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.452933:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc1464869 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e0 expref: 299 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.452948:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065082.452951:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065082.452954:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:3.0:1746065082.453047:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+299:27981:x1830881261574016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4076us (5792us total) trans 4294975885 rc 0/0 00000100:00100000:3.0:1746065082.453056:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12571 00000100:00100000:0.0:1746065082.463731:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.466386:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574144 00000100:00100000:2.0:1746065082.466403:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574144 00000100:00100000:3.0:1746065082.466546:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8906 00000100:00100000:3.0:1746065082.466557:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+75:2005:x1830881261574144:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065082.466607:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.466711:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 75 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.466720:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065082.466723:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065082.466726:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.466762:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 75 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.466802:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 75 pid: 9548 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746065082.466816:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262684800:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065082.466925:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065082.470428:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.470914:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881262684800:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065082.470943:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065082.471241:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574272 00000100:00100000:2.0:1746065082.471249:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574272 00002000:00100000:2.0:1746065082.471296:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x389:0x0] (0->4) req@ffff88009077f800 x1830881261574272/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:753/0 lens 496/0 e 0 to 0 dl 1746065093 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065082.471305:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881261574272 ext(0->4) 00010000:00010000:2.0:1746065082.471312:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 76 pid: 9548 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.471323:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 76 pid: 9548 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746065082.471328:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077f800 00000100:00100000:2.0:1746065082.471359:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 225 00000100:00100000:2.0:1746065082.471366:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+76:2007:x1830881261574272:12345-192.168.202.27@tcp:4:bash.0 00000100:00100000:2.0:1746065082.473805:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+78:2007:x1830881261574272:12345-192.168.202.27@tcp:4:bash.0 Request processed in 2399us (3348us total) trans 17179872682 rc 0/0 00000100:00100000:2.0:1746065082.473818:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 225 00002000:00100000:2.0:1746065082.473829:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0x389:0x0] (0->4) req@ffff88009077f800 x1830881261574272/t17179872682(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:753/0 lens 496/448 e 0 to 0 dl 1746065093 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1746065082.473844:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881261574272 ext(0->4) 00010000:00010000:2.0:1746065082.473856:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 78 pid: 9548 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.473872:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 78 pid: 9548 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746065082.473880:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077f800 00000100:00100000:0.0:1746065082.483296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.487944:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574400 00000100:00100000:2.0:1746065082.487960:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574400 00010000:00010000:2.0:1746065082.488010:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 78 pid: 9548 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.488056:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3738 00000100:00100000:2.0:1746065082.488064:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+78:2007:x1830881261574400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.488079:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065082.488097:0:10893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1746065082.488100:0:10893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1746065082.488106:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 78 pid: 9548 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.488118:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 78 pid: 9548 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.488141:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc14647f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4bd expref: 78 pid: 9548 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.488177:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.488180:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.488184:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.488192:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.488226:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065082.488281:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+77:2007:x1830881261574400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 218us (4996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.488288:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3738 00010000:00010000:3.0:1746065082.488432:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488442:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488460:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488467:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488473:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488479:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ada00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065082.488483:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488490:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488499:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.488504:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1464877 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065082.488577:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+76:2005:x1830881261574144:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 22022us (24856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065082.488585:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8906 00000100:00100000:0.0:1746065082.492136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.492463:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574656 00000100:00100000:3.0:1746065082.492473:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574656 00000100:00100000:3.0:1746065082.492555:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12572 00000100:00100000:3.0:1746065082.492562:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+299:27981:x1830881261574656:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065082.492618:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065082.492646:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc146485b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4d9 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065082.492665:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065082.492668:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065082.492696:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065082.492710:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:3.0:1746065082.492718:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000040:00080000:3.0:1746065082.492944:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2532, 88 off209336 00000004:00080000:3.0:1746065082.492950:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678511175746ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065082.492990:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2528, 88 off208896 00000004:00080000:3.0:1746065082.492994:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678511220409ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065082.493881:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2529, 88 off208984 00000004:00080000:3.0:1746065082.493888:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678512114332ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065082.494065:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2533, 88 off209424 00000004:00080000:3.0:1746065082.494069:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678512295839ns, next at 678738608678ns, rc = 0 00000001:00080000:0.0:1746065082.498736:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975886 is committed 00000004:00080000:0.0:1746065082.498747:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1709 committed 00000004:00080000:0.0:1746065082.498768:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1699 committed 00000004:00080000:0.0:1746065082.498798:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1698 committed 00000004:00080000:0.0:1746065082.498802:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1708 committed 00010000:00010000:2.0:1746065082.498874:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.498886:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.498892:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.498898:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065082.498903:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.498909:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.498930:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff88012ef2a200) 00010000:00010000:2.0:1746065082.498933:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065082.498938:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.498944:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73200/0xad6b7ddc146483f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065082.499096:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065082.499104:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065082.499113:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262684928:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065082.499114:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262685056:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065082.499253:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.499275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.499303:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685056 00000100:00100000:2.0:1746065082.499311:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685056 00000100:00100000:1.0:1746065082.499317:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262684928 00000100:00100000:1.0:1746065082.499321:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262684928 00000100:00100000:2.0:1746065082.499352:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8907 00000100:00100000:1.0:1746065082.499357:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8908 00000100:00100000:2.0:1746065082.499359:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+190:3759:x1830881262684928:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065082.499363:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+190:3762:x1830881262685056:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.499430:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065082.499437:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262685184:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1746065082.499460:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077dc00 reply state ffff880098369800 transno 4294975886 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT1 00000100:00100000:3.0:1746065082.499461:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.499475:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.499485:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:1.0:1746065082.499488:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065082.499490:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065082.499509:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685184 00000100:00100000:1.0:1746065082.499512:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685184 00000100:00100000:1.0:1746065082.499528:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8909 00000100:00100000:1.0:1746065082.499543:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+156:3761:x1830881262685184:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1746065082.499670:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065082.499673:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:1.0:1746065082.499675:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065082.499677:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:1.0:1746065082.499679:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065082.499720:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+157:3761:x1830881262685184:12345-0@lo:2:osp-syn-0-1.0 Request processed in 186us (257us total) trans 21474839958 rc 0/0 00000100:00100000:1.0:1746065082.499726:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8909 00000100:00100000:0.0:1746065082.499807:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065082.499815:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262685312:0@lo:2:osp-syn-0-1.0 00010000:00080000:1.0:1746065082.499822:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065082.499832:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27981:x1830881261574656:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 7270us (7707us total) trans 4294975886 rc 0/0 00000100:00100000:1.0:1746065082.499839:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12572 00000100:00100000:0.0:1746065082.499841:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065082.499860:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.499866:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.499870:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065082.499870:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685312 00000100:00100000:0.0:1746065082.499873:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685312 00010000:00010000:1.0:1746065082.499875:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.499878:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.499882:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT1 00000100:00100000:0.0:1746065082.499889:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8910 00010000:00010000:1.0:1746065082.499890:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:1.0:1746065082.499892:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065082.499893:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+157:3760:x1830881262685312:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1746065082.499894:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00010000:00010000:1.0:1746065082.499898:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c400/0xad6b7ddc146487e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT1 00002000:00010000:0.0:1746065082.499948:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065082.499950:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065082.499952:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065082.499954:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065082.499955:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065082.499976:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+158:3760:x1830881262685312:12345-0@lo:2:osp-syn-0-1.0 Request processed in 82us (135us total) trans 21474839959 rc 0/0 00000100:00100000:0.0:1746065082.499981:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8910 00000004:00080000:0.0:1746065082.500015:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f100/2, rc 0, transno 21474839959 00000100:00100000:0.0:1746065082.500020:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262685312:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065082.500093:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577ca80/2, rc 0, transno 21474839958 00000100:00100000:3.0:1746065082.500096:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262685184:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1746065082.500420:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+191:3759:x1830881262684928:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1061us (1144us total) trans 17179872683 rc 0/0 00000100:00100000:2.0:1746065082.500426:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8907 00000004:00080000:0.0:1746065082.500510:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dc380/2, rc 0, transno 17179872683 00000100:00100000:0.0:1746065082.500514:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262684928:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1746065082.500643:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065082.500646:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065082.500647:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065082.500649:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065082.500650:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065082.500679:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+191:3762:x1830881262685056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1316us (1426us total) trans 17179872684 rc 0/0 00000100:00100000:1.0:1746065082.500684:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8908 00000004:00080000:3.0:1746065082.500740:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5dd180/2, rc 0, transno 17179872684 00000100:00100000:3.0:1746065082.500743:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262685056:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1746065082.503481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065082.503604:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574784 00000100:00100000:1.0:1746065082.503616:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574784 00000100:00100000:1.0:1746065082.505962:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12573 00000100:00100000:1.0:1746065082.505981:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27981:x1830881261574784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065082.506011:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065082.506033:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4e7 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.506100:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.506114:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.506131:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:1.0:1746065082.506134:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065082.506137:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ccda00, rc 0) 00000100:00100000:1.0:1746065082.506201:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27981:x1830881261574784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 225us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.506207:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12573 00000100:00100000:0.0:1746065082.513471:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.515446:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261574912 00000100:00100000:2.0:1746065082.515460:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261574912 00000100:00100000:2.0:1746065082.515754:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12574 00000100:00100000:2.0:1746065082.515762:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:27981:x1830881261574912:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.515794:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.515814:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc146488c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4ee expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.515882:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc1464893 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065082.515895:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc1464893 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.515906:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc1464893 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065082.515952:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x362:0x0]: returning size 5 00000004:00200000:2.0:1746065082.515956:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065082.515970:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc1464893 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.515995:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc146488c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4ee expref: 293 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.516033:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc1464893 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4ee expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.516339:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065082.516342:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065082.516345:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:2.0:1746065082.516409:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27981:x1830881261574912:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 648us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.516415:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12574 00000100:00100000:1.0:1746065082.521175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.521302:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261575040 00000100:00100000:2.0:1746065082.521313:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261575040 00000100:00100000:2.0:1746065082.521525:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8911 00000100:00100000:2.0:1746065082.521545:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+76:2005:x1830881261575040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065082.521564:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065082.521585:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146489a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4f5 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065082.521610:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x389:0x0] initial LVB size: 5, mtime: 0x6812d6ba, atime: 0x0, ctime: 0x6812d6ba, blocks: 0x8 00010000:00010000:2.0:1746065082.521630:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.521633:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065082.521642:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146489a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4f5 expref: 77 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.521656:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146489a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4f5 expref: 77 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065082.521667:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:2.0:1746065082.521728:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261575040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 195us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.521733:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8911 00000100:00100000:0.0:1746065082.526972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.527085:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261575168 00000100:00100000:2.0:1746065082.527095:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261575168 00000100:00100000:2.0:1746065082.527292:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8912 00000100:00100000:2.0:1746065082.527300:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261575168:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065082.527425:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2005:x1830881261575168:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 125us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.527748:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8912 00000100:00100000:0.0:1746065082.536374:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.536497:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261575296 00000100:00100000:2.0:1746065082.536507:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261575296 00000100:00100000:2.0:1746065082.536566:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8913 00000100:00100000:2.0:1746065082.536574:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2004:x1830881261575296:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065082.538009:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2004:x1830881261575296:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 1430us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.538021:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8913 00000100:00100000:0.0:1746065082.541016:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262685440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065082.541100:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065082.541315:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685440 00000100:00100000:1.0:1746065082.541325:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685440 00000100:00100000:1.0:1746065082.541381:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1746065082.541388:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+191:3760:x1830881262685440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065082.541413:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490335424 pending 200704 free 3920257024 avail 3688734720 00000100:00100000:1.0:1746065082.541450:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+191:3760:x1830881262685440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.541456:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1746065082.542431:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262685440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065082.548156:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.548593:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261575552 00000100:00100000:2.0:1746065082.548604:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261575552 00000100:00100000:2.0:1746065082.548924:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12575 00000100:00100000:2.0:1746065082.548933:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+292:27981:x1830881261575552:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065082.548993:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.549023:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72200/0xad6b7ddc1464893 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x362:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4ee expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.549047:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065082.549052:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065082.549083:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065082.549095:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.549103:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065082.549235:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077ea00 reply state ffff880097df1000 transno 4294975887 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.549244:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065082.549248:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065082.549250:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065082.549253:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065082.549346:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:27981:x1830881261575552:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 414us (1203us total) trans 4294975887 rc 0/0 00000100:00100000:2.0:1746065082.549353:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12575 00000100:00100000:2.0:1746065082.552066:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.552445:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261575680 00000100:00100000:3.0:1746065082.552455:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261575680 00000100:00100000:3.0:1746065082.552510:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8914 00000100:00100000:3.0:1746065082.552519:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+77:2007:x1830881261575680:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065082.552690:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1746065082.552694:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065082.552696:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb atime from disk: 0 -> 1746065082 00002000:00010000:3.0:1746065082.552698:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065082.552700:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1746065082.553563:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+78:2007:x1830881261575680:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 1042us (1504us total) trans 17179872685 rc 0/0 00000100:00100000:3.0:1746065082.553572:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8914 00000100:00100000:0.0:1746065082.555752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.555998:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261575936 00000100:00100000:2.0:1746065082.556009:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261575936 00000100:00100000:2.0:1746065082.556062:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4334 00000100:00100000:2.0:1746065082.556069:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+293:27981:x1830881261575936:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065082.556131:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x240000403:0x362:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc1464869 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e0 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.556177:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065082.556188:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.556194:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.556226:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 293 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065082.556237:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 293 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.556249:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262685568:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065082.556341:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065082.559309:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:16721:1830881262685568:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065082.559337:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000100:00100000:0.0:1746065082.561042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065082.561380:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576064 00000100:00100000:2.0:1746065082.561388:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576064 00010000:00010000:2.0:1746065082.561428:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 294 pid: 7205 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746065082.561458:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3739 00000100:00100000:2.0:1746065082.561465:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261576064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065082.561485:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065082.561490:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 294 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.561501:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 294 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.561658:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464885 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e7 expref: 294 pid: 7205 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746065082.561688:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:2.0:1746065082.561693:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.561702:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.561709:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.561741:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065082.561813:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+293:2004:x1830881261576064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 348us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065082.561820:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3739 00010000:00010000:3.0:1746065082.561974:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.561981:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00000040:00080000:3.0:1746065082.562232:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2534, 88 off209512 00000004:00080000:3.0:1746065082.562239:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678580464011ns, next at 678738608678ns, rc = 0 00000040:00080000:3.0:1746065082.562267:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2530, 88 off209072 00000004:00080000:3.0:1746065082.562271:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678580497051ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065082.562282:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2531, 88 off209160 00000004:00080000:3.0:1746065082.562286:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678580512358ns, next at 678738623360ns, rc = 0 00000040:00080000:3.0:1746065082.562294:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2535, 88 off209600 00000004:00080000:3.0:1746065082.562297:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 678580523275ns, next at 678738608678ns, rc = 0 00000001:00080000:3.0:1746065082.577302:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975888 is committed 00000004:00080000:3.0:1746065082.577318:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1711 committed 00000004:00080000:3.0:1746065082.577744:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1701 committed 00000100:00100000:2.0:1746065082.577887:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262685696:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.577958:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.578009:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065082.578013:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262685824:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1746065082.578029:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065082.578066:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685696 00000100:00100000:2.0:1746065082.578074:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685696 00000100:00100000:2.0:1746065082.578107:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685824 00000100:00100000:2.0:1746065082.578108:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685824 00000100:00100000:2.0:1746065082.578126:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8915 00000100:00100000:2.0:1746065082.578131:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+192:3761:x1830881262685696:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065082.578271:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1746065082.578274:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:2.0:1746065082.578276:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb atime from disk: 1746065082 -> 1746065082 00002000:00010000:2.0:1746065082.578278:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:2.0:1746065082.578280:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x389:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1746065082.578305:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+193:3761:x1830881262685696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (347us total) trans 17179872686 rc 0/0 00000100:00100000:2.0:1746065082.578310:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8915 00000100:00100000:2.0:1746065082.578322:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8916 00000100:00100000:2.0:1746065082.578326:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+192:3761:x1830881262685824:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1746065082.578356:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065082.578358:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.578360:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.578361:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065082.578363:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:3.0:1746065082.579081:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1700 committed 00000004:00080000:3.0:1746065082.579087:0:8342:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1710 committed 00000004:00010000:3.0:1746065082.579150:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077ce00 reply state ffff880099e74800 transno 4294975888 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.579170:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.579179:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065082.579182:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065082.579186:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065082.579191:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065082.579193:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065082.579199:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012c7ac200/0xad6b7ddc1464869 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4e0 expref: 291 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065082.579351:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.579360:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.579366:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.579371:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065082.579376:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.579382:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.579392:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:1.0:1746065082.579395:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065082.579398:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065082.579402:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f72600/0xad6b7ddc14648a1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00080000:3.0:1746065082.579669:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065082.579679:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27981:x1830881261575936:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 23610us (23935us total) trans 4294975888 rc 0/0 00000100:00100000:3.0:1746065082.579687:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4334 00000004:00080000:3.0:1746065082.579745:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098359500/2, rc 0, transno 17179872686 00000100:00100000:3.0:1746065082.579750:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262685696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1746065082.579818:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262685952:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065082.579850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.579883:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065082.579887:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262686080:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1746065082.579901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065082.579920:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262685952 00000100:00100000:3.0:1746065082.579924:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262685952 00000100:00100000:3.0:1746065082.579945:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686080 00000100:00100000:3.0:1746065082.579947:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686080 00000100:00100000:3.0:1746065082.579957:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8917 00000100:00100000:3.0:1746065082.579962:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+159:3759:x1830881262685952:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065082.580069:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065082.580071:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065082.580074:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.580075:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065082 -> 1746065082 00002000:00010000:3.0:1746065082.580077:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065082.580097:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+160:3759:x1830881262685952:12345-0@lo:2:osp-syn-0-1.0 Request processed in 135us (247us total) trans 21474839960 rc 0/0 00000100:00100000:3.0:1746065082.580102:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8917 00000100:00100000:3.0:1746065082.580111:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8918 00000100:00100000:3.0:1746065082.580115:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+159:3759:x1830881262686080:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1746065082.580149:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065082.580151:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.580152:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.580155:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065082.580156:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065082.580171:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+160:3759:x1830881262686080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 55us (269us total) trans 21474839961 rc 0/0 00000100:00100000:3.0:1746065082.580175:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8918 00000004:00080000:3.0:1746065082.580196:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c380/2, rc 0, transno 21474839961 00000100:00100000:3.0:1746065082.580199:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262686080:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1746065082.580204:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c000/2, rc 0, transno 21474839960 00000100:00100000:3.0:1746065082.580207:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262685952:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1746065082.580360:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.580367:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.580373:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.580378:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065082.580380:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.580386:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.580394:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012ef2a000) 00010000:00010000:3.0:1746065082.580396:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065082.580399:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.580403:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f73a00/0xad6b7ddc14648a8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT1 00000100:00100000:3.0:1746065082.586193:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009835b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+193:3761:x1830881262685824:12345-0@lo:2:osp-syn-1-1.0 Request processed in 7853us (8149us total) trans 17179872687 rc 0/0 00000100:00100000:3.0:1746065082.586210:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8916 00000004:00080000:0.0:1746065082.586574:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098359c00/2, rc 0, transno 17179872687 00000100:00100000:0.0:1746065082.586582:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881262685824:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1746065082.586732:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065082.586801:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576192 00000100:00100000:0.0:1746065082.586808:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576192 00000100:00100000:0.0:1746065082.586863:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12576 00000100:00100000:0.0:1746065082.586870:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+289:27981:x1830881261576192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065082.586895:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065082.586918:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14648af lrc: 2/0,0 mode: --/CR res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d4fc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.586978:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14648af lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4fc expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.586991:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d600/0xad6b7ddc14648af lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x362:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d4fc expref: 290 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065082.587011:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012c7ab500) 00010000:00010000:0.0:1746065082.587014:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065082.587017:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d600, rc 0) 00000100:00100000:0.0:1746065082.587064:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27981:x1830881261576192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 196us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065082.587069:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12576 00000100:00100000:0.0:1746065082.590419:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065082.590527:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576448 00000100:00100000:3.0:1746065082.590546:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576448 00000100:00100000:3.0:1746065082.590611:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4335 00000100:00100000:3.0:1746065082.590619:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+290:27981:x1830881261576448:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065082.590893:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x362:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1746065082.590955:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2536, 64 off209664 00000040:00080000:3.0:1746065082.590981:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2532, 64 off209224 00000040:00080000:3.0:1746065082.590990:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].2533, 64 off209288 00000040:00080000:3.0:1746065082.590998:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].2537, 64 off209728 00010000:00010000:3.0:1746065082.591053:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065082.591070:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.591080:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.591088:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.591093:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.591098:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065082.591128:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746065082.591166:0:8351:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065082.591172:0:8351:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.591179:0:8351:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065082.591183:0:8351:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.591190:0:8351:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.591201:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x362:0x0].0x0 (ffff88012c7ab500) 00010000:00010000:2.0:1746065082.591203:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065082.591207:0:8351:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.591211:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44000/0xad6b7ddc14648b6 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x362:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065082.591226:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.591227:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065082.591228:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065082.591302:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+291:27981:x1830881261576448:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 682us (892us total) trans 4294975889 rc 0/0 00000100:00100000:3.0:1746065082.591309:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4335 00000100:00100000:2.0:1746065082.701737:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065082.702008:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262686208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065082.702088:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065082.702590:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686208 00000100:00100000:1.0:1746065082.702599:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686208 00000100:00100000:1.0:1746065082.702639:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1746065082.702646:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+160:3762:x1830881262686208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746065082.702679:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490277184 pending 143360 free 3919237120 avail 3687714816 00000100:00100000:1.0:1746065082.702717:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+160:3762:x1830881262686208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065082.702723:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1746065082.704187:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262686208:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1746065082.739097:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746065083.694454:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872687 is committed 00000001:00080000:0.0:1746065083.694464:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872685 is committed 00010000:00010000:1.0:1746065083.741441:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065084.559929:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065084.559979:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262686336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065084.560027:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065084.560191:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686336 00000100:00100000:0.0:1746065084.560198:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686336 00000100:00100000:0.0:1746065084.560232:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1746065084.560238:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262686336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065084.560264:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445711872 avail 1316249600 00000100:00100000:0.0:1746065084.560310:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262686336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065084.560315:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1746065084.560392:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262686336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746065084.573123:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262686848:0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573176:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065084.573219:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881262687360:0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573239:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065084.573252:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881262687872:0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573266:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065084.573281:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746065084.573285:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830881262686720:0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573304:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065084.573315:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3762:1830881262687232:0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573327:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065084.573337:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881262687744:0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573351:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065084.573375:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687360 00000100:00100000:2.0:1746065084.573380:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687360 00000100:00100000:2.0:1746065084.573415:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687872 00000100:00100000:2.0:1746065084.573417:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687872 00000100:00100000:2.0:1746065084.573424:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686720 00000100:00100000:2.0:1746065084.573426:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686720 00000100:00100000:2.0:1746065084.573433:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687232 00000100:00100000:2.0:1746065084.573434:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687232 00000100:00100000:2.0:1746065084.573446:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1746065084.573452:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881262687360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573488:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881262687360:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065084.573493:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1746065084.573505:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1746065084.573509:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881262687872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573541:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881262687872:12345-0@lo:400:kworker.0 Request processed in 31us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065084.573546:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1746065084.573555:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1746065084.573559:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830881262686720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573576:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830881262686720:12345-0@lo:400:kworker.0 Request processed in 17us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065084.573580:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1746065084.573587:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1746065084.573591:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3762:x1830881262687232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065084.573607:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3762:x1830881262687232:12345-0@lo:400:kworker.0 Request processed in 16us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065084.573611:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1746065084.573632:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686848 00000100:00100000:2.0:1746065084.573635:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686848 00000100:00100000:2.0:1746065084.573650:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687744 00000100:00100000:2.0:1746065084.573652:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687744 00000100:00100000:3.0:1746065084.573709:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881262686464:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.573734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.573759:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262686976:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.573793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.573806:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881262687488:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.573820:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.573833:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1746065084.573837:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262686592:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.573853:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.573863:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881262687104:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.573874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.573880:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262687616:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.573892:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.573906:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686976 00000100:00100000:3.0:1746065084.573908:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686976 00000100:00100000:0.0:1746065084.573969:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687488 00000100:00100000:0.0:1746065084.573972:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687488 00000100:00100000:0.0:1746065084.574106:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687104 00000100:00100000:0.0:1746065084.574108:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687104 00000100:00100000:0.0:1746065084.574120:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1746065084.574124:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881262687488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.574147:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881262687488:12345-0@lo:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065084.574151:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1746065084.574159:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1746065084.574162:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881262687104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.574174:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881262687104:12345-0@lo:400:kworker.0 Request processed in 12us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065084.574178:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1746065084.574200:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881262687104:0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.574207:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881262687488:0@lo:400:kworker.0 00000100:00080000:1.0:1746065084.574302:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065084.574305:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065084.574307:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746065084.574309:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065084.574319:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262687616 00000100:00100000:2.0:1746065084.574325:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262687616 00000100:00100000:1.0:1746065084.574331:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686464 00000100:00100000:1.0:1746065084.574334:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686464 00000100:00100000:1.0:1746065084.574354:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1746065084.574358:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881262686464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065084.574391:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881262686464:12345-0@lo:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065084.574395:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1746065084.575144:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1746065084.575151:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+160:3762:x1830881262686848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575182:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+160:3762:x1830881262686848:12345-0@lo:400:kworker.0 Request processed in 32us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065084.575187:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1746065084.575198:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1746065084.575202:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881262687744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575222:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881262687744:12345-0@lo:400:kworker.0 Request processed in 21us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065084.575226:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1746065084.575233:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1746065084.575237:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881262686976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575251:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881262686976:12345-0@lo:400:kworker.0 Request processed in 14us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065084.575255:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1746065084.575297:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830881262686720:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575305:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3762:1830881262687232:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575312:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881262687744:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575321:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881262686848:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575328:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881262687360:0@lo:400:kworker.0 00000100:00100000:3.0:1746065084.575336:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881262687872:0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.575502:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881262686464:0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.575510:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179872687 gen 2 00000004:00080000:0.0:1746065084.575527:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1500, transno 17179872453 00000100:00100000:2.0:1746065084.575530:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000004:00080000:0.0:1746065084.575533:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3100, transno 17179872454 00000004:00080000:0.0:1746065084.575536:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ea00, transno 17179872455 00000100:00100000:2.0:1746065084.575537:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262687616:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1746065084.575537:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834df80, transno 17179872456 00000004:00080000:0.0:1746065084.575539:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665500, transno 17179872458 00000004:00080000:0.0:1746065084.575541:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665880, transno 17179872459 00000004:00080000:0.0:1746065084.575543:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098667100, transno 17179872460 00000004:00080000:0.0:1746065084.575545:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098666300, transno 17179872461 00000004:00080000:0.0:1746065084.575546:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013189bb80, transno 17179872462 00000004:00080000:0.0:1746065084.575548:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098665f80, transno 17179872463 00000004:00080000:0.0:1746065084.575550:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef24700, transno 17179872465 00000004:00080000:0.0:1746065084.575551:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25500, transno 17179872466 00000004:00080000:0.0:1746065084.575553:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef26680, transno 17179872467 00000004:00080000:0.0:1746065084.575555:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ef25f80, transno 17179872468 00000004:00080000:0.0:1746065084.575557:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098660700, transno 17179872470 00000004:00080000:0.0:1746065084.575559:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661180, transno 17179872471 00000004:00080000:0.0:1746065084.575561:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a2d80, transno 17179872472 00000004:00080000:0.0:1746065084.575564:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a0a80, transno 17179872473 00000004:00080000:0.0:1746065084.575566:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098663480, transno 17179872475 00000004:00080000:0.0:1746065084.575567:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098661880, transno 17179872476 00000100:00100000:2.0:1746065084.575574:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262687616:12345-0@lo:400:kworker.0 Request processed in 37us (1678us total) trans 0 rc 0/0 00000004:00080000:0.0:1746065084.575574:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098662a00, transno 17179872478 00000004:00080000:0.0:1746065084.575575:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098660e00, transno 17179872479 00000004:00080000:0.0:1746065084.575577:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cd880, transno 17179872480 00000004:00080000:0.0:1746065084.575579:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cdc00, transno 17179872481 00000100:00100000:2.0:1746065084.575580:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000004:00080000:0.0:1746065084.575581:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cb800, transno 17179872483 00000004:00080000:0.0:1746065084.575583:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c8000, transno 17179872484 00000004:00080000:0.0:1746065084.575586:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925cb480, transno 17179872485 00000004:00080000:0.0:1746065084.575587:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c9c00, transno 17179872486 00000004:00080000:0.0:1746065084.575589:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800925c9f80, transno 17179872487 00000004:00080000:0.0:1746065084.575592:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131899f80, transno 17179872488 00000004:00080000:0.0:1746065084.575593:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ca80, transno 17179872490 00000004:00080000:0.0:1746065084.575595:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85e300, transno 17179872491 00000004:00080000:0.0:1746065084.575597:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85d180, transno 17179872492 00000004:00080000:0.0:1746065084.575599:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85fb80, transno 17179872493 00000004:00080000:0.0:1746065084.575600:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5880, transno 17179872496 00000004:00080000:0.0:1746065084.575602:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6a00, transno 17179872497 00000004:00080000:0.0:1746065084.575604:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a649f80, transno 17179872499 00000004:00080000:0.0:1746065084.575606:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a64a680, transno 17179872500 00000004:00080000:0.0:1746065084.575608:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982de680, transno 17179872502 00000004:00080000:0.0:1746065084.575610:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dca80, transno 17179872503 00000004:00080000:0.0:1746065084.575611:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dc380, transno 17179872504 00000004:00080000:0.0:1746065084.575613:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d0380, transno 17179872505 00000004:00080000:0.0:1746065084.575615:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dce00, transno 17179872506 00000004:00080000:0.0:1746065084.575617:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982df800, transno 17179872507 00000004:00080000:0.0:1746065084.575619:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982ded80, transno 17179872508 00000004:00080000:0.0:1746065084.575621:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982ddc00, transno 17179872509 00000004:00080000:0.0:1746065084.575623:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d0000, transno 17179872511 00000004:00080000:0.0:1746065084.575625:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d2a00, transno 17179872512 00000100:00100000:1.0:1746065084.575626:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686592 00000004:00080000:0.0:1746065084.575627:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d2300, transno 17179872513 00000004:00080000:0.0:1746065084.575628:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d3800, transno 17179872514 00000100:00100000:1.0:1746065084.575630:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686592 00000004:00080000:0.0:1746065084.575630:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ea00, transno 17179872516 00000004:00080000:0.0:1746065084.575632:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d500, transno 17179872517 00000004:00080000:0.0:1746065084.575633:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3df80, transno 17179872518 00000004:00080000:0.0:1746065084.575635:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3c000, transno 17179872519 00000004:00080000:0.0:1746065084.575637:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90700, transno 17179872521 00000004:00080000:0.0:1746065084.575639:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a92300, transno 17179872522 00000004:00080000:0.0:1746065084.575640:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a93b80, transno 17179872523 00000004:00080000:0.0:1746065084.575642:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a92680, transno 17179872524 00000004:00080000:0.0:1746065084.575643:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d0a80, transno 17179872526 00000004:00080000:0.0:1746065084.575645:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d1500, transno 17179872527 00000004:00080000:0.0:1746065084.575646:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957dad80, transno 17179872528 00000004:00080000:0.0:1746065084.575648:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9880, transno 17179872529 00000100:00100000:1.0:1746065084.575650:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000004:00080000:0.0:1746065084.575650:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9500, transno 17179872530 00000004:00080000:0.0:1746065084.575652:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9180, transno 17179872531 00000004:00080000:0.0:1746065084.575654:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cca80, transno 17179872533 00000100:00100000:1.0:1746065084.575655:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881262686592:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1746065084.575655:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cd500, transno 17179872534 00000004:00080000:0.0:1746065084.575657:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982ce680, transno 17179872535 00000004:00080000:0.0:1746065084.575659:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cf480, transno 17179872536 00000004:00080000:0.0:1746065084.575661:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cd880, transno 17179872537 00000004:00080000:0.0:1746065084.575662:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cc000, transno 17179872538 00000004:00080000:0.0:1746065084.575664:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d1f80, transno 17179872540 00000004:00080000:0.0:1746065084.575666:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6a00, transno 17179872541 00000004:00080000:0.0:1746065084.575667:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ca80, transno 17179872542 00000004:00080000:0.0:1746065084.575669:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37e680, transno 17179872543 00000004:00080000:0.0:1746065084.575671:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37d180, transno 17179872544 00000004:00080000:0.0:1746065084.575673:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ea00, transno 17179872545 00000004:00080000:0.0:1746065084.575675:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ce00, transno 17179872546 00000004:00080000:0.0:1746065084.575677:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37c700, transno 17179872547 00000004:00080000:0.0:1746065084.575679:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df100, transno 17179872550 00000004:00080000:0.0:1746065084.575681:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6ddf80, transno 17179872551 00000004:00080000:0.0:1746065084.575682:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5180, transno 17179872553 00000004:00080000:0.0:1746065084.575684:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5880, transno 17179872554 00000004:00080000:0.0:1746065084.575686:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfd880, transno 17179872555 00000100:00100000:1.0:1746065084.575687:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881262686592:12345-0@lo:400:kworker.0 Request processed in 32us (1833us total) trans 0 rc 0/0 00000004:00080000:0.0:1746065084.575688:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfca80, transno 17179872556 00000004:00080000:0.0:1746065084.575690:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc000, transno 17179872558 00000100:00100000:1.0:1746065084.575692:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000004:00080000:0.0:1746065084.575692:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c000, transno 17179872559 00000004:00080000:0.0:1746065084.575694:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd500, transno 17179872560 00000004:00080000:0.0:1746065084.575696:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd180, transno 17179872561 00000004:00080000:0.0:1746065084.575698:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098358a80, transno 17179872562 00000004:00080000:0.0:1746065084.575700:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098358000, transno 17179872563 00000004:00080000:0.0:1746065084.575701:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5c00, transno 17179872564 00000100:00080000:1.0:1746065084.575703:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746065084.575704:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6a00, transno 17179872565 00000004:00080000:0.0:1746065084.575706:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37d880, transno 17179872567 00000004:00080000:0.0:1746065084.575707:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37c000, transno 17179872568 00000004:00080000:0.0:1746065084.575710:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37f480, transno 17179872569 00000004:00080000:0.0:1746065084.575711:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37fb80, transno 17179872570 00000004:00080000:0.0:1746065084.575713:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37e300, transno 17179872571 00000004:00080000:0.0:1746065084.575715:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37c380, transno 17179872572 00000004:00080000:0.0:1746065084.575717:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835a680, transno 17179872574 00000004:00080000:0.0:1746065084.575719:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3480, transno 17179872575 00000004:00080000:0.0:1746065084.575721:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1880, transno 17179872576 00000004:00080000:0.0:1746065084.575723:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2680, transno 17179872577 00000004:00080000:0.0:1746065084.575724:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf3800, transno 17179872580 00000004:00080000:0.0:1746065084.575726:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1180, transno 17179872581 00000004:00080000:0.0:1746065084.575728:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858f800, transno 17179872583 00000004:00080000:0.0:1746065084.575730:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858e680, transno 17179872584 00000004:00080000:0.0:1746065084.575732:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858f480, transno 17179872585 00000004:00080000:0.0:1746065084.575734:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858df80, transno 17179872586 00000004:00080000:0.0:1746065084.575742:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d17b80, transno 17179872589 00000004:00080000:0.0:1746065084.575744:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aeca680, transno 17179872590 00000004:00080000:0.0:1746065084.575745:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d17100, transno 17179872591 00000004:00080000:0.0:1746065084.575747:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8700, transno 17179872592 00000004:00080000:0.0:1746065084.575749:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5f80, transno 17179872593 00000004:00080000:0.0:1746065084.575751:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb100, transno 17179872594 00000004:00080000:0.0:1746065084.575753:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a2300, transno 17179872596 00000004:00080000:0.0:1746065084.575755:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a0e00, transno 17179872597 00000004:00080000:0.0:1746065084.575757:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a1500, transno 17179872598 00000004:00080000:0.0:1746065084.575759:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a3b80, transno 17179872599 00000004:00080000:0.0:1746065084.575761:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099d14e00, transno 17179872601 00000004:00080000:0.0:1746065084.575763:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fe300, transno 17179872602 00000004:00080000:0.0:1746065084.575765:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2680, transno 17179872603 00000004:00080000:0.0:1746065084.575766:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf3100, transno 17179872604 00000004:00080000:0.0:1746065084.575768:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098359180, transno 17179872605 00000004:00080000:0.0:1746065084.575770:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835ad80, transno 17179872606 00000004:00080000:0.0:1746065084.576835:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835aa00, transno 17179872609 00000004:00080000:0.0:1746065084.576837:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f57b80, transno 17179872610 00000004:00080000:0.0:1746065084.576839:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54e00, transno 17179872611 00000004:00080000:0.0:1746065084.576841:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098359880, transno 17179872612 00000004:00080000:0.0:1746065084.576843:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1880, transno 17179872614 00000004:00080000:0.0:1746065084.576845:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc0e00, transno 17179872615 00000004:00080000:0.0:1746065084.576847:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1f80, transno 17179872616 00000004:00080000:0.0:1746065084.576849:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3100, transno 17179872617 00000004:00080000:0.0:1746065084.576852:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dce00, transno 17179872619 00000004:00080000:0.0:1746065084.576853:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dd500, transno 17179872620 00000004:00080000:0.0:1746065084.576855:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858fb80, transno 17179872621 00000004:00080000:0.0:1746065084.576857:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5df800, transno 17179872622 00000004:00080000:0.0:1746065084.576859:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858c380, transno 17179872623 00000004:00080000:0.0:1746065084.576862:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858d500, transno 17179872625 00000004:00080000:0.0:1746065084.576864:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e52d80, transno 17179872626 00000004:00080000:0.0:1746065084.576866:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e53b80, transno 17179872627 00000004:00080000:0.0:1746065084.576867:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5de300, transno 17179872628 00000004:00080000:0.0:1746065084.576869:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5df100, transno 17179872629 00000004:00080000:0.0:1746065084.576871:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e52a00, transno 17179872631 00000004:00080000:0.0:1746065084.576873:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50e00, transno 17179872632 00000004:00080000:0.0:1746065084.576875:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50700, transno 17179872633 00000004:00080000:0.0:1746065084.576877:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50000, transno 17179872634 00000004:00080000:0.0:1746065084.576879:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009858ed80, transno 17179872637 00000004:00080000:0.0:1746065084.576881:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a2a00, transno 17179872638 00000004:00080000:0.0:1746065084.576883:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cdc00, transno 17179872640 00000004:00080000:0.0:1746065084.576885:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cc380, transno 17179872641 00000004:00080000:0.0:1746065084.576886:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc380, transno 17179872642 00000004:00080000:0.0:1746065084.576888:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7ff480, transno 17179872643 00000004:00080000:0.0:1746065084.576890:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de680, transno 17179872645 00000004:00080000:0.0:1746065084.576893:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dc000, transno 17179872646 00000004:00080000:0.0:1746065084.576895:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dea00, transno 17179872647 00000004:00080000:0.0:1746065084.576897:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd500, transno 17179872648 00000004:00080000:0.0:1746065084.576899:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570f480, transno 17179872649 00000004:00080000:0.0:1746065084.576901:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570f800, transno 17179872650 00000004:00080000:0.0:1746065084.576903:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d880, transno 17179872651 00000004:00080000:0.0:1746065084.576906:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570e680, transno 17179872652 00000004:00080000:0.0:1746065084.576907:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570fb80, transno 17179872655 00000004:00080000:0.0:1746065084.576909:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c700, transno 17179872656 00000004:00080000:0.0:1746065084.576911:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570e300, transno 17179872657 00000004:00080000:0.0:1746065084.576913:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570c380, transno 17179872658 00000004:00080000:0.0:1746065084.576915:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf4380, transno 17179872660 00000004:00080000:0.0:1746065084.576917:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fe680, transno 17179872661 00000004:00080000:0.0:1746065084.576919:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb800, transno 17179872663 00000004:00080000:0.0:1746065084.576922:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec9500, transno 17179872664 00000004:00080000:0.0:1746065084.576924:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c526300, transno 17179872665 00000004:00080000:0.0:1746065084.576926:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acefb80, transno 17179872666 00000004:00080000:0.0:1746065084.576928:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c526a00, transno 17179872667 00000004:00080000:0.0:1746065084.576929:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c526680, transno 17179872668 00000004:00080000:0.0:1746065084.576931:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c527100, transno 17179872669 00000004:00080000:0.0:1746065084.576934:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acedc00, transno 17179872670 00000004:00080000:0.0:1746065084.576936:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c525500, transno 17179872672 00000004:00080000:0.0:1746065084.576938:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c527480, transno 17179872673 00000004:00080000:0.0:1746065084.576941:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c525f80, transno 17179872674 00000004:00080000:0.0:1746065084.576943:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aceed80, transno 17179872675 00000004:00080000:0.0:1746065084.576945:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d180, transno 17179872677 00000004:00080000:0.0:1746065084.576947:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ed0aa00, transno 17179872678 00000004:00080000:0.0:1746065084.576949:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ed09500, transno 17179872679 00000004:00080000:0.0:1746065084.576951:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45aa00, transno 17179872680 00000004:00080000:0.0:1746065084.576953:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dc380, transno 17179872683 00000004:00080000:0.0:1746065084.576955:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dd180, transno 17179872684 00000004:00080000:0.0:1746065084.576957:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098359500, transno 17179872686 00000004:00080000:0.0:1746065084.576959:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098359c00, transno 17179872687 00000100:00100000:0.0:1746065084.577049:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262686976:0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.577078:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262686592:0@lo:400:kworker.0 00000100:00100000:0.0:1746065084.577091:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262687616:0@lo:400:kworker.0 00000004:00080000:3.0:1746065084.577740:0:11455:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 2 changes, 63 in progress, 0 in flight, 123 done 00000004:00080000:3.0:1746065084.577957:0:11455:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 2 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:3.0:1746065084.655006:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065084.655025:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262688000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065084.655085:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.655163:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688000 00000100:00100000:3.0:1746065084.655170:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688000 00000100:00100000:3.0:1746065084.655204:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1746065084.655209:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881262688000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746065084.655235:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445793792 avail 1316331520 00000100:00100000:3.0:1746065084.655266:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881262688000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065084.655270:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1746065084.655299:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881262688000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065084.669406:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065084.669429:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262688128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065084.669500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065084.669569:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688128 00000100:00100000:3.0:1746065084.669579:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688128 00000100:00100000:3.0:1746065084.669744:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1746065084.669751:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262688128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065084.669999:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490277184 pending 143360 free 3919237120 avail 3687714816 00000100:00100000:3.0:1746065084.670061:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881262688128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 311us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065084.670069:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1746065084.670121:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881262688128:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1746065084.690678:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839961 is committed 00000001:00080000:0.0:1746065084.690692:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839957 is committed 00000100:00100000:1.0:1746065084.701416:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262688256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065084.701470:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065084.702124:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688256 00000100:00100000:0.0:1746065084.702132:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688256 00000100:00100000:0.0:1746065084.702174:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1746065084.702181:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262688256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065084.702206:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490134720 pending 0 free 3920252928 avail 3688730624 00000100:00100000:0.0:1746065084.702240:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881262688256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065084.702245:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1746065084.702309:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881262688256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1746065084.743496:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065084.958266:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065084.958469:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576576 00000100:00100000:0.0:1746065084.958476:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576576 00000100:00100000:0.0:1746065084.958553:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12577 00000100:00100000:0.0:1746065084.958559:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+291:28451:x1830881261576576:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:0.0:1746065084.958578:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065084.958605:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14648bd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d503 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065084.958661:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065084.958671:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958680:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958691:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065084.958696:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958704:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958736:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958740:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958745:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958749:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958754:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800906c5600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065084.958756:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958761:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958769:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff880090dc5800) 00010000:00010000:0.0:1746065084.958771:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065084.958793:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958798:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800906c5600/0xad6b7ddc14648c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958816:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958820:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958825:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958828:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a656e400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065084.958830:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958834:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958838:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff880090dc5900) 00010000:00010000:0.0:1746065084.958839:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065084.958841:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958844:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a656e400/0xad6b7ddc14648cb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065084.958867:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14648bd lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d503 expref: 292 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065084.958873:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f877000/0xad6b7ddc14648bd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d503 expref: 292 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065084.958883:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:0.0:1746065084.958921:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+291:28451:x1830881261576576:12345-192.168.202.27@tcp:101:rm.0 Request processed in 362us (662us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065084.958927:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12577 00000100:00080000:1.0:1746065084.959063:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065084.961696:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065084.962363:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576704 00000100:00100000:3.0:1746065084.962374:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576704 00000100:00100000:3.0:1746065084.962427:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12578 00000100:00100000:3.0:1746065084.962436:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:28451:x1830881261576704:12345-192.168.202.27@tcp:101:rm.0 00010000:00010000:3.0:1746065084.962460:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065084.962483:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e200/0xad6b7ddc14648d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d50a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065084.962560:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065084.962573:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962584:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962595:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065084.962600:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962605:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962647:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962652:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962658:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962663:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962667:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065084.962670:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962677:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962687:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0x0 (ffff8800982d5500) 00010000:00010000:3.0:1746065084.962690:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065084.962694:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962698:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e600/0xad6b7ddc14648d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962724:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962729:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962734:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962738:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065084.962740:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962747:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962753:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5:0x0].0xbac14b83 (ffff8800982d5a00) 00010000:00010000:3.0:1746065084.962755:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065084.962757:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962761:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993f200/0xad6b7ddc14648e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5:0x0].0xbac14b83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065084.962811:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e200/0xad6b7ddc14648d2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d50a expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065084.962818:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009993e200/0xad6b7ddc14648d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d50a expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065084.962828:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e200, rc 0) 00000100:00100000:3.0:1746065084.962877:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:28451:x1830881261576704:12345-192.168.202.27@tcp:101:rm.0 Request processed in 442us (1193us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065084.962883:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12578 00010000:00010000:2.0:1746065085.744950:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065085.829632:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065085.829680:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065085.829706:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576832 00000100:00100000:0.0:1746065085.829710:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065085.829714:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576832 00000100:00100000:0.0:1746065085.829744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065085.829765:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 136 00000100:00100000:3.0:1746065085.829795:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124d38bc-0f92-4827-84b7-a543154654fd+9:2006:x1830881261576832:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065085.829795:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577088 00000100:00100000:0.0:1746065085.829799:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577088 00000100:00100000:0.0:1746065085.829829:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577216 00000100:00100000:0.0:1746065085.829831:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577216 00000100:00100000:0.0:1746065085.829845:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 560 00000100:00100000:3.0:1746065085.829847:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124d38bc-0f92-4827-84b7-a543154654fd+9:2006:x1830881261576832:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065085.829851:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+18:2006:x1830881261577088:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065085.829853:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 136 00000100:00100000:0.0:1746065085.829883:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+18:2006:x1830881261577088:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065085.829889:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 561 00000100:00100000:3.0:1746065085.829901:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881261577216:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065085.829925:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881261577216:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 30us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065085.830114:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261576960 00000100:00100000:1.0:1746065085.830118:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261576960 00000100:00100000:1.0:1746065085.830285:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 894 00000100:00100000:1.0:1746065085.830292:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261576960:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065085.830322:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261576960:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065085.830526:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 894 00000100:00080000:1.0:1746065085.830545:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065085.830549:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065085.830550:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065085.830661:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 560 00000100:00100000:3.0:1746065085.830668:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 561 00000001:02000400:2.0:1746065085.961264:0:12546:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 70a: flr mode fsx test ================ 22:04:45 (1746065085) 00000100:00100000:0.0:1746065086.038287:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.038360:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577344 00000100:00100000:0.0:1746065086.038369:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577344 00000100:00100000:0.0:1746065086.038412:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12579 00000100:00100000:0.0:1746065086.038419:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+20:28626:x1830881261577344:12345-192.168.202.27@tcp:41:stat.0 00000004:00000024:0.0:1746065086.038462:0:9571:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839490048 avail 7376302080 00000100:00100000:0.0:1746065086.038917:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+20:28626:x1830881261577344:12345-192.168.202.27@tcp:41:stat.0 Request processed in 497us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065086.038924:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12579 00000100:00100000:3.0:1746065086.086834:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.086863:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577472 00000100:00100000:3.0:1746065086.086870:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577472 00000100:00100000:3.0:1746065086.086913:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12580 00000100:00100000:3.0:1746065086.086921:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+20:28630:x1830881261577472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065086.086936:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.086951:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc14648e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d511 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.086997:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087007:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087017:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087027:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087032:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087036:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087069:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087073:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087078:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087082:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087086:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5cea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065086.087088:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087093:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087101:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065086.087103:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.087106:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087110:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14648ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087121:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087126:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087129:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087133:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5ce800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065086.087135:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087139:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087143:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a0adff4 (ffff8800982d5200) 00010000:00010000:3.0:1746065086.087144:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.087146:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087149:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14648f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.087171:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc14648e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d511 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.087177:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc14648e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d511 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.087183:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6f400, rc 0) 00000100:00100000:3.0:1746065086.087219:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+20:28630:x1830881261577472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 299us (393us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065086.087225:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12580 00000100:00100000:2.0:1746065086.089818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.089923:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577728 00000100:00100000:0.0:1746065086.089930:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577728 00000100:00100000:0.0:1746065086.090288:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12581 00000100:00100000:0.0:1746065086.090295:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+20:28630:x1830881261577728:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065086.090332:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065086.090351:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af08000/0xad6b7ddc1434a83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd91dfe0 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065086.090364:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065086.090367:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065086.090412:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.090421:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.090428:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.090436:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1464903 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.090440:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1464903 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.090445:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1464903 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000040:00080000:0.0:1746065086.091075:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].7, 2160 off42304 00000040:00080000:0.0:1746065086.091127:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x240000404:0x2:0x0].5, 2360 off42624 00000004:00080000:0.0:1746065086.091131:0:9571:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880131535780 with version 15 00000004:00080000:1.0:1746065086.092752:0:8150:0:(osp_trans.c:1327:osp_get_next_request()) ou ffff88009a93c240 version 15 rpc_version 15 00000020:00100000:1.0:1746065086.092803:0:8150:0:(genops.c:2421:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1746065086.092811:0:8150:0:(client.c:764:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009a5ddc00 x1830881262688512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1746065086.092831:0:8150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5ddc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8150:1830881262688512:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1746065086.092883:0:8150:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065086.093306:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688512 00000100:00100000:0.0:1746065086.093312:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688512 00000100:00100000:1.0:1746065086.093927:0:8150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065086.094035:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1746065086.094043:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8150:x1830881262688512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1746065086.094446:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8150:x1830881262688512:12345-0@lo:1000:osp_up1-0.0 Request processed in 403us (1562us total) trans 4294975890 rc 0/0 00000100:00100000:0.0:1746065086.094453:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1746065086.094632:0:8150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5ddc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8150:1830881262688512:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1746065086.094993:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc146490a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095005:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc146490a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095014:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc146490a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095029:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc1464911 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095036:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc1464911 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095040:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc1464911 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095062:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095067:0:9571:0:(ldlm_request.c:1021:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.095074:0:9571:0:(ldlm_request.c:1108:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065086.095087:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9571:1830881262688640:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1746065086.095110:0:9571:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065086.096129:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688640 00000100:00100000:3.0:1746065086.096135:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688640 00000100:00100000:3.0:1746065086.096170:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1746065086.096177:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9571:x1830881262688640:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1746065086.096193:0:8357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.096206:0:8357:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 2/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad6b7ddc1464918 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.096221:0:8357:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xad6b7ddc1464918 expref: 7 pid: 8357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.096232:0:8357:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad6b7ddc1464918 expref: 7 pid: 8357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.096238:0:8357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff8800982d5400) 00010000:00010000:3.0:1746065086.096241:0:8357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.096243:0:8357:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce800, rc 0) 00000100:00100000:3.0:1746065086.096268:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:9571:x1830881262688640:12345-0@lo:101:mdt00_004.0 Request processed in 91us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.096272:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1746065086.096832:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065086.096852:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9571:1830881262688640:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1746065086.096864:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065086.096877:0:9571:0:(ldlm_request.c:783:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1746065086.096896:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc2a00 reply state ffff88009c234000 transno 8589934817 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc1464911 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096904:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc1464911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096910:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff880090dc5600) 00010000:00010000:0.0:1746065086.096912:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065086.096914:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065086.096919:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065086.096925:0:9571:0:(ldlm_lock.c:914:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065086.096934:0:9571:0:(osp_object.c:1377:osp_invalidate()) Invalidate osp_object [0x240000404:0x6:0x0] 00000004:00010000:0.0:1746065086.096939:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc2a00 reply state ffff88009c234000 transno 8589934817 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc146490a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096944:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc146490a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096949:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff880090dc5500) 00010000:00010000:0.0:1746065086.096951:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065086.096952:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1746065086.096956:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2c:0x0]: returning size 4096 00010000:00010000:0.0:1746065086.096964:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096972:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096977:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096982:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096987:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a656e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065086.096990:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.096995:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.097003:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065086.097004:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065086.097007:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.097011:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc14648fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000004:00010000:0.0:1746065086.097021:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cc2a00 reply state ffff88009c234000 transno 8589934817 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1464903 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.097027:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1464903 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.097032:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a0adff4 (ffff880090dc5a00) 00010000:00010000:0.0:1746065086.097033:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746065086.097035:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1746065086.097093:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+21:28630:x1830881261577728:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 6796us (7279us total) trans 8589934817 rc 0/0 00000100:00100000:0.0:1746065086.097099:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12581 00000100:00100000:0.0:1746065086.137112:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.137181:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577856 00000100:00100000:2.0:1746065086.137189:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577856 00000100:00100000:2.0:1746065086.137241:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12582 00000100:00100000:2.0:1746065086.137248:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+21:28633:x1830881261577856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065086.137268:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.137282:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc1464926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d518 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.137337:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146492d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.137347:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146492d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.137356:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146492d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065086.137402:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1746065086.137405:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065086.137418:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146492d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.137435:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc1464926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d518 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.137467:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146492d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d518 expref: 22 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.137475:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065086.137477:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065086.137480:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c400, rc 0) 00000100:00100000:2.0:1746065086.137527:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+22:28633:x1830881261577856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 279us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.137533:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12582 00000100:00100000:0.0:1746065086.142845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.142956:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261577984 00000100:00100000:3.0:1746065086.142964:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261577984 00000100:00100000:3.0:1746065086.143012:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12583 00000100:00100000:3.0:1746065086.143019:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+22:28633:x1830881261577984:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065086.143036:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.143054:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d51f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.143099:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143109:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143120:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143129:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143133:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143138:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143190:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f800/0xad6b7ddc1464949 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143195:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f800/0xad6b7ddc1464949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143199:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f800/0xad6b7ddc1464949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065086.143247:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2c:0x0]: returning size 4096 00000004:00200000:3.0:1746065086.143250:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1746065086.143261:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f800/0xad6b7ddc1464949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143268:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143272:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143277:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143284:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143288:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5ce400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065086.143291:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143295:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143303:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065086.143305:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.143308:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143312:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce400/0xad6b7ddc146493b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143325:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143330:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143333:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143337:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065086.143339:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143343:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143353:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a0adff4 (ffff880090dc5a00) 00010000:00010000:3.0:1746065086.143355:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.143357:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143361:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f400/0xad6b7ddc1464942 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a0adff4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.143378:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d51f expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.143388:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6f800/0xad6b7ddc1464949 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d51f expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.143394:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff880090dc5500) 00010000:00010000:3.0:1746065086.143396:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746065086.143398:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6f800, rc 0) 00000100:00100000:3.0:1746065086.143443:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+23:28633:x1830881261577984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 423us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.143448:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12583 00000100:00100000:0.0:1746065086.144959:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.145027:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261578112 00000100:00100000:2.0:1746065086.145033:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261578112 00000100:00100000:2.0:1746065086.145071:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12584 00000100:00100000:2.0:1746065086.145078:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+23:28633:x1830881261578112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065086.145089:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.145100:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d200/0xad6b7ddc1464950 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d526 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.145129:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc1464957 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.145138:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc1464957 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.145146:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc1464957 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065086.145174:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000bd0:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1746065086.145177:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065086.145195:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d200/0xad6b7ddc1464950 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d526 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.145210:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc1464957 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d526 expref: 24 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.145217:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff880090dc5600) 00010000:00010000:2.0:1746065086.145219:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065086.145222:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d400, rc 0) 00000100:00100000:2.0:1746065086.145259:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+24:28633:x1830881261578112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 182us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.145265:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12584 00000100:00100000:0.0:1746065086.147434:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.147521:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261578240 00000100:00100000:3.0:1746065086.147527:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261578240 00000100:00080000:1.0:1746065086.147800:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065086.149197:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12585 00000100:00100000:3.0:1746065086.149208:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:28633:x1830881261578240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065086.149225:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.149241:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146495e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d52d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.149290:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.149300:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xad6b7ddc1464918 expref: 6 pid: 8357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.149306:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.149327:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xad6b7ddc1464918 expref: 6 pid: 8357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065086.149337:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262688768:0@lo:104: 00000100:00100000:3.0:1746065086.149374:0:7231:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065086.149824:0:8350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688768 00000100:00100000:0.0:1746065086.149829:0:8350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688768 00000100:00100000:0.0:1746065086.151235:0:8350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1746065086.151244:0:8350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:7231:x1830881262688768:12345-0@lo:104: 00010000:00010000:0.0:1746065086.151255:0:8350:0:(ldlm_lockd.c:2491:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065086.151348:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098000600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065086.151368:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262688768:0@lo:104: 00010000:00010000:3.0:1746065086.151381:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065086.151767:0:8350:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1746065086.151790:0:8350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:7231:x1830881262688768:12345-0@lo:104: Request processed in 531us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065086.151795:0:8350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00010000:1.0:1746065086.152480:0:7194:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746065086.152486:0:7194:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.152494:0:7194:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b000 already unused, calling callback (ffffffffa0f21e30) 00010000:00010000:1.0:1746065086.152498:0:7194:0:(ldlm_request.c:1284:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1746065086.152513:0:7194:0:(mdt_handler.c:3930:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.152540:0:7194:0:(ldlm_request.c:1331:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.152544:0:7194:0:(ldlm_request.c:1377:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1746065086.152568:0:7194:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.152574:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88012f84b000/0xad6b7ddc1464918 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xad6b7ddc146491f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.152593:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065086.152594:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065086.152596:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065086.152687:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881262688896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1746065086.152722:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065086.152798:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688896 00000100:00100000:3.0:1746065086.152804:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688896 00010000:00010000:3.0:1746065086.152822:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xad6b7ddc1464918 expref: 7 pid: 8357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065086.152839:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1746065086.152844:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3762:x1830881262688896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1746065086.152852:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1746065086.155316:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975890 is committed 00000001:00080000:0.0:1746065086.155326:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975889 is committed 00010000:00010000:3.0:1746065086.155538:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5ce800/0xad6b7ddc146491f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xad6b7ddc1464918 expref: 6 pid: 8357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.155562:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff8800982d5400) 00010000:00010000:3.0:1746065086.155566:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.155574:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.155580:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.158154:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065086.158236:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881262688896:12345-0@lo:103:ldlm_bl.0 Request processed in 5386us (5508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.158246:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:0.0:1746065086.158341:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881262688896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1746065086.158438:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.158445:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065086.158494:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000404:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1746065086.158508:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1746065086.158547:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146495e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d52d expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.159804:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d52d expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.159815:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff8800982d5400) 00010000:00010000:2.0:1746065086.159817:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1746065086.159820:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:2.0:1746065086.160446:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:28633:x1830881261578240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11239us (13016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.160454:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12585 00000100:00100000:1.0:1746065086.167199:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.167299:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261578368 00000100:00100000:2.0:1746065086.167307:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261578368 00000100:00100000:2.0:1746065086.167349:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12586 00000100:00100000:2.0:1746065086.167355:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:28633:x1830881261578368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065086.167370:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.167385:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146496c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d534 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.167436:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.167451:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167459:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167485:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.167491:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167497:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167563:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167569:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167574:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167579:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167584:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065086.167587:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167593:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167602:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff8800982d5400) 00010000:00010000:2.0:1746065086.167606:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065086.167609:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167614:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc1464973 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167623:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167627:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167632:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167635:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065086.167637:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167642:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167646:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a0ae006 (ffff880098c65000) 00010000:00010000:2.0:1746065086.167648:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065086.167650:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167654:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc146497a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.167675:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146496c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d534 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.167687:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146496c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d534 expref: 292 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.167695:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9ce00, rc 0) 00000100:00100000:2.0:1746065086.167743:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+291:28633:x1830881261578368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 387us (551us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065086.167748:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12586 00000100:00100000:0.0:1746065086.171716:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.171834:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261578496 00000100:00100000:2.0:1746065086.171841:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261578496 00000100:00100000:2.0:1746065086.171890:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12587 00000100:00100000:2.0:1746065086.171897:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+24:28633:x1830881261578496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065086.171912:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.171927:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc1464981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d53b expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.171974:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c200/0xad6b7ddc1464988 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.171984:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c200/0xad6b7ddc1464988 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.171992:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c200/0xad6b7ddc1464988 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065086.172098:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2c:0x0]: returning size 4096 00000004:00200000:2.0:1746065086.172101:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1746065086.172115:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c200/0xad6b7ddc1464988 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.172135:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc1464981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d53b expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.172150:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c200/0xad6b7ddc1464988 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d53b expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.172156:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2c:0x0].0x0 (ffff880090dc5500) 00010000:00010000:2.0:1746065086.172159:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065086.172161:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c200, rc 0) 00000100:00100000:2.0:1746065086.172208:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+25:28633:x1830881261578496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 311us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.172213:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12587 00000100:00100000:0.0:1746065086.174438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.174520:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261578752 00000100:00100000:2.0:1746065086.174527:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261578752 00000100:00100000:2.0:1746065086.174558:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12588 00000100:00100000:2.0:1746065086.174564:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+291:28633:x1830881261578752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065086.174577:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.174579:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065086.174596:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1464965 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d52d expref: 291 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.174609:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff8800982d5400) 00010000:00010000:2.0:1746065086.174618:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.174627:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146498f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d542 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.174697:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.174912:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.174920:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.174931:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.174936:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.174940:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175217:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.175224:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175230:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065086.175237:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 0 00010000:00010000:2.0:1746065086.175253:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175258:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175263:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175268:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175273:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9cc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065086.175276:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175281:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175287:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff880098c65500) 00010000:00010000:2.0:1746065086.175289:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065086.175292:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175296:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9cc00/0xad6b7ddc1464996 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00000004:00010000:2.0:1746065086.175304:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a6dc000 reply state ffff880098594000 transno 4294975891 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175311:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.175316:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a0ae006 (ffff880098c65400) 00010000:00010000:2.0:1746065086.175317:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.175319:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065086.175336:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9c800/0xad6b7ddc146498f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 293 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.175348:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 292 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.175354:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65700) 00010000:00010000:2.0:1746065086.175356:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.175358:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d800, rc 0) 00000100:00100000:2.0:1746065086.175408:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+293:28633:x1830881261578752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 844us (975us total) trans 4294975891 rc 0/0 00000100:00100000:2.0:1746065086.175414:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12588 00000100:00100000:0.0:1746065086.177655:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.177730:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261579008 00000100:00100000:2.0:1746065086.177737:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261579008 00000100:00100000:2.0:1746065086.177769:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12589 00000100:00100000:2.0:1746065086.177799:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+293:28633:x1830881261579008:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065086.177818:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.177830:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14649b2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d549 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.177902:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.177913:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 294 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.177919:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.177942:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 294 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.177952:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 294 pid: 9571 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746065086.177961:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262689024:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065086.178145:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065086.179984:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.180071:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262689024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065086.180098:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000100:00100000:3.0:1746065086.180157:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261579136 00000100:00100000:3.0:1746065086.180163:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261579136 00010000:00010000:3.0:1746065086.180185:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 295 pid: 9571 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746065086.180205:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3741 00000100:00100000:3.0:1746065086.180211:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+295:2004:x1830881261579136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065086.180220:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065086.180225:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 295 pid: 9571 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746065086.180237:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 295 pid: 9571 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746065086.180254:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d800/0xad6b7ddc14649a4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d542 expref: 295 pid: 9571 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746065086.180384:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65700) 00010000:00010000:3.0:1746065086.180389:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065086.180397:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065086.180402:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065086.180510:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.180587:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180593:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065086.180611:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 0 00000100:00100000:3.0:1746065086.180690:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881261579136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 476us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.180697:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3741 00000004:00080000:2.0:1746065086.180736:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x38a:0x0], index 0: 0 00000004:00080000:2.0:1746065086.180741:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x38b:0x0], index 1: 0 00010000:00010000:2.0:1746065086.180846:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180853:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180858:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180863:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065086.180866:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180871:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180878:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65700) 00010000:00010000:2.0:1746065086.180880:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065086.180884:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180888:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d000/0xad6b7ddc14649b9 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.180921:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14649b2 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d549 expref: 294 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.180928:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9d200/0xad6b7ddc14649b2 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d549 expref: 294 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.180938:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d200, rc 0) 00000100:00100000:2.0:1746065086.180957:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+293:28633:x1830881261579008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3159us (3308us total) trans 4294975892 rc 301/301 00000100:00100000:2.0:1746065086.180962:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12589 00000100:00100000:0.0:1746065086.183022:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.183664:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261579392 00000100:00100000:1.0:1746065086.183672:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261579392 00000100:00100000:1.0:1746065086.183716:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4336 00000100:00100000:1.0:1746065086.183723:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+293:28633:x1830881261579392:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065086.184071:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:28633:x1830881261579392:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 347us (1053us total) trans 4294975893 rc 0/0 00000100:00100000:1.0:1746065086.184078:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4336 00000100:00100000:0.0:1746065086.185476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.185564:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261579648 00000100:00100000:1.0:1746065086.185569:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261579648 00000100:00100000:1.0:1746065086.185603:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4337 00000100:00100000:1.0:1746065086.185608:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+294:28633:x1830881261579648:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065086.185710:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+295:28633:x1830881261579648:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 101us (236us total) trans 4294975894 rc 0/0 00000100:00100000:1.0:1746065086.185715:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4337 00000100:00100000:0.0:1746065086.225125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.225844:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261579904 00000100:00100000:2.0:1746065086.225852:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261579904 00000100:00100000:2.0:1746065086.225896:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12590 00000100:00100000:2.0:1746065086.225903:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+295:28634:x1830881261579904:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.225922:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.225939:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc14649c7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d550 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.226039:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.226049:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.226058:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.226067:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.227049:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227062:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227109:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2600/0xad6b7ddc14649dc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.227116:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2600/0xad6b7ddc14649dc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227122:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2600/0xad6b7ddc14649dc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065086.227129:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 0 00010000:00010000:2.0:1746065086.227190:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227195:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227200:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227205:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227210:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090176400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065086.227212:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227221:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227231:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff880098c65a00) 00010000:00010000:2.0:1746065086.227233:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065086.227236:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.227241:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090176400/0xad6b7ddc14649ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228935:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228947:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228953:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228957:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065086.228960:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228965:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228975:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a0ae006 (ffff880098c65400) 00010000:00010000:2.0:1746065086.228978:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065086.228980:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.228984:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800b53d1000/0xad6b7ddc14649d5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.229047:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880090176600/0xad6b7ddc14649c7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d550 expref: 298 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.229062:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2600/0xad6b7ddc14649dc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d550 expref: 297 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.229068:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.229069:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.229071:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2600, rc 0) 00000100:00100000:2.0:1746065086.229144:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+297:28634:x1830881261579904:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 3241us (4025us total) trans 4294975895 rc 0/0 00000100:00100000:2.0:1746065086.229152:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12590 00000100:00100000:0.0:1746065086.235497:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.235743:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580032 00000100:00100000:2.0:1746065086.235750:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580032 00000100:00100000:2.0:1746065086.235807:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12591 00000100:00100000:2.0:1746065086.235814:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+297:28634:x1830881261580032:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.235831:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.235845:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14649ea lrc: 2/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d557 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.235869:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.235878:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.235887:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.235962:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3000/0xad6b7ddc14649ea lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.235991:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 298 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.235998:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.236000:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065086.236003:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:2.0:1746065086.236037:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+298:28634:x1830881261580032:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 224us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.236042:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12591 00000100:00100000:0.0:1746065086.242164:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.242250:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580288 00000100:00100000:2.0:1746065086.242258:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580288 00000100:00100000:2.0:1746065086.242410:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12592 00000100:00100000:2.0:1746065086.242417:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:28634:x1830881261580288:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.242460:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.242481:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2600/0xad6b7ddc14649dc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d550 expref: 298 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.242655:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.242660:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.243386:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.243397:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.243409:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.243443:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975896 00000004:00010000:2.0:1746065086.243460:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925cce00 reply state ffff880097df6000 transno 4294975897 ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.243468:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.243473:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.243476:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.243478:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.243557:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+300:28634:x1830881261580288:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 1139us (1397us total) trans 4294975897 rc 0/0 00000100:00100000:2.0:1746065086.243563:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12592 00000020:00080000:2.0:1746065086.243567:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.245693:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.245900:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580416 00000100:00100000:2.0:1746065086.245906:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580416 00000100:00100000:2.0:1746065086.245944:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12593 00000100:00100000:2.0:1746065086.245950:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+300:28634:x1830881261580416:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.245966:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.245977:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14649ff lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d55e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.246224:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14649ff lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d55e expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.246234:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14649ff lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d55e expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.246487:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.246491:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065086.246493:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:2.0:1746065086.246809:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+301:28634:x1830881261580416:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 601us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.246817:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12593 00000100:00100000:0.0:1746065086.249732:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.249986:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580544 00000100:00100000:2.0:1746065086.249993:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580544 00000100:00100000:2.0:1746065086.250363:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8919 00000100:00100000:2.0:1746065086.250371:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+18:28634:x1830881261580544:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.250385:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.250399:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d565 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065086.250416:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065086.250483:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.250485:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.250493:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.250517:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.250526:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2400, rc 0) 00000100:00100000:2.0:1746065086.250990:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+19:28634:x1830881261580544:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 618us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.251000:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8919 00000100:00100000:0.0:1746065086.254841:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.255049:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580672 00000100:00100000:2.0:1746065086.255056:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580672 00000100:00100000:2.0:1746065086.255389:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8920 00000100:00100000:2.0:1746065086.255397:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:28634:x1830881261580672:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.255412:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.255428:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1464a0d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d56c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065086.255448:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x38b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065086.255604:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.255606:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.255613:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1464a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d56c expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.255628:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc1464a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d56c expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.255637:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:2.0:1746065086.255681:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:28634:x1830881261580672:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 285us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.255687:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8920 00000100:00100000:0.0:1746065086.258664:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.259162:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.259181:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580928 00000100:00100000:2.0:1746065086.259189:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580928 00002000:00010000:2.0:1746065086.259223:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.259227:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cf480 with x1830881261580928 ext(0->18446744073709551615) 00000100:00100000:3.0:1746065086.259410:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261580800 00000100:00100000:3.0:1746065086.259414:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261580800 00002000:00010000:3.0:1746065086.259427:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00010000:2.0:1746065086.259448:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925cf480. 00000100:00100000:2.0:1746065086.259468:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1305 00000100:00100000:2.0:1746065086.259475:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881261580928:12345-192.168.202.27@tcp:10:fsx.0 00002000:00100000:3.0:1746065086.259528:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cca80 with x1830881261580800 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.259534:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cca80. 00000100:00100000:3.0:1746065086.259558:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1306 00000100:00100000:3.0:1746065086.259563:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881261580800:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.259709:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.259712:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 1746065086 00002000:00010000:3.0:1746065086.259715:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.259717:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 1746065086 00002000:00010000:3.0:1746065086.259718:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.259759:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261580800:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 195us (597us total) trans 21474839962 rc 0/0 00000100:00100000:3.0:1746065086.259766:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1306 00002000:00010000:3.0:1746065086.259769:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.259787:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cca80 with x1830881261580800 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.259791:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cca80. 00002000:00010000:2.0:1746065086.260027:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.260030:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 0 -> 1746065086 00002000:00010000:2.0:1746065086.260032:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.260034:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 0 -> 1746065086 00002000:00010000:2.0:1746065086.260036:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.260066:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881261580928:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 591us (1409us total) trans 17179872688 rc 0/0 00000100:00100000:2.0:1746065086.260073:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1305 00002000:00010000:2.0:1746065086.260076:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.260078:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cf480 with x1830881261580928 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.260082:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925cf480. 00000100:00100000:0.0:1746065086.263427:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.263533:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261581184 00000100:00100000:2.0:1746065086.263540:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261581184 00000100:00100000:2.0:1746065086.263579:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12594 00000100:00100000:2.0:1746065086.263585:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+301:28634:x1830881261581184:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.263603:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.263713:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45e00/0xad6b7ddc1464a14 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d573 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.263999:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.264013:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264022:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264227:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x6:0x0].0x503ec310 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.264234:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264241:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00080000:3.0:1746065086.264457:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x38b:0x0], index 0: 0 00010000:00010000:3.0:1746065086.264560:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6200/0xad6b7ddc1464a29 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x366:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.264567:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6200/0xad6b7ddc1464a29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x366:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264573:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6200/0xad6b7ddc1464a29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x366:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264595:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264600:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264606:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264611:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264616:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065086.264618:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264624:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264632:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff880098c65a00) 00010000:00010000:3.0:1746065086.264635:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.264637:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 3/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264642:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7000/0xad6b7ddc1464a1b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065086.264671:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925cfb80 reply state ffff88008ec50000 transno 4294975898 ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264678:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.264683:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x503ec310 (ffff8800a3f1da00) 00010000:00010000:3.0:1746065086.264685:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065086.264687:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065086.264710:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45e00/0xad6b7ddc1464a14 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d573 expref: 304 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.264726:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae6200/0xad6b7ddc1464a29 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x366:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d573 expref: 303 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.264732:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x366:0x0].0x0 (ffff88013527f300) 00010000:00010000:3.0:1746065086.264734:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065086.264736:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6200, rc 0) 00000100:00100000:3.0:1746065086.264807:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+304:28634:x1830881261581184:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 1222us (1389us total) trans 4294975898 rc 0/0 00000100:00100000:3.0:1746065086.264813:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12594 00000100:00100000:0.0:1746065086.267080:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.267253:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261581440 00000100:00100000:3.0:1746065086.267260:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261581440 00000100:00100000:3.0:1746065086.267294:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12595 00000100:00100000:3.0:1746065086.267300:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+25:28634:x1830881261581440:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065086.267316:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.267319:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065086.267338:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc1464957 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d526 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.267353:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff880090dc5600) 00010000:00010000:3.0:1746065086.267357:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065086.267367:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc1464a37 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d57a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.267455:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267467:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267475:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267485:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1464a45 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0x54dabb10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267490:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1464a45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x54dabb10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267495:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1464a45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x54dabb10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00080000:3.0:1746065086.267837:0:7231:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6c:0x0], index 1: 0 00010000:00010000:3.0:1746065086.267940:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f7c00/0xad6b7ddc1464a4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267947:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f7c00/0xad6b7ddc1464a4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267953:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f7c00/0xad6b7ddc1464a4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267978:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267984:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267989:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267994:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.267999:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5cea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065086.268002:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.268008:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.268015:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff880090dc5600) 00010000:00010000:3.0:1746065086.268017:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065086.268020:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.268024:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1464a3e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000004:00010000:3.0:1746065086.268036:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925cd880 reply state ffff88009a808000 transno 8589934818 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1464a45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x54dabb10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.268042:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1464a45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x54dabb10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.268046:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x54dabb10 (ffff8800b4999f00) 00010000:00010000:3.0:1746065086.268048:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065086.268050:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065086.268067:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc1464a37 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d57a expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.268078:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f7c00/0xad6b7ddc1464a4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d57a expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.268083:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2d:0x0].0x0 (ffff8800b4999900) 00010000:00010000:3.0:1746065086.268085:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065086.268087:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f7c00, rc 0) 00000100:00100000:3.0:1746065086.268139:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:28634:x1830881261581440:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 838us (1064us total) trans 8589934818 rc 0/0 00000100:00100000:3.0:1746065086.268145:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12595 00000100:00100000:0.0:1746065086.281904:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.282001:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261581696 00000100:00100000:3.0:1746065086.282009:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261581696 00000100:00100000:3.0:1746065086.282047:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12596 00000100:00100000:3.0:1746065086.282053:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+304:28634:x1830881261581696:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:3.0:1746065086.282208:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.282222:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.282230:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:3.0:1746065086.282254:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975899 00000004:00010000:3.0:1746065086.282265:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925cc000 reply state ffff88012be10000 transno 4294975900 ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.282272:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.282277:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.282280:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065086.282282:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065086.282348:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+307:28634:x1830881261581696:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 294us (451us total) trans 4294975900 rc 0/0 00000100:00100000:3.0:1746065086.282356:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12596 00000020:00080000:3.0:1746065086.282360:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.287886:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.287950:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261581824 00000100:00100000:2.0:1746065086.287958:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261581824 00002000:00010000:2.0:1746065086.287989:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.287993:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cdc00 with x1830881261581824 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.288003:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cdc00. 00000100:00100000:2.0:1746065086.288022:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1307 00000100:00100000:2.0:1746065086.288029:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261581824:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.288143:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.288146:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.288148:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.288150:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.288152:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.288193:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261581824:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 165us (316us total) trans 21474839963 rc 0/0 00000100:00100000:2.0:1746065086.288199:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1307 00002000:00010000:2.0:1746065086.288202:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.288204:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cdc00 with x1830881261581824 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.288207:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cdc00. 00000100:00100000:1.0:1746065086.289236:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.289388:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261581952 00000100:00100000:0.0:1746065086.289393:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261581952 00002000:00010000:0.0:1746065086.289409:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.289412:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5de300 with x1830881261581952 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.289418:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5de300. 00000100:00100000:0.0:1746065086.289553:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1308 00000100:00100000:0.0:1746065086.289559:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881261581952:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:0.0:1746065086.289638:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065086.289642:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.289643:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065086.289645:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.289646:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065086.289724:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261581952:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 163us (489us total) trans 17179872689 rc 0/0 00000100:00100000:0.0:1746065086.289733:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1308 00002000:00010000:0.0:1746065086.289736:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.289738:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5de300 with x1830881261581952 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.289742:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5de300. 00000100:00100000:0.0:1746065086.293004:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.293523:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261582208 00000100:00100000:2.0:1746065086.293531:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261582208 00000100:00100000:2.0:1746065086.293735:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12597 00000100:00100000:2.0:1746065086.293743:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+307:28634:x1830881261582208:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.294006:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.294020:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.294030:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:2.0:1746065086.294055:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975901 00000004:00010000:2.0:1746065086.294070:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091a90700 reply state ffff880097df0000 transno 4294975902 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.294079:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.294085:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.294087:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.294090:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.294157:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+310:28634:x1830881261582208:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 414us (1160us total) trans 4294975902 rc 0/0 00000100:00100000:2.0:1746065086.294163:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12597 00000020:00080000:2.0:1746065086.294167:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.297148:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.297405:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261582336 00000100:00100000:2.0:1746065086.297414:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261582336 00002000:00010000:2.0:1746065086.297450:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (100000->18446744073709551615) 00002000:00100000:2.0:1746065086.297454:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881261582336 ext(100000->18446744073709551615) 00002000:00010000:2.0:1746065086.297465:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92300. 00000100:00100000:2.0:1746065086.297494:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1309 00000100:00100000:2.0:1746065086.297509:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261582336:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.297669:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 100000 00002000:00010000:2.0:1746065086.297672:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.297674:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.297676:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.297678:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.297727:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261582336:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 226us (587us total) trans 21474839964 rc 0/0 00000100:00100000:2.0:1746065086.297733:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1309 00002000:00010000:2.0:1746065086.297736:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (100000->18446744073709551615) 00002000:00100000:2.0:1746065086.297738:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881261582336 ext(100000->18446744073709551615) 00002000:00010000:2.0:1746065086.297742:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92300. 00000100:00100000:0.0:1746065086.299449:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.299538:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261582464 00000100:00100000:2.0:1746065086.299543:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261582464 00000100:00100000:2.0:1746065086.299936:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12598 00000100:00100000:2.0:1746065086.299944:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+310:28634:x1830881261582464:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.299962:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.299977:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45600/0xad6b7ddc1464a68 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d581 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.300052:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a6f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.300063:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a6f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.300072:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a6f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065086.300424:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 100000 00000004:00200000:2.0:1746065086.300428:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065086.300440:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a6f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.300463:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45600/0xad6b7ddc1464a68 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d581 expref: 312 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.300507:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a6f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d581 expref: 311 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.300514:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.300518:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.300521:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45800, rc 0) 00000100:00100000:2.0:1746065086.302084:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+311:28634:x1830881261582464:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 2136us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.302092:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12598 00000100:00100000:0.0:1746065086.306164:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.306520:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261582720 00000100:00100000:2.0:1746065086.306528:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261582720 00000100:00100000:2.0:1746065086.306580:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12599 00000100:00100000:2.0:1746065086.306588:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+311:28634:x1830881261582720:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.306632:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.306655:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a6f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d581 expref: 311 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.306683:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.306687:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.306827:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.306839:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.306847:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:2.0:1746065086.306875:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975903 00000004:00010000:2.0:1746065086.306891:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091a92680 reply state ffff88009a999000 transno 4294975904 ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.306899:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.306907:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.306910:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.306912:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.306981:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+313:28634:x1830881261582720:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 393us (825us total) trans 4294975904 rc 0/0 00000100:00100000:2.0:1746065086.306988:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12599 00000020:00080000:2.0:1746065086.306992:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746065086.309392:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.309426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.309491:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261582976 00000100:00100000:0.0:1746065086.309497:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261582976 00002000:00010000:0.0:1746065086.309533:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.309537:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2d80 with x1830881261582976 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.309546:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc2d80. 00000100:00100000:0.0:1746065086.309568:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261582848 00000100:00100000:0.0:1746065086.309571:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261582848 00002000:00010000:0.0:1746065086.309581:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.309583:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881261582848 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.309587:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1180. 00000100:00100000:0.0:1746065086.309610:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1310 00000100:00100000:0.0:1746065086.309617:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261582976:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:1.0:1746065086.309694:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1311 00000100:00100000:1.0:1746065086.309701:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261582848:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:0.0:1746065086.309720:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065086.309723:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.309725:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065086.309726:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.309728:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065086.309760:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261582976:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 143us (374us total) trans 17179872690 rc 0/0 00000100:00100000:0.0:1746065086.309766:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1310 00002000:00010000:0.0:1746065086.309769:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.309770:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2d80 with x1830881261582976 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.309787:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc2d80. 00002000:00010000:1.0:1746065086.309827:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 100000 -> 0 00002000:00010000:1.0:1746065086.309830:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.309831:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.309833:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.309834:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.309852:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881261582848:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 151us (425us total) trans 21474839965 rc 0/0 00000100:00100000:1.0:1746065086.309857:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1311 00002000:00010000:1.0:1746065086.309859:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.309861:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881261582848 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.309864:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1180. 00000100:00100000:0.0:1746065086.313049:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.313125:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261583232 00000100:00100000:2.0:1746065086.313132:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261583232 00000100:00100000:2.0:1746065086.313188:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12600 00000100:00100000:2.0:1746065086.313195:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+313:28634:x1830881261583232:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.313214:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.313217:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065086.313237:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3600/0xad6b7ddc14649ff lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d55e expref: 313 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.313265:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.313269:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.313277:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464a7d lrc: 2/0,0 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d588 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.313320:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a84 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.313330:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a84 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.313341:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a84 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00080000:2.0:1746065086.313440:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x38c:0x0], index 0: 0 00000004:00080000:2.0:1746065086.313446:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x38c:0x0], index 1: 0 00010000:00010000:2.0:1746065086.313526:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a84 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d588 expref: 315 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.313532:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.313534:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065086.313540:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44600/0xad6b7ddc1464a7d lrc: 0/0,0 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d588 expref: 315 pid: 9571 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065086.313550:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a84 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d588 expref: 314 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.313565:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.313567:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065086.313569:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45800, rc 0) 00000100:00100000:2.0:1746065086.313616:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+314:28634:x1830881261583232:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 421us (574us total) trans 4294975905 rc 0/0 00000100:00100000:2.0:1746065086.313621:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12600 00000100:00100000:0.0:1746065086.316059:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.316231:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261583360 00000100:00100000:2.0:1746065086.316239:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261583360 00000100:00100000:2.0:1746065086.316294:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8921 00000100:00100000:2.0:1746065086.316302:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:28634:x1830881261583360:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.316319:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.316337:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d58f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065086.316358:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065086.316384:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.316386:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.316393:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.316406:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.316415:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:2.0:1746065086.316463:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:28634:x1830881261583360:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 161us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.316469:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8921 00000100:00100000:0.0:1746065086.318538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.318586:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.318645:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261583488 00000100:00100000:3.0:1746065086.318653:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261583488 00000100:00100000:3.0:1746065086.318694:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261583616 00000100:00100000:3.0:1746065086.318696:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261583616 00000100:00100000:3.0:1746065086.318712:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8922 00000100:00100000:3.0:1746065086.318718:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261583488:12345-192.168.202.27@tcp:22:fsx.0 00000100:00100000:2.0:1746065086.318816:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8923 00000100:00100000:2.0:1746065086.318824:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261583616:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065086.318932:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1746065086.318932:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1746065086.318935:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.318935:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 0 -> 1746065086 00002000:00010000:3.0:1746065086.318937:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.318937:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.318938:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 0 -> 1746065086 00002000:00010000:3.0:1746065086.318939:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.318940:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 6144 00002000:00010000:3.0:1746065086.318941:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:3.0:1746065086.318991:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261583488:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 272us (458us total) trans 21474839966 rc 0/0 00000100:00100000:3.0:1746065086.318997:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8922 00000100:00100000:2.0:1746065086.319721:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261583616:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 897us (1133us total) trans 21474839967 rc 0/0 00000100:00100000:2.0:1746065086.319728:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8923 00000100:00100000:0.0:1746065086.323452:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.323520:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261583872 00000100:00100000:2.0:1746065086.323528:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261583872 00000100:00100000:2.0:1746065086.323575:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12601 00000100:00100000:2.0:1746065086.323581:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+314:28634:x1830881261583872:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.323620:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.323641:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45800/0xad6b7ddc1464a84 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d588 expref: 314 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.323667:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.323671:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.323817:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.323829:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.323837:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:2.0:1746065086.323863:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975906 00000004:00010000:2.0:1746065086.323879:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091a92a00 reply state ffff88009a99c000 transno 4294975907 ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.323886:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.323891:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.323893:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.323895:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.323955:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+316:28634:x1830881261583872:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 373us (511us total) trans 4294975907 rc 0/0 00000100:00100000:2.0:1746065086.323961:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12601 00000020:00080000:2.0:1746065086.323965:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.325685:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.328607:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584000 00000100:00100000:2.0:1746065086.328618:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584000 00000100:00100000:2.0:1746065086.328675:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12602 00000100:00100000:2.0:1746065086.328682:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+316:28634:x1830881261584000:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.328702:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.328715:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d596 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.328754:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 317 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.328765:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 317 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.328798:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.328801:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065086.328803:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8600, rc 0) 00000100:00100000:2.0:1746065086.328858:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+317:28634:x1830881261584000:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 173us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.328863:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12602 00000100:00100000:0.0:1746065086.331231:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.331286:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584128 00000100:00100000:2.0:1746065086.331292:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584128 00000100:00100000:2.0:1746065086.331332:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8924 00000100:00100000:2.0:1746065086.331338:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:28634:x1830881261584128:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.331351:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.331368:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d59d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065086.331390:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x38c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1746065086.331406:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.331408:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065086.331412:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.331424:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.331431:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8a00, rc 0) 00000100:00100000:2.0:1746065086.331486:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:28634:x1830881261584128:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 142us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.331494:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8924 00000100:00100000:0.0:1746065086.333181:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.333221:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.333248:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.333274:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584256 00000100:00100000:2.0:1746065086.333283:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584256 00000100:00100000:0.0:1746065086.333285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.333302:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584384 00000100:00100000:0.0:1746065086.333306:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584384 00002000:00010000:2.0:1746065086.333315:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.333319:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90e00 with x1830881261584256 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.333320:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.333323:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881261584384 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.333330:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90e00. 00002000:00010000:0.0:1746065086.333330:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90a80. 00000100:00100000:2.0:1746065086.333344:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584512 00000100:00100000:2.0:1746065086.333347:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584512 00002000:00010000:2.0:1746065086.333356:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.333358:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91880 with x1830881261584512 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.333362:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91880. 00000100:00100000:0.0:1746065086.333631:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584640 00000100:00100000:0.0:1746065086.333635:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584640 00002000:00010000:0.0:1746065086.333644:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:0.0:1746065086.333647:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90000 with x1830881261584640 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.333652:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90000. 00000100:00100000:2.0:1746065086.333793:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1312 00000100:00100000:2.0:1746065086.333801:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261584256:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.333958:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:2.0:1746065086.333961:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.333963:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.333964:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.333966:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:3.0:1746065086.333983:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1313 00000100:00100000:3.0:1746065086.333992:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261584384:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:2.0:1746065086.334004:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261584256:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 203us (828us total) trans 21474839968 rc 0/0 00000100:00100000:2.0:1746065086.334010:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1312 00002000:00010000:2.0:1746065086.334013:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.334015:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90e00 with x1830881261584256 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.334018:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90e00. 00000100:00100000:2.0:1746065086.334032:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1314 00000100:00100000:2.0:1746065086.334037:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261584512:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.334060:0:29489:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.334062:0:29489:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.334064:0:29489:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.334065:0:29489:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.334067:0:29489:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.334086:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261584384:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 96us (864us total) trans 17179872691 rc 0/0 00000100:00100000:3.0:1746065086.334091:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1313 00002000:00010000:3.0:1746065086.334094:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.334097:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881261584384 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.334100:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90a80. 00000100:00100000:3.0:1746065086.334111:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1315 00002000:00010000:2.0:1746065086.334113:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 4194304 -> 0 00000100:00100000:3.0:1746065086.334115:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261584640:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.334116:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.334117:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.334119:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.334120:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:2.0:1746065086.334135:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261584512:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 99us (887us total) trans 21474839969 rc 0/0 00000100:00100000:2.0:1746065086.334140:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1314 00002000:00010000:2.0:1746065086.334143:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.334144:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91880 with x1830881261584512 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.334148:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91880. 00002000:00010000:3.0:1746065086.334168:0:29489:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.334170:0:29489:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 0 -> 1746065086 00002000:00010000:3.0:1746065086.334172:0:29489:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.334173:0:29489:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 0 -> 1746065086 00002000:00010000:3.0:1746065086.334175:0:29489:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.334191:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261584640:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 75us (906us total) trans 17179872692 rc 0/0 00000100:00100000:3.0:1746065086.334196:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1315 00002000:00010000:3.0:1746065086.334199:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.334201:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90000 with x1830881261584640 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.334205:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90000. 00000100:00100000:0.0:1746065086.340827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.340881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.340970:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584768 00000100:00100000:1.0:1746065086.340979:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584768 00000100:00100000:1.0:1746065086.341031:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261584896 00000100:00100000:1.0:1746065086.341034:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261584896 00000100:00100000:1.0:1746065086.341054:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8925 00000100:00100000:1.0:1746065086.341061:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881261584768:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.341190:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.341192:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.341194:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.341195:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.341197:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.341240:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261584768:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 179us (420us total) trans 21474839970 rc 0/0 00000100:00100000:1.0:1746065086.341246:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8925 00000100:00100000:1.0:1746065086.341261:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8926 00000100:00100000:1.0:1746065086.341266:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881261584896:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.341306:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.341308:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.341310:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.341311:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.341313:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.341329:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261584896:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 62us (448us total) trans 21474839971 rc 0/0 00000100:00100000:1.0:1746065086.341333:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8926 00000100:00100000:0.0:1746065086.345479:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.345574:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585152 00000100:00100000:2.0:1746065086.345582:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585152 00000100:00100000:2.0:1746065086.345621:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12603 00000100:00100000:2.0:1746065086.345627:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+317:28634:x1830881261585152:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.345809:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.345823:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.345832:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:2.0:1746065086.345862:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975908 00000004:00010000:2.0:1746065086.345879:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880135220e00 reply state ffff88009c17a000 transno 4294975909 ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.345887:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.345893:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.345895:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.345898:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.345967:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+320:28634:x1830881261585152:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 339us (495us total) trans 4294975909 rc 0/0 00000100:00100000:2.0:1746065086.345973:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12603 00000020:00080000:2.0:1746065086.345977:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.347713:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.347746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.347768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.347819:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585280 00000100:00100000:0.0:1746065086.347820:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.347825:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585280 00002000:00010000:3.0:1746065086.347852:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.347855:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222d80 with x1830881261585280 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.347863:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135222d80. 00000100:00100000:2.0:1746065086.347872:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585408 00000100:00100000:2.0:1746065086.347876:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585408 00000100:00100000:3.0:1746065086.347878:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585536 00000100:00100000:3.0:1746065086.347880:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585536 00002000:00010000:3.0:1746065086.347888:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00010000:2.0:1746065086.347889:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.347890:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221c00 with x1830881261585536 ext(0->18446744073709551615) 00002000:00100000:2.0:1746065086.347892:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220000 with x1830881261585408 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.347894:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135221c00. 00002000:00010000:2.0:1746065086.347898:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220000. 00000100:00100000:3.0:1746065086.347901:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585664 00000100:00100000:3.0:1746065086.347903:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585664 00002000:00010000:3.0:1746065086.347910:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00000100:00100000:2.0:1746065086.347911:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1316 00002000:00100000:3.0:1746065086.347912:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221f80 with x1830881261585664 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.347916:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221f80. 00000100:00100000:2.0:1746065086.347918:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261585280:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:3.0:1746065086.347926:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1317 00000100:00100000:3.0:1746065086.347931:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261585536:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:2.0:1746065086.347996:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1318 00000100:00100000:2.0:1746065086.348001:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261585408:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.348051:0:29490:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.348054:0:29490:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.348055:0:29490:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.348057:0:29490:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.348059:0:29490:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.348087:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881261585408:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 86us (341us total) trans 17179872693 rc 0/0 00000100:00100000:2.0:1746065086.348092:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1318 00002000:00010000:2.0:1746065086.348095:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.348097:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220000 with x1830881261585408 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.348100:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220000. 00000100:00100000:2.0:1746065086.348112:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1319 00000100:00100000:2.0:1746065086.348116:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261585664:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.348150:0:29490:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.348151:0:29490:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.348153:0:29490:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.348154:0:29490:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.348155:0:29490:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.348168:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881261585664:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 52us (348us total) trans 17179872694 rc 0/0 00000100:00100000:2.0:1746065086.348172:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1319 00002000:00010000:2.0:1746065086.348175:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.348177:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221f80 with x1830881261585664 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.348180:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221f80. 00002000:00010000:2.0:1746065086.348207:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.348209:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.348211:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.348212:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.348214:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.348225:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881261585280:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 309us (518us total) trans 21474839972 rc 0/0 00000100:00100000:2.0:1746065086.348230:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1316 00002000:00010000:2.0:1746065086.348232:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.348234:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222d80 with x1830881261585280 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.348236:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135222d80. 00002000:00010000:3.0:1746065086.348935:0:29489:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.348940:0:29489:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.348942:0:29489:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.348943:0:29489:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.348945:0:29489:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.348982:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261585536:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 1049us (1211us total) trans 21474839973 rc 0/0 00000100:00100000:3.0:1746065086.348988:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1317 00002000:00010000:3.0:1746065086.348991:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.348993:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221c00 with x1830881261585536 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.348997:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135221c00. 00000100:00100000:0.0:1746065086.351066:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.351107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.351182:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585920 00000100:00100000:2.0:1746065086.351189:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585920 00000100:00100000:2.0:1746065086.351218:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261585792 00000100:00100000:2.0:1746065086.351220:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261585792 00000100:00100000:2.0:1746065086.351242:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8927 00000100:00100000:2.0:1746065086.351248:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881261585920:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.351421:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1746065086.351424:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.351425:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.351427:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.351428:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:2.0:1746065086.351459:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881261585920:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 211us (398us total) trans 21474839974 rc 0/0 00000100:00100000:2.0:1746065086.351468:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8927 00000100:00100000:2.0:1746065086.351482:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8928 00000100:00100000:2.0:1746065086.351487:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881261585792:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.351557:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1746065086.351560:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.351561:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.351563:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.351565:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:2.0:1746065086.351579:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881261585792:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 92us (472us total) trans 21474839975 rc 0/0 00000100:00100000:2.0:1746065086.351584:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8928 00000100:00100000:0.0:1746065086.353141:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.353205:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586176 00000100:00100000:2.0:1746065086.353210:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586176 00000100:00100000:2.0:1746065086.353406:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12604 00000100:00100000:2.0:1746065086.353413:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+320:28634:x1830881261586176:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.353569:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.353583:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.353592:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.353618:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975910 00000004:00010000:2.0:1746065086.353634:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f1a4700 reply state ffff88009c17f000 transno 4294975911 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.353647:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.353653:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.353655:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.353658:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.354475:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+323:28634:x1830881261586176:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 1059us (1334us total) trans 4294975911 rc 0/0 00000100:00100000:2.0:1746065086.354482:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12604 00000020:00080000:2.0:1746065086.354487:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.357417:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.357445:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.357472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.357514:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.357602:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586304 00000100:00100000:1.0:1746065086.357610:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586304 00002000:00010000:1.0:1746065086.357638:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.357642:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881261586304 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.357650:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7b80. 00000100:00100000:1.0:1746065086.357664:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586432 00000100:00100000:1.0:1746065086.357666:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586432 00002000:00010000:1.0:1746065086.357674:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.357676:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4380 with x1830881261586432 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.357680:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a4380. 00000100:00100000:1.0:1746065086.357688:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586688 00000100:00100000:1.0:1746065086.357689:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586688 00002000:00010000:1.0:1746065086.357694:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.357696:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6680 with x1830881261586688 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.357699:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6680. 00000100:00100000:1.0:1746065086.357705:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586560 00000100:00100000:1.0:1746065086.357706:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586560 00002000:00010000:1.0:1746065086.357712:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.357714:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881261586560 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.357718:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7100. 00000100:00100000:1.0:1746065086.357726:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1320 00000100:00100000:1.0:1746065086.357732:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261586304:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.357910:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:1.0:1746065086.357913:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.357915:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.357917:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.357919:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:1.0:1746065086.357954:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261586304:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 221us (543us total) trans 21474839976 rc 0/0 00000100:00100000:1.0:1746065086.357959:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1320 00002000:00010000:1.0:1746065086.357962:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.357964:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881261586304 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.357967:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7b80. 00000100:00100000:1.0:1746065086.357979:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1321 00000100:00100000:1.0:1746065086.357983:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881261586432:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.358032:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.358034:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.358035:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.358037:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.358039:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.358051:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261586432:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 67us (605us total) trans 17179872695 rc 0/0 00000100:00100000:1.0:1746065086.358055:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1321 00002000:00010000:1.0:1746065086.358057:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.358059:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4380 with x1830881261586432 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.358061:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a4380. 00000100:00100000:1.0:1746065086.358068:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1322 00000100:00100000:1.0:1746065086.358072:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881261586688:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.358099:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.358100:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.358102:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.358103:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.358105:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.358116:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261586688:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 44us (644us total) trans 17179872696 rc 0/0 00000100:00100000:1.0:1746065086.358120:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1322 00002000:00010000:1.0:1746065086.358122:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.358123:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6680 with x1830881261586688 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.358126:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6680. 00000100:00100000:1.0:1746065086.358132:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1323 00000100:00100000:1.0:1746065086.358135:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881261586560:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.358182:0:29492:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:1.0:1746065086.358184:0:29492:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.358186:0:29492:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.358187:0:29492:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.358189:0:29492:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:1.0:1746065086.358200:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261586560:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 64us (685us total) trans 21474839977 rc 0/0 00000100:00100000:1.0:1746065086.358207:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1323 00002000:00010000:1.0:1746065086.358209:0:29492:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.358210:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881261586560 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.358213:0:29492:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7100. 00000100:00100000:0.0:1746065086.361678:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.361722:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.361802:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586944 00000100:00100000:3.0:1746065086.361809:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586944 00000100:00100000:3.0:1746065086.361839:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261586816 00000100:00100000:3.0:1746065086.361840:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261586816 00000100:00100000:3.0:1746065086.361864:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8929 00000100:00100000:3.0:1746065086.361871:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261586944:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065086.362031:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.362034:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.362036:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.362038:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.362040:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:3.0:1746065086.362075:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261586944:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 205us (404us total) trans 21474839978 rc 0/0 00000100:00100000:3.0:1746065086.362082:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8929 00000100:00100000:3.0:1746065086.362099:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8930 00000100:00100000:3.0:1746065086.362103:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881261586816:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065086.362162:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.362164:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.362166:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.362168:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.362169:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:3.0:1746065086.362184:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261586816:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 81us (463us total) trans 21474839979 rc 0/0 00000100:00100000:3.0:1746065086.362189:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8930 00000100:00100000:0.0:1746065086.363883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.363939:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587200 00000100:00100000:2.0:1746065086.363944:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587200 00000100:00100000:2.0:1746065086.363971:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12605 00000100:00100000:2.0:1746065086.363978:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+323:28634:x1830881261587200:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.364110:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.364123:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.364132:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.364157:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975912 00000004:00010000:2.0:1746065086.364171:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f1a6a00 reply state ffff88012ed07000 transno 4294975913 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.364179:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.364185:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.364189:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.364191:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.364245:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+326:28634:x1830881261587200:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 267us (364us total) trans 4294975913 rc 0/0 00000100:00100000:2.0:1746065086.364250:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12605 00000020:00080000:2.0:1746065086.364253:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.365743:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.365803:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.365834:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.365854:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.365928:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587456 00000100:00100000:2.0:1746065086.365933:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587456 00002000:00010000:2.0:1746065086.365956:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.365959:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6300 with x1830881261587456 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.365967:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6300. 00000100:00100000:2.0:1746065086.365977:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587712 00000100:00100000:2.0:1746065086.365979:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587712 00002000:00010000:2.0:1746065086.365984:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.365986:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7800 with x1830881261587712 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.365989:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7800. 00000100:00100000:2.0:1746065086.366002:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587328 00000100:00100000:2.0:1746065086.366004:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587328 00002000:00010000:2.0:1746065086.366012:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.366014:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881261587328 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.366018:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5880. 00000100:00100000:1.0:1746065086.366040:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1324 00000100:00100000:1.0:1746065086.366049:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261587456:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:0.0:1746065086.366055:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1325 00000100:00100000:0.0:1746065086.366061:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881261587712:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.366139:0:29490:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.366141:0:29490:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.366143:0:29490:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.366145:0:29490:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.366147:0:29490:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1746065086.366147:0:29489:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065086.366149:0:29489:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.366151:0:29489:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065086.366152:0:29489:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.366154:0:29489:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.366171:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261587456:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 123us (430us total) trans 17179872698 rc 0/0 00000100:00100000:0.0:1746065086.366172:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261587712:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 111us (397us total) trans 17179872697 rc 0/0 00000100:00100000:1.0:1746065086.366176:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1324 00002000:00010000:1.0:1746065086.366178:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/907 (0->18446744073709551615) 00000100:00100000:0.0:1746065086.366179:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1325 00002000:00100000:1.0:1746065086.366180:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6300 with x1830881261587456 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.366181:0:29489:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00010000:1.0:1746065086.366183:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6300. 00002000:00100000:0.0:1746065086.366183:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7800 with x1830881261587712 ext(0->18446744073709551615) 00002000:00010000:0.0:1746065086.366187:0:29489:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7800. 00000100:00100000:1.0:1746065086.366195:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1326 00000100:00100000:1.0:1746065086.366200:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261587328:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.366247:0:29490:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.366249:0:29490:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.366251:0:29490:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.366252:0:29490:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.366253:0:29490:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065086.366268:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261587328:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 69us (435us total) trans 21474839980 rc 0/0 00000100:00100000:1.0:1746065086.366272:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1326 00002000:00010000:1.0:1746065086.366274:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.366275:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881261587328 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.366277:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5880. 00000100:00100000:2.0:1746065086.366308:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587584 00000100:00100000:2.0:1746065086.366312:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587584 00002000:00010000:2.0:1746065086.366325:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.366327:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6d80 with x1830881261587584 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.366332:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a6d80. 00000100:00100000:2.0:1746065086.366344:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1327 00000100:00100000:2.0:1746065086.366349:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261587584:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.366584:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.366587:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.366588:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.366590:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.366591:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1746065086.366611:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261587584:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 262us (756us total) trans 21474839981 rc 0/0 00000100:00100000:2.0:1746065086.366616:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1327 00002000:00010000:2.0:1746065086.366618:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.366620:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6d80 with x1830881261587584 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.366623:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a6d80. 00000100:00100000:0.0:1746065086.369877:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.369963:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587840 00000100:00100000:1.0:1746065086.369971:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587840 00000100:00100000:1.0:1746065086.370010:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8931 00000100:00100000:1.0:1746065086.370017:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881261587840:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:1.0:1746065086.370032:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065086.370049:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5a4 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065086.370066:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1746065086.370081:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065086.370083:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065086.370089:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 38 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065086.370100:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 38 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065086.370108:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090790600, rc 0) 00000100:00100000:1.0:1746065086.370151:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881261587840:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.370156:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8931 00000100:00100000:0.0:1746065086.372557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.372651:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261587968 00000100:00100000:2.0:1746065086.372658:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261587968 00000100:00100000:2.0:1746065086.372695:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12606 00000100:00100000:2.0:1746065086.372701:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+326:28634:x1830881261587968:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.372720:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.372733:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464ac3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5ab expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.372817:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1464aca lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.372828:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1464aca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.372836:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1464aca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065086.372856:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 0 00000004:00200000:2.0:1746065086.372858:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065086.372869:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1464aca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.372884:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464ac3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ab expref: 328 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.373128:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1464aca lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ab expref: 327 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.373135:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.373137:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.373139:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1000, rc 0) 00000100:00100000:2.0:1746065086.373380:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+327:28634:x1830881261587968:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 677us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.373386:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12606 00000100:00100000:0.0:1746065086.376437:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.376512:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261588096 00000100:00100000:2.0:1746065086.376520:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261588096 00000100:00100000:2.0:1746065086.376654:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8932 00000100:00100000:2.0:1746065086.376661:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881261588096:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.376907:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 93044 00002000:00010000:2.0:1746065086.376910:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.376912:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.376913:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.376915:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065086.376960:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881261588096:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 299us (530us total) trans 21474839982 rc 0/0 00000100:00100000:2.0:1746065086.376967:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8932 00000100:00100000:0.0:1746065086.379735:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.380075:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261588224 00000100:00100000:2.0:1746065086.380082:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261588224 00002000:00100000:2.0:1746065086.380117:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (151552->171006) req@ffff88008f3e5880 x1830881261588224/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.380125:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5880 with x1830881261588224 ext(151552->171006) 00002000:00010000:2.0:1746065086.380130:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5880 00000100:00100000:2.0:1746065086.380225:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1328 00000100:00100000:2.0:1746065086.380232:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261588224:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:2.0:1746065086.382914:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881261588224:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 2676us (3180us total) trans 21474839983 rc 0/0 00000100:00100000:2.0:1746065086.382922:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1328 00002000:00100000:2.0:1746065086.382931:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (151552->171006) req@ffff88008f3e5880 x1830881261588224/t21474839983(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.382940:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5880 with x1830881261588224 ext(151552->171006) 00002000:00010000:2.0:1746065086.382945:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5880 00000100:00100000:0.0:1746065086.385600:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.385677:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261588352 00000100:00100000:2.0:1746065086.385685:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261588352 00000100:00100000:2.0:1746065086.385729:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8933 00000100:00100000:2.0:1746065086.385736:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881261588352:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.386026:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 93044 -> 171007 00002000:00010000:2.0:1746065086.386029:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.386031:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.386033:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.386035:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065086.386073:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881261588352:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 337us (480us total) trans 21474839984 rc 0/0 00000100:00100000:2.0:1746065086.386081:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8933 00000100:00100000:0.0:1746065086.388609:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.388684:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261588480 00000100:00100000:1.0:1746065086.388690:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261588480 00000100:00100000:1.0:1746065086.388736:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8934 00000100:00100000:1.0:1746065086.388743:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881261588480:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.388880:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 171007 -> 171007 00002000:00010000:1.0:1746065086.388883:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.388885:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.388886:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.388887:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065086.388917:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881261588480:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 175us (316us total) trans 21474839985 rc 0/0 00000100:00100000:1.0:1746065086.388923:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8934 00000100:00100000:0.0:1746065086.393117:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.393224:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261588736 00000100:00100000:2.0:1746065086.393232:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261588736 00002000:00100000:2.0:1746065086.393267:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (151552->155647) req@ffff88008f3e5180 x1830881261588736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.393276:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5180 with x1830881261588736 ext(151552->155647) 00002000:00010000:2.0:1746065086.393281:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5180 00000100:00100000:2.0:1746065086.393310:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1329 00000100:00100000:2.0:1746065086.393316:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881261588736:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.393442:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881261588736:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 125us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.393448:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1329 00002000:00100000:2.0:1746065086.393453:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (151552->155647) req@ffff88008f3e5180 x1830881261588736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.393460:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5180 with x1830881261588736 ext(151552->155647) 00002000:00010000:2.0:1746065086.393462:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5180 00000100:00100000:0.0:1746065086.395332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.395869:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261588992 00000100:00100000:3.0:1746065086.395876:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261588992 00002000:00100000:3.0:1746065086.395905:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38a:0x0] (147456->151551) req@ffff88008f3e7800 x1830881261588992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.395914:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881261588992 ext(147456->151551) 00002000:00010000:3.0:1746065086.395918:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:3.0:1746065086.396024:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1330 00000100:00100000:3.0:1746065086.396032:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881261588992:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.396196:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881261588992:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 165us (868us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.396205:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1330 00002000:00100000:3.0:1746065086.396210:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38a:0x0] (147456->151551) req@ffff88008f3e7800 x1830881261588992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.396216:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881261588992 ext(147456->151551) 00002000:00010000:3.0:1746065086.396219:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:0.0:1746065086.398404:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.398495:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261589248 00000100:00100000:2.0:1746065086.398511:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261589248 00002000:00100000:2.0:1746065086.398546:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (114688->172031) req@ffff88008f3e4000 x1830881261589248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.398554:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4000 with x1830881261589248 ext(114688->172031) 00002000:00010000:2.0:1746065086.398558:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4000 00000100:00100000:2.0:1746065086.398589:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1331 00000100:00100000:2.0:1746065086.398596:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881261589248:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.402205:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881261589248:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 3600us (3797us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1746065086.402215:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1331 00002000:00100000:2.0:1746065086.402224:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (114688->172031) req@ffff88008f3e4000 x1830881261589248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.402232:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4000 with x1830881261589248 ext(114688->172031) 00002000:00010000:2.0:1746065086.402238:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4000 00000100:00100000:0.0:1746065086.406930:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.407512:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261589504 00000100:00100000:2.0:1746065086.407523:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261589504 00000100:00100000:2.0:1746065086.407591:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12607 00000100:00100000:2.0:1746065086.407602:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+327:28634:x1830881261589504:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.407647:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.407669:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1000/0xad6b7ddc1464aca lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ab expref: 327 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.407703:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.407707:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.408049:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.408062:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.408070:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:2.0:1746065086.408103:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975914 00000004:00010000:2.0:1746065086.408122:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f3e4700 reply state ffff88011daa8000 transno 4294975915 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.408129:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.408134:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.408137:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.408139:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.408207:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+329:28634:x1830881261589504:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 605us (1290us total) trans 4294975915 rc 0/0 00000100:00100000:2.0:1746065086.408213:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12607 00000020:00080000:2.0:1746065086.408217:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.412193:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.412225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.412253:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.412382:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261589632 00000100:00100000:2.0:1746065086.412390:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261589632 00002000:00010000:2.0:1746065086.412422:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (262144->18446744073709551615) 00002000:00100000:2.0:1746065086.412426:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6300 with x1830881261589632 ext(262144->18446744073709551615) 00002000:00010000:2.0:1746065086.412435:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6300. 00000100:00100000:2.0:1746065086.412459:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261589760 00000100:00100000:2.0:1746065086.412462:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261589760 00002000:00010000:2.0:1746065086.412470:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (262144->18446744073709551615) 00002000:00100000:2.0:1746065086.412472:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7480 with x1830881261589760 ext(262144->18446744073709551615) 00002000:00010000:2.0:1746065086.412477:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e7480. 00000100:00100000:2.0:1746065086.413439:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261589888 00000100:00100000:3.0:1746065086.413445:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1332 00000100:00100000:2.0:1746065086.413445:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261589888 00000100:00100000:3.0:1746065086.413453:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881261589632:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.413458:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.413460:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881261589888 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.413465:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4380. 00002000:00010000:3.0:1746065086.413614:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 171007 -> 262144 00002000:00010000:3.0:1746065086.413617:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.413619:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.413620:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.413622:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 2048 -> 512 00000100:00100000:3.0:1746065086.413662:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881261589632:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 210us (1476us total) trans 21474839986 rc 0/0 00000100:00100000:3.0:1746065086.413719:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1332 00002000:00010000:3.0:1746065086.413722:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (262144->18446744073709551615) 00000100:00100000:2.0:1746065086.413723:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1333 00002000:00100000:3.0:1746065086.413724:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6300 with x1830881261589632 ext(262144->18446744073709551615) 00002000:00010000:3.0:1746065086.413728:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6300. 00000100:00100000:2.0:1746065086.413729:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261589760:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:3.0:1746065086.413741:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1334 00000100:00100000:3.0:1746065086.413745:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881261589888:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.413805:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.413807:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.413808:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 0 -> 262144 00002000:00010000:3.0:1746065086.413809:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.413810:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.413811:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.413812:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.413813:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1746065086.413814:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.413815:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:3.0:1746065086.413829:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881261589888:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 83us (1575us total) trans 17179872699 rc 0/0 00000100:00100000:2.0:1746065086.413829:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261589760:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 101us (1603us total) trans 21474839987 rc 0/0 00000100:00100000:3.0:1746065086.413834:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1334 00002000:00010000:3.0:1746065086.413836:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.413838:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881261589888 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.413841:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4380. 00000100:00100000:2.0:1746065086.413841:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1333 00002000:00010000:2.0:1746065086.413843:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (262144->18446744073709551615) 00002000:00100000:2.0:1746065086.413845:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7480 with x1830881261589760 ext(262144->18446744073709551615) 00002000:00010000:2.0:1746065086.413848:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e7480. 00000100:00100000:0.0:1746065086.418115:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.418281:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261590144 00000100:00100000:2.0:1746065086.418289:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261590144 00002000:00100000:2.0:1746065086.418325:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (229376->262143) req@ffff88008f3e7b80 x1830881261590144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.418334:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7b80 with x1830881261590144 ext(229376->262143) 00002000:00010000:2.0:1746065086.418339:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e7b80 00000100:00100000:2.0:1746065086.418369:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1335 00000100:00100000:2.0:1746065086.418375:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261590144:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.421515:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261590144:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 3123us (3391us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1746065086.421524:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1335 00002000:00100000:2.0:1746065086.421533:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (229376->262143) req@ffff88008f3e7b80 x1830881261590144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.421542:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7b80 with x1830881261590144 ext(229376->262143) 00002000:00010000:2.0:1746065086.421547:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e7b80 00000100:00100000:0.0:1746065086.424228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.424304:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261590272 00000100:00100000:2.0:1746065086.424310:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261590272 00002000:00100000:2.0:1746065086.424345:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (258048->262143) req@ffff88008f3e6680 x1830881261590272/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 4584/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.424354:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6680 with x1830881261590272 ext(258048->262143) 00002000:00010000:2.0:1746065086.424359:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6680 00000100:00100000:2.0:1746065086.424925:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1336 00000100:00100000:2.0:1746065086.424933:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881261590272:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:0.0:1746065086.426581:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881261590272:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 1644us (2356us total) trans 21474839988 rc 0/0 00000100:00100000:0.0:1746065086.426589:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1336 00002000:00100000:0.0:1746065086.426598:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (258048->262143) req@ffff88008f3e6680 x1830881261590272/t21474839988(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 4584/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:0.0:1746065086.426606:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6680 with x1830881261590272 ext(258048->262143) 00002000:00010000:0.0:1746065086.426611:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6680 00000100:00100000:0.0:1746065086.428448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.428529:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261590400 00000100:00100000:1.0:1746065086.428536:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261590400 00000100:00100000:1.0:1746065086.428581:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12608 00000100:00100000:1.0:1746065086.428588:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+329:28634:x1830881261590400:12345-192.168.202.27@tcp:44:fsx.0 00000001:00080000:2.0:1746065086.434150:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975915 is committed 00010000:00010000:1.0:1746065086.434286:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434299:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434306:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434311:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434315:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434325:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434342:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a0ae006 (ffff880098c65400) 00010000:00010000:1.0:1746065086.434345:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434348:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434353:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012db9dc00/0xad6b7ddc146499d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434392:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434397:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434400:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434404:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434406:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434410:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434415:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434417:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434419:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434423:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b2e00/0xad6b7ddc14649f8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434431:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434435:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434438:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434441:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434443:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434447:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434452:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x503ec310 (ffff8800a3f1da00) 00010000:00010000:1.0:1746065086.434453:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434455:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434458:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464a22 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x6:0x0].0x503ec310 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434469:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434473:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434477:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434483:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434485:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434488:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434493:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434495:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434508:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434513:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f7f6800/0xad6b7ddc1464a5a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434520:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434525:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434529:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434532:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434534:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434538:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434544:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434545:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434547:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434551:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f45400/0xad6b7ddc1464a61 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434557:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434561:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434564:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434567:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434568:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434573:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434577:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434578:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434580:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434584:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129f44400/0xad6b7ddc1464a76 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434590:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434595:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434602:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434606:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434608:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434612:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434617:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434619:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434621:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434624:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8e00/0xad6b7ddc1464a92 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434631:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434635:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434639:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434642:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434643:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434647:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434656:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434657:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434659:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434663:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880098c1b800/0xad6b7ddc1464aa7 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434670:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434674:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434678:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434682:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434684:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434688:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434694:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434695:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434697:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434701:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0c00/0xad6b7ddc1464aae lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434708:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434714:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434718:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434722:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434723:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434728:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434733:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434734:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434736:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434740:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0600/0xad6b7ddc1464ab5 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:1.0:1746065086.434748:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434753:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434757:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434761:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065086.434763:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434769:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434794:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.434795:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065086.434798:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.434802:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00000100:00100000:0.0:1746065086.435212:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:28634:x1830881261590400:12345-192.168.202.27@tcp:44:fsx.0 Request processed in 6618us (6763us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065086.435224:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12608 00000100:00100000:0.0:1746065086.437599:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.440520:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261590528 00000100:00100000:2.0:1746065086.440535:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261590528 00000100:00100000:2.0:1746065086.440613:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8935 00000100:00100000:2.0:1746065086.440622:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261590528:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.443929:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839988 is committed 00000100:00100000:2.0:1746065086.444404:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261590528:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 3774us (6803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.444415:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8935 00000100:00100000:0.0:1746065086.446482:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.446561:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261590656 00000100:00100000:2.0:1746065086.446569:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261590656 00000100:00100000:2.0:1746065086.446625:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12609 00000100:00100000:2.0:1746065086.446632:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+293:28634:x1830881261590656:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.446647:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.446662:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5b2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.446733:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1464adf lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.446743:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1464adf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.446751:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1464adf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065086.446767:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 262144 00000004:00200000:2.0:1746065086.446770:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065086.446858:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1464adf lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.446878:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f800/0xad6b7ddc1464ad8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5b2 expref: 295 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.446891:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1464adf lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5b2 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.446948:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.446952:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.446955:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:2.0:1746065086.447073:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:28634:x1830881261590656:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 441us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.447078:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12609 00000100:00100000:0.0:1746065086.449572:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.449649:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261590784 00000100:00100000:2.0:1746065086.449659:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261590784 00000100:00100000:2.0:1746065086.449704:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8936 00000100:00100000:2.0:1746065086.449712:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261590784:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.450648:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.450651:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.450653:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.450655:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.450656:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 512 -> 512 00000100:00100000:2.0:1746065086.450942:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261590784:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 1229us (1373us total) trans 21474839989 rc 0/0 00000100:00100000:2.0:1746065086.450949:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8936 00000100:00100000:0.0:1746065086.454254:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.454342:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261591040 00000100:00100000:2.0:1746065086.454350:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261591040 00000100:00100000:2.0:1746065086.454386:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12610 00000100:00100000:2.0:1746065086.454393:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:28634:x1830881261591040:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.454431:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.454452:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580f400/0xad6b7ddc1464adf lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5b2 expref: 294 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.454466:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.454470:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.454600:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.454610:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.454617:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.454643:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975916 00000004:00010000:2.0:1746065086.454661:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925c8000 reply state ffff88011daae000 transno 4294975917 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.454669:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.454673:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.454675:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.454677:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.454741:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+296:28634:x1830881261591040:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 349us (495us total) trans 4294975917 rc 0/0 00000100:00100000:2.0:1746065086.454747:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12610 00000020:00080000:2.0:1746065086.454751:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.460916:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.460951:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.460977:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261591296 00000100:00100000:3.0:1746065086.460985:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261591296 00000100:00100000:0.0:1746065086.460985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065086.461017:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (207162->18446744073709551615) 00002000:00100000:3.0:1746065086.461020:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cb480 with x1830881261591296 ext(207162->18446744073709551615) 00002000:00010000:3.0:1746065086.461031:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cb480. 00000100:00100000:3.0:1746065086.461485:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261591424 00000100:00100000:2.0:1746065086.461485:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261591168 00000100:00100000:3.0:1746065086.461489:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261591424 00000100:00100000:2.0:1746065086.461489:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261591168 00002000:00010000:3.0:1746065086.461510:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00010000:2.0:1746065086.461511:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (207162->18446744073709551615) 00002000:00100000:3.0:1746065086.461513:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9f80 with x1830881261591424 ext(0->18446744073709551615) 00002000:00100000:2.0:1746065086.461513:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9c00 with x1830881261591168 ext(207162->18446744073709551615) 00000100:00100000:1.0:1746065086.461514:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1337 00002000:00010000:3.0:1746065086.461519:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925c9f80. 00002000:00010000:2.0:1746065086.461519:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c9c00. 00000100:00100000:1.0:1746065086.461532:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261591296:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:2.0:1746065086.461540:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1338 00000100:00100000:2.0:1746065086.461546:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261591168:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.461761:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 207162 00002000:00010000:2.0:1746065086.461764:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.461766:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.461768:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.461770:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 512 -> 408 00000100:00100000:3.0:1746065086.461798:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1339 00000100:00100000:3.0:1746065086.461805:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881261591424:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:2.0:1746065086.461832:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261591168:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 286us (880us total) trans 21474839990 rc 0/0 00000100:00100000:2.0:1746065086.461838:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1338 00002000:00010000:2.0:1746065086.461842:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (207162->18446744073709551615) 00002000:00100000:2.0:1746065086.461844:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9c00 with x1830881261591168 ext(207162->18446744073709551615) 00002000:00010000:2.0:1746065086.461847:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c9c00. 00002000:00010000:3.0:1746065086.461860:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.461862:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.461864:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.461865:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.461867:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.461883:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881261591424:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 78us (897us total) trans 17179872700 rc 0/0 00000100:00100000:3.0:1746065086.461888:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1339 00002000:00010000:3.0:1746065086.461891:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.461892:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9f80 with x1830881261591424 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.461895:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925c9f80. 00002000:00010000:1.0:1746065086.461953:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 262144 -> 207162 00002000:00010000:1.0:1746065086.461956:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.461958:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.461960:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.461961:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.462023:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881261591296:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 499us (1113us total) trans 21474839991 rc 0/0 00000100:00100000:1.0:1746065086.462030:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1337 00002000:00010000:1.0:1746065086.462034:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (207162->18446744073709551615) 00002000:00100000:1.0:1746065086.462037:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cb480 with x1830881261591296 ext(207162->18446744073709551615) 00002000:00010000:1.0:1746065086.462042:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cb480. 00000100:00100000:0.0:1746065086.465924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.466298:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261591552 00000100:00100000:2.0:1746065086.466306:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261591552 00000100:00100000:2.0:1746065086.466353:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12611 00000100:00100000:2.0:1746065086.466360:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+296:28634:x1830881261591552:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.466379:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.466393:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464aed lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5b9 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.466468:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc1464af4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065086.466478:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc1464af4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.466488:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc1464af4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065086.466516:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 207162 00000004:00200000:2.0:1746065086.466519:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065086.466532:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc1464af4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065086.466551:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464aed lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5b9 expref: 298 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.466583:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc1464af4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5b9 expref: 297 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.466594:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.466596:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.466599:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fe00, rc 0) 00000100:00100000:2.0:1746065086.467740:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+297:28634:x1830881261591552:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 1374us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.467748:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12611 00000100:00100000:0.0:1746065086.474269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.474367:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261591808 00000100:00100000:2.0:1746065086.474375:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261591808 00002000:00100000:2.0:1746065086.474415:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38a:0x0] (24576->90111) req@ffff8800925c8a80 x1830881261591808/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.474424:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c8a80 with x1830881261591808 ext(24576->90111) 00002000:00010000:2.0:1746065086.474429:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c8a80 00000100:00100000:2.0:1746065086.474461:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1340 00000100:00100000:2.0:1746065086.474468:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881261591808:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.476591:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881261591808:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2117us (2323us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1746065086.476601:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1340 00002000:00100000:2.0:1746065086.476608:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38a:0x0] (24576->90111) req@ffff8800925c8a80 x1830881261591808/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.476616:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c8a80 with x1830881261591808 ext(24576->90111) 00002000:00010000:2.0:1746065086.476620:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c8a80 00000100:00100000:0.0:1746065086.478168:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.478317:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592064 00000100:00100000:2.0:1746065086.478323:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592064 00002000:00100000:2.0:1746065086.478351:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38a:0x0] (4096->24575) req@ffff8800925c9180 x1830881261592064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.478359:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9180 with x1830881261592064 ext(4096->24575) 00002000:00010000:2.0:1746065086.478363:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c9180 00000100:00100000:2.0:1746065086.478382:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1341 00000100:00100000:2.0:1746065086.478388:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261592064:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.480585:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261592064:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2191us (2417us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1746065086.480594:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1341 00002000:00100000:2.0:1746065086.480601:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38a:0x0] (4096->24575) req@ffff8800925c9180 x1830881261592064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.480609:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9180 with x1830881261592064 ext(4096->24575) 00002000:00010000:2.0:1746065086.480613:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c9180 00000100:00100000:0.0:1746065086.484867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.485055:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592192 00000100:00100000:2.0:1746065086.485062:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592192 00002000:00100000:2.0:1746065086.485095:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38a:0x0] (65536->90111) req@ffff8800925c9500 x1830881261592192/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.485103:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9500 with x1830881261592192 ext(65536->90111) 00002000:00010000:2.0:1746065086.485108:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c9500 00000100:00100000:2.0:1746065086.485278:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1342 00000100:00100000:2.0:1746065086.485284:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881261592192:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:2.0:1746065086.488915:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261592192:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 3624us (4048us total) trans 21474839992 rc 0/0 00000100:00100000:2.0:1746065086.488925:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1342 00002000:00100000:2.0:1746065086.488936:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38a:0x0] (65536->90111) req@ffff8800925c9500 x1830881261592192/t21474839992(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.488944:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925c9500 with x1830881261592192 ext(65536->90111) 00002000:00010000:2.0:1746065086.488949:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925c9500 00000100:00100000:0.0:1746065086.490603:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.490668:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592320 00000100:00100000:2.0:1746065086.490675:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592320 00000100:00100000:2.0:1746065086.490712:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12612 00000100:00100000:2.0:1746065086.490718:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+297:28634:x1830881261592320:12345-192.168.202.27@tcp:44:fsx.0 00000100:00100000:2.0:1746065086.490834:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+297:28634:x1830881261592320:12345-192.168.202.27@tcp:44:fsx.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.490839:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12612 00000100:00100000:0.0:1746065086.492284:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.495580:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592448 00000100:00100000:2.0:1746065086.495592:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592448 00000100:00100000:2.0:1746065086.495654:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8937 00000100:00100000:2.0:1746065086.495661:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261592448:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.496934:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839992 is committed 00000100:00100000:2.0:1746065086.497076:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261592448:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 1413us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.497084:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8937 00000100:00100000:0.0:1746065086.500341:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.500424:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592704 00000100:00100000:2.0:1746065086.500432:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592704 00000100:00100000:2.0:1746065086.500475:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12613 00000100:00100000:2.0:1746065086.500483:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:28634:x1830881261592704:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.500534:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.500557:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fe00/0xad6b7ddc1464af4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5b9 expref: 297 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.500584:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.500589:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.500712:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.500723:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.500730:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.500761:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975918 00000004:00010000:2.0:1746065086.500798:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925ca680 reply state ffff88008b06f000 transno 4294975919 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.500805:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.500810:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.500812:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.500814:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.500871:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+299:28634:x1830881261592704:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 388us (537us total) trans 4294975919 rc 0/0 00000100:00100000:2.0:1746065086.500876:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12613 00000020:00080000:2.0:1746065086.500880:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.503708:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.504635:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.505269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.505345:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592832 00000100:00100000:1.0:1746065086.505353:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592832 00000100:00100000:2.0:1746065086.505366:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261592960 00000100:00100000:2.0:1746065086.505371:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261592960 00002000:00010000:1.0:1746065086.505382:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (262144->18446744073709551615) 00002000:00010000:2.0:1746065086.505385:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (262144->18446744073709551615) 00002000:00100000:1.0:1746065086.505386:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cb100 with x1830881261592832 ext(262144->18446744073709551615) 00002000:00100000:2.0:1746065086.505387:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ca300 with x1830881261592960 ext(262144->18446744073709551615) 00002000:00010000:2.0:1746065086.505394:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ca300. 00002000:00010000:1.0:1746065086.505394:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cb100. 00000100:00100000:1.0:1746065086.505411:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261593088 00000100:00100000:1.0:1746065086.505413:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261593088 00002000:00010000:1.0:1746065086.505420:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.505422:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f57b80 with x1830881261593088 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.505427:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095f57b80. 00000100:00100000:2.0:1746065086.505528:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1343 00000100:00100000:2.0:1746065086.505535:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261592832:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:0.0:1746065086.505541:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1344 00000100:00100000:0.0:1746065086.505548:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261592960:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:3.0:1746065086.505697:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1345 00000100:00100000:3.0:1746065086.505706:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881261593088:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:0.0:1746065086.506169:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 207162 -> 262144 00002000:00010000:0.0:1746065086.506173:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.506175:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065086.506177:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.506178:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065086.506215:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261592960:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 667us (1580us total) trans 21474839993 rc 0/0 00000100:00100000:0.0:1746065086.506221:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1344 00002000:00010000:0.0:1746065086.506224:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (262144->18446744073709551615) 00002000:00100000:0.0:1746065086.506226:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ca300 with x1830881261592960 ext(262144->18446744073709551615) 00002000:00010000:0.0:1746065086.506229:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ca300. 00002000:00010000:2.0:1746065086.506268:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 207162 -> 262144 00002000:00010000:2.0:1746065086.506271:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.506273:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.506275:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.506277:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 408 -> 416 00000100:00100000:2.0:1746065086.506294:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261592832:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 760us (2599us total) trans 21474839994 rc 0/0 00000100:00100000:2.0:1746065086.506299:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1343 00002000:00010000:2.0:1746065086.506301:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (262144->18446744073709551615) 00002000:00100000:2.0:1746065086.506303:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925cb100 with x1830881261592832 ext(262144->18446744073709551615) 00002000:00010000:2.0:1746065086.506307:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925cb100. 00002000:00010000:3.0:1746065086.506388:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.506390:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.506392:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.506393:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.506395:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.506411:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881261593088:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 709us (1143us total) trans 17179872701 rc 0/0 00000100:00100000:3.0:1746065086.506416:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1345 00002000:00010000:3.0:1746065086.506418:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.506420:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f57b80 with x1830881261593088 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.506423:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095f57b80. 00000100:00100000:0.0:1746065086.508719:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.508903:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261593344 00000100:00100000:3.0:1746065086.508914:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261593344 00002000:00100000:3.0:1746065086.508948:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (217088->262143) req@ffff880095f54e00 x1830881261593344/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.508956:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f54e00 with x1830881261593344 ext(217088->262143) 00002000:00010000:3.0:1746065086.508961:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f54e00 00000100:00100000:3.0:1746065086.508989:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1346 00000100:00100000:3.0:1746065086.508996:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261593344:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.513848:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261593344:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 4842us (5126us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1746065086.513858:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1346 00002000:00100000:3.0:1746065086.513868:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (217088->262143) req@ffff880095f54e00 x1830881261593344/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.513877:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f54e00 with x1830881261593344 ext(217088->262143) 00002000:00010000:3.0:1746065086.513882:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f54e00 00000100:00100000:0.0:1746065086.517938:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.518054:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261593472 00000100:00100000:3.0:1746065086.518061:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261593472 00002000:00100000:3.0:1746065086.518094:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (245760->262143) req@ffff880095f56d80 x1830881261593472/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 16872/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.518102:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f56d80 with x1830881261593472 ext(245760->262143) 00002000:00010000:3.0:1746065086.518106:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f56d80 00000100:00100000:3.0:1746065086.518132:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1347 00000100:00100000:3.0:1746065086.518137:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261593472:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:3.0:1746065086.519474:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881261593472:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 1330us (1542us total) trans 21474839995 rc 0/0 00000100:00100000:3.0:1746065086.519484:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1347 00002000:00100000:3.0:1746065086.519490:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (245760->262143) req@ffff880095f56d80 x1830881261593472/t21474839995(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 16872/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.519507:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f56d80 with x1830881261593472 ext(245760->262143) 00002000:00010000:3.0:1746065086.519510:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f56d80 00000100:00100000:0.0:1746065086.522578:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.522635:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261593600 00000100:00100000:2.0:1746065086.522643:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261593600 00000100:00100000:2.0:1746065086.522695:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12614 00000100:00100000:2.0:1746065086.522702:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+299:28634:x1830881261593600:12345-192.168.202.27@tcp:44:fsx.0 00000100:00100000:2.0:1746065086.522843:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+299:28634:x1830881261593600:12345-192.168.202.27@tcp:44:fsx.0 Request processed in 140us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.522850:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12614 00000100:00100000:0.0:1746065086.523997:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.524073:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261593728 00000100:00100000:2.0:1746065086.524078:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261593728 00000100:00100000:2.0:1746065086.524116:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8938 00000100:00100000:2.0:1746065086.524122:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261593728:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.525405:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839995 is committed 00000100:00100000:2.0:1746065086.525553:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261593728:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 1429us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.525561:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8938 00000100:00100000:0.0:1746065086.527185:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.527228:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261593856 00000100:00100000:2.0:1746065086.527235:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261593856 00000100:00100000:2.0:1746065086.527274:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12615 00000100:00100000:2.0:1746065086.527279:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+299:28634:x1830881261593856:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:2.0:1746065086.527293:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065086.527310:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc1464b02 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5c0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.527377:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1464b09 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.527387:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1464b09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.527396:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1464b09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065086.527416:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 262144 00000004:00200000:2.0:1746065086.527420:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065086.527430:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1464b09 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.527448:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580fc00/0xad6b7ddc1464b02 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5c0 expref: 301 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.527459:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1464b09 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5c0 expref: 300 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.527466:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.527468:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065086.527471:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580ea00, rc 0) 00000100:00100000:2.0:1746065086.527514:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+300:28634:x1830881261593856:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 234us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.527519:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12615 00000100:00100000:1.0:1746065086.532948:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.533082:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261594112 00000100:00100000:3.0:1746065086.533091:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261594112 00002000:00100000:3.0:1746065086.533128:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (90112->126975) req@ffff88009a5df100 x1830881261594112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.533137:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5df100 with x1830881261594112 ext(90112->126975) 00002000:00010000:3.0:1746065086.533142:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5df100 00000100:00100000:3.0:1746065086.533441:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1348 00000100:00100000:3.0:1746065086.533448:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261594112:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.538510:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261594112:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 5047us (5554us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1746065086.538521:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1348 00002000:00100000:3.0:1746065086.538532:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (90112->126975) req@ffff88009a5df100 x1830881261594112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.538540:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5df100 with x1830881261594112 ext(90112->126975) 00002000:00010000:3.0:1746065086.538545:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5df100 00000100:00100000:0.0:1746065086.540979:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.541109:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261594240 00000100:00100000:3.0:1746065086.541119:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261594240 00002000:00100000:3.0:1746065086.541159:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (45056->98303) req@ffff880095f55c00 x1830881261594240/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.541167:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55c00 with x1830881261594240 ext(45056->98303) 00002000:00010000:3.0:1746065086.541171:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f55c00 00000100:00100000:3.0:1746065086.541257:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1349 00000100:00100000:3.0:1746065086.541265:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261594240:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:3.0:1746065086.545141:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261594240:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 3868us (4160us total) trans 21474839996 rc 0/0 00000100:00100000:3.0:1746065086.545151:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1349 00002000:00100000:3.0:1746065086.545160:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (45056->98303) req@ffff880095f55c00 x1830881261594240/t21474839996(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.545167:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55c00 with x1830881261594240 ext(45056->98303) 00002000:00010000:3.0:1746065086.545173:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f55c00 00000100:00100000:0.0:1746065086.546906:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.547053:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261594368 00000100:00100000:2.0:1746065086.547061:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261594368 00000100:00100000:2.0:1746065086.547106:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8939 00000100:00100000:2.0:1746065086.547112:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881261594368:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.548465:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839996 is committed 00000100:00100000:2.0:1746065086.549124:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261594368:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 2006us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.549132:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8939 00000100:00100000:0.0:1746065086.553472:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.553739:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261594496 00000100:00100000:3.0:1746065086.553747:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261594496 00002000:00100000:3.0:1746065086.553835:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (258048->262143) req@ffff880095f55f80 x1830881261594496/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 4584/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.553843:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55f80 with x1830881261594496 ext(258048->262143) 00002000:00010000:3.0:1746065086.553848:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f55f80 00000100:00100000:3.0:1746065086.553870:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1350 00000100:00100000:3.0:1746065086.553876:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261594496:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:3.0:1746065086.554890:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261594496:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 1011us (1422us total) trans 21474839997 rc 0/0 00000100:00100000:3.0:1746065086.554897:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1350 00002000:00100000:3.0:1746065086.554903:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (258048->262143) req@ffff880095f55f80 x1830881261594496/t21474839997(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 4584/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.554910:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095f55f80 with x1830881261594496 ext(258048->262143) 00002000:00010000:3.0:1746065086.554913:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095f55f80 00000100:00100000:0.0:1746065086.556657:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.556733:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261594624 00000100:00100000:2.0:1746065086.556740:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261594624 00000100:00100000:1.0:1746065086.556890:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8940 00000100:00100000:1.0:1746065086.556899:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261594624:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.557953:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839997 is committed 00000100:00100000:1.0:1746065086.558067:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261594624:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 1168us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.558075:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8940 00000100:00100000:0.0:1746065086.561292:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.561380:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261594880 00000100:00100000:3.0:1746065086.561389:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261594880 00002000:00100000:3.0:1746065086.561424:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (147456->176127) req@ffff88012e37ca80 x1830881261594880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.561437:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ca80 with x1830881261594880 ext(147456->176127) 00002000:00010000:3.0:1746065086.561442:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37ca80 00000100:00100000:3.0:1746065086.561512:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1351 00000100:00100000:3.0:1746065086.561519:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261594880:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.563035:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261594880:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 1511us (1746us total) trans 0 rc 24576/24576 00000100:00100000:3.0:1746065086.563043:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1351 00002000:00100000:3.0:1746065086.563051:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (147456->176127) req@ffff88012e37ca80 x1830881261594880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.563059:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ca80 with x1830881261594880 ext(147456->176127) 00002000:00010000:3.0:1746065086.563063:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37ca80 00000100:00100000:0.0:1746065086.566525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.566613:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261595136 00000100:00100000:2.0:1746065086.566621:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261595136 00000100:00100000:2.0:1746065086.566658:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12616 00000100:00100000:2.0:1746065086.566665:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+300:28634:x1830881261595136:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.566703:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.566725:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ea00/0xad6b7ddc1464b09 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5c0 expref: 300 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.566755:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.566759:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.566890:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.566901:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.566908:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.566932:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975920 00000004:00010000:2.0:1746065086.566946:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e37e680 reply state ffff88012ec8f000 transno 4294975921 ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.566952:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.566957:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.566959:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.566961:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.567011:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+302:28634:x1830881261595136:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 346us (493us total) trans 4294975921 rc 0/0 00000100:00100000:2.0:1746065086.567017:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12616 00000020:00080000:2.0:1746065086.567020:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.570651:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.570683:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.570717:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.570789:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261595264 00000100:00100000:2.0:1746065086.570797:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261595264 00002000:00010000:2.0:1746065086.570825:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (236806->18446744073709551615) 00002000:00100000:2.0:1746065086.570828:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37d180 with x1830881261595264 ext(236806->18446744073709551615) 00002000:00010000:2.0:1746065086.570837:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37d180. 00000100:00100000:2.0:1746065086.570850:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261595392 00000100:00100000:2.0:1746065086.570851:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261595392 00002000:00010000:2.0:1746065086.570857:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (236806->18446744073709551615) 00002000:00100000:2.0:1746065086.570859:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ea00 with x1830881261595392 ext(236806->18446744073709551615) 00002000:00010000:2.0:1746065086.570863:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37ea00. 00000100:00100000:2.0:1746065086.571335:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261595520 00000100:00100000:2.0:1746065086.571339:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261595520 00002000:00010000:2.0:1746065086.571352:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.571354:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ce00 with x1830881261595520 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.571359:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e37ce00. 00000100:00100000:3.0:1746065086.571386:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1352 00000100:00100000:3.0:1746065086.571395:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261595264:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.571609:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 236806 00002000:00010000:3.0:1746065086.571612:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.571614:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.571615:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.571617:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 416 -> 416 00000100:00100000:3.0:1746065086.571660:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261595264:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 266us (1016us total) trans 21474839998 rc 0/0 00000100:00100000:3.0:1746065086.571665:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1352 00002000:00010000:3.0:1746065086.571668:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (236806->18446744073709551615) 00002000:00100000:3.0:1746065086.571670:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37d180 with x1830881261595264 ext(236806->18446744073709551615) 00002000:00010000:3.0:1746065086.571673:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37d180. 00000100:00100000:3.0:1746065086.571688:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1353 00000100:00100000:3.0:1746065086.571692:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261595392:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.571765:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 262144 -> 236806 00002000:00010000:3.0:1746065086.571767:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.571768:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.571770:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.571788:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.571805:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261595392:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 112us (1121us total) trans 21474839999 rc 0/0 00000100:00100000:3.0:1746065086.571810:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1353 00002000:00010000:3.0:1746065086.571812:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (236806->18446744073709551615) 00002000:00100000:3.0:1746065086.571814:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ea00 with x1830881261595392 ext(236806->18446744073709551615) 00002000:00010000:3.0:1746065086.571817:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37ea00. 00000100:00100000:3.0:1746065086.571826:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1354 00000100:00100000:3.0:1746065086.571830:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881261595520:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.571880:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.571882:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.571883:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.571885:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.571886:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.571901:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881261595520:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 70us (1183us total) trans 17179872702 rc 0/0 00000100:00100000:3.0:1746065086.571906:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1354 00002000:00010000:3.0:1746065086.571908:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.571910:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37ce00 with x1830881261595520 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.571913:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e37ce00. 00000100:00100000:1.0:1746065086.575897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.576174:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261595648 00000100:00100000:0.0:1746065086.576182:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261595648 00000100:00100000:0.0:1746065086.577125:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12617 00000100:00100000:0.0:1746065086.577136:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+302:28634:x1830881261595648:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:0.0:1746065086.577159:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065086.577176:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1464b17 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5c7 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065086.577250:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84aa00/0xad6b7ddc1464b1e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065086.577261:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84aa00/0xad6b7ddc1464b1e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065086.577270:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84aa00/0xad6b7ddc1464b1e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065086.577290:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 236806 00000004:00200000:0.0:1746065086.577293:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065086.577305:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84aa00/0xad6b7ddc1464b1e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065086.577324:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1464b17 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5c7 expref: 304 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065086.577350:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84aa00/0xad6b7ddc1464b1e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5c7 expref: 303 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065086.577357:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065086.577360:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065086.577362:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84aa00, rc 0) 00000100:00100000:0.0:1746065086.577408:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+303:28634:x1830881261595648:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 275us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065086.577414:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12617 00000100:00100000:0.0:1746065086.580584:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.581290:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261595776 00000100:00100000:1.0:1746065086.581299:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261595776 00000100:00100000:1.0:1746065086.581379:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8941 00000100:00100000:1.0:1746065086.581386:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261595776:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.581670:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 236806 -> 236806 00002000:00010000:1.0:1746065086.581673:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.581675:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.581676:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.581678:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 416 -> 416 00000100:00100000:1.0:1746065086.582290:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261595776:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 902us (1710us total) trans 21474840000 rc 0/0 00000100:00100000:1.0:1746065086.582297:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8941 00000100:00100000:0.0:1746065086.585375:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.585473:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596032 00000100:00100000:2.0:1746065086.585480:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596032 00000100:00100000:2.0:1746065086.585524:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12618 00000100:00100000:2.0:1746065086.585531:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+303:28634:x1830881261596032:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:2.0:1746065086.585569:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065086.585590:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84aa00/0xad6b7ddc1464b1e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5c7 expref: 303 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065086.585618:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.585621:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065086.585733:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065086.585744:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.585751:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:2.0:1746065086.585798:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975922 00000004:00010000:2.0:1746065086.585815:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e37d880 reply state ffff88012ec8a000 transno 4294975923 ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.585823:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065086.585828:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065086.585830:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065086.585832:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065086.585887:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+305:28634:x1830881261596032:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 356us (520us total) trans 4294975923 rc 0/0 00000100:00100000:2.0:1746065086.585893:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12618 00000020:00080000:2.0:1746065086.585898:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.588247:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.588279:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.588487:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.588557:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596160 00000100:00100000:3.0:1746065086.588564:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596160 00002000:00010000:3.0:1746065086.588590:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (166516->18446744073709551615) 00002000:00100000:3.0:1746065086.588593:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37c000 with x1830881261596160 ext(166516->18446744073709551615) 00002000:00010000:3.0:1746065086.588602:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37c000. 00000100:00100000:3.0:1746065086.588617:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596288 00000100:00100000:3.0:1746065086.588620:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596288 00002000:00010000:3.0:1746065086.588627:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (166516->18446744073709551615) 00002000:00100000:3.0:1746065086.588629:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37f480 with x1830881261596288 ext(166516->18446744073709551615) 00002000:00010000:3.0:1746065086.588633:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37f480. 00000100:00100000:3.0:1746065086.588639:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596416 00000100:00100000:3.0:1746065086.588641:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596416 00002000:00010000:3.0:1746065086.588649:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.588651:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37fb80 with x1830881261596416 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.588656:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e37fb80. 00000100:00100000:3.0:1746065086.588666:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1355 00000100:00100000:3.0:1746065086.588672:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261596160:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.588897:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 236806 -> 166516 00002000:00010000:3.0:1746065086.588900:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.588902:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.588903:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.588905:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 416 -> 336 00000100:00100000:3.0:1746065086.588941:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261596160:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 268us (699us total) trans 21474840001 rc 0/0 00000100:00100000:3.0:1746065086.588950:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1355 00002000:00010000:3.0:1746065086.588953:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (166516->18446744073709551615) 00002000:00100000:3.0:1746065086.588954:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37c000 with x1830881261596160 ext(166516->18446744073709551615) 00002000:00010000:3.0:1746065086.588958:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37c000. 00000100:00100000:3.0:1746065086.588972:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1356 00000100:00100000:3.0:1746065086.588977:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881261596288:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:2.0:1746065086.589039:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1357 00000100:00100000:2.0:1746065086.589047:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881261596416:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.589105:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.589107:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.589109:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.589110:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.589112:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.589128:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261596416:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 83us (641us total) trans 17179872703 rc 0/0 00000100:00100000:2.0:1746065086.589134:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1357 00002000:00010000:2.0:1746065086.589136:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.589138:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37fb80 with x1830881261596416 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.589140:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e37fb80. 00002000:00010000:3.0:1746065086.590352:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 236806 -> 166516 00002000:00010000:3.0:1746065086.590356:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.590358:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.590359:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.590361:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.590392:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881261596288:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 1415us (2111us total) trans 21474840002 rc 0/0 00000100:00100000:3.0:1746065086.590397:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1356 00002000:00010000:3.0:1746065086.590400:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (166516->18446744073709551615) 00002000:00100000:3.0:1746065086.590402:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37f480 with x1830881261596288 ext(166516->18446744073709551615) 00002000:00010000:3.0:1746065086.590405:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37f480. 00000100:00100000:0.0:1746065086.592870:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.593084:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596544 00000100:00100000:1.0:1746065086.593092:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596544 00000100:00100000:1.0:1746065086.593141:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12619 00000100:00100000:1.0:1746065086.593149:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+305:28634:x1830881261596544:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:1.0:1746065086.593170:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065086.593185:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668200/0xad6b7ddc1464b2c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5ce expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.593258:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b33 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.593269:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.593278:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:1.0:1746065086.593299:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 166516 00000004:00200000:1.0:1746065086.593302:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065086.593316:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.593336:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668200/0xad6b7ddc1464b2c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ce expref: 307 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.593351:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b33 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ce expref: 306 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.593358:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.593360:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065086.593363:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668a00, rc 0) 00000100:00100000:1.0:1746065086.593396:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+306:28634:x1830881261596544:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 248us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.593401:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12619 00000100:00100000:0.0:1746065086.596887:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.596947:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596672 00000100:00100000:1.0:1746065086.596955:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596672 00000100:00100000:1.0:1746065086.597055:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8942 00000100:00100000:1.0:1746065086.597062:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261596672:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.597677:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 166516 -> 166516 00002000:00010000:1.0:1746065086.597680:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.597682:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.597684:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.597685:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 336 -> 328 00000100:00100000:1.0:1746065086.598078:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881261596672:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 1015us (1196us total) trans 21474840003 rc 0/0 00000100:00100000:1.0:1746065086.598085:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8942 00000100:00100000:0.0:1746065086.600990:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.601077:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261596928 00000100:00100000:3.0:1746065086.601083:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261596928 00002000:00100000:3.0:1746065086.601116:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (0->147455) req@ffff88012e37f100 x1830881261596928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 520/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.601128:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37f100 with x1830881261596928 ext(0->147455) 00002000:00010000:3.0:1746065086.601132:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37f100 00000100:00100000:3.0:1746065086.601154:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1358 00000100:00100000:3.0:1746065086.601160:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261596928:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.603913:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261596928:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2744us (2921us total) trans 0 rc 126976/126976 00000100:00100000:3.0:1746065086.603922:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1358 00002000:00100000:3.0:1746065086.603930:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (0->147455) req@ffff88012e37f100 x1830881261596928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 520/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 126976/126976 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.603937:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37f100 with x1830881261596928 ext(0->147455) 00002000:00010000:3.0:1746065086.603941:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37f100 00000100:00100000:0.0:1746065086.606559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.606975:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597056 00000100:00100000:3.0:1746065086.606982:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597056 00002000:00100000:3.0:1746065086.607014:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (36864->40959) req@ffff88012e37f800 x1830881261597056/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 4584/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.607022:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37f800 with x1830881261597056 ext(36864->40959) 00002000:00010000:3.0:1746065086.607026:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37f800 00000100:00100000:3.0:1746065086.607382:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1359 00000100:00100000:3.0:1746065086.607390:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261597056:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:3.0:1746065086.608619:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261597056:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 1228us (2062us total) trans 21474840004 rc 0/0 00000100:00100000:3.0:1746065086.608627:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1359 00002000:00100000:3.0:1746065086.608634:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (36864->40959) req@ffff88012e37f800 x1830881261597056/t21474840004(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 4584/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.608642:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e37f800 with x1830881261597056 ext(36864->40959) 00002000:00010000:3.0:1746065086.608646:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e37f800 00000100:00100000:0.0:1746065086.610394:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.610657:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597184 00000100:00100000:3.0:1746065086.610664:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597184 00000100:00100000:3.0:1746065086.610710:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12620 00000100:00100000:3.0:1746065086.610717:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+306:28634:x1830881261597184:12345-192.168.202.27@tcp:44:fsx.0 00000100:00100000:3.0:1746065086.610835:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+306:28634:x1830881261597184:12345-192.168.202.27@tcp:44:fsx.0 Request processed in 118us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.610841:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12620 00000100:00100000:0.0:1746065086.612130:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.612341:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597312 00000100:00100000:1.0:1746065086.612345:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597312 00000100:00100000:1.0:1746065086.612383:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8943 00000100:00100000:1.0:1746065086.612389:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261597312:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.613914:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840004 is committed 00000100:00100000:1.0:1746065086.614416:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261597312:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 2024us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.614425:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8943 00000100:00100000:0.0:1746065086.616976:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.617125:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597440 00000100:00100000:1.0:1746065086.617132:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597440 00000100:00100000:1.0:1746065086.617180:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8944 00000100:00100000:1.0:1746065086.617186:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261597440:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.617341:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 166516 -> 166516 00002000:00010000:1.0:1746065086.617344:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.617345:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 1746065086 00002000:00010000:1.0:1746065086.617347:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.617348:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 328 -> 328 00000100:00100000:1.0:1746065086.617383:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261597440:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 197us (414us total) trans 21474840005 rc 0/0 00000100:00100000:1.0:1746065086.617389:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8944 00000100:00100000:0.0:1746065086.622745:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.622847:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597568 00000100:00100000:2.0:1746065086.622855:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597568 00000100:00100000:2.0:1746065086.622941:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8945 00000100:00100000:2.0:1746065086.622949:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261597568:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.623114:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 166516 -> 262144 00002000:00010000:2.0:1746065086.623116:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.623118:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.623120:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.623122:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 328 -> 336 00000100:00100000:2.0:1746065086.623798:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881261597568:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 850us (1061us total) trans 21474840006 rc 0/0 00000100:00100000:2.0:1746065086.623805:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8945 00000100:00100000:0.0:1746065086.627557:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.629270:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597824 00000100:00100000:3.0:1746065086.629279:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597824 00002000:00100000:3.0:1746065086.629315:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (167936->262143) req@ffff880098667100 x1830881261597824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.629324:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098667100 with x1830881261597824 ext(167936->262143) 00002000:00010000:3.0:1746065086.629328:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098667100 00000100:00100000:3.0:1746065086.629353:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1360 00000100:00100000:3.0:1746065086.629358:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881261597824:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.632241:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881261597824:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2874us (4683us total) trans 0 rc 94208/94208 00000100:00100000:3.0:1746065086.632251:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1360 00002000:00100000:3.0:1746065086.632260:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (167936->262143) req@ffff880098667100 x1830881261597824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 94208/94208 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.632268:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098667100 with x1830881261597824 ext(167936->262143) 00002000:00010000:3.0:1746065086.632272:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098667100 00000100:00100000:0.0:1746065086.636889:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.637056:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261597952 00000100:00100000:3.0:1746065086.637063:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261597952 00002000:00100000:3.0:1746065086.637098:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (90112->262143) req@ffff880098666300 x1830881261597952/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.637113:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098666300 with x1830881261597952 ext(90112->262143) 00002000:00010000:3.0:1746065086.637117:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098666300 00000100:00100000:3.0:1746065086.637289:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1361 00000100:00100000:3.0:1746065086.637296:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881261597952:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:3.0:1746065086.642991:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261597952:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 5687us (6102us total) trans 21474840007 rc 0/0 00000100:00100000:3.0:1746065086.643002:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1361 00002000:00100000:3.0:1746065086.643012:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (90112->262143) req@ffff880098666300 x1830881261597952/t21474840007(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.643021:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098666300 with x1830881261597952 ext(90112->262143) 00002000:00010000:3.0:1746065086.643026:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098666300 00000100:00100000:0.0:1746065086.646072:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.646157:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261598080 00000100:00100000:2.0:1746065086.646165:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261598080 00000100:00100000:2.0:1746065086.646210:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8946 00000100:00100000:2.0:1746065086.646217:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881261598080:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.646885:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.646888:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.646890:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.646892:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.646893:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 336 -> 448 00000100:00100000:2.0:1746065086.646970:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261598080:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 752us (903us total) trans 21474840008 rc 0/0 00000100:00100000:2.0:1746065086.646977:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8946 00000100:00100000:0.0:1746065086.653204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.654000:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261598336 00000100:00100000:3.0:1746065086.654008:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261598336 00002000:00100000:3.0:1746065086.654041:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (122880->126975) req@ffff880098665f80 x1830881261598336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.654050:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665f80 with x1830881261598336 ext(122880->126975) 00002000:00010000:3.0:1746065086.654054:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665f80 00000100:00100000:3.0:1746065086.654068:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1362 00000100:00100000:3.0:1746065086.654073:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261598336:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.654170:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261598336:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 96us (974us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.654175:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1362 00002000:00100000:3.0:1746065086.654179:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (122880->126975) req@ffff880098665f80 x1830881261598336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.654186:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665f80 with x1830881261598336 ext(122880->126975) 00002000:00010000:3.0:1746065086.654188:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665f80 00000100:00100000:0.0:1746065086.663163:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.663691:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261598592 00000100:00100000:2.0:1746065086.663701:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261598592 00002000:00100000:2.0:1746065086.663751:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (118784->122879) req@ffff880098666680 x1830881261598592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.663760:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098666680 with x1830881261598592 ext(118784->122879) 00002000:00010000:2.0:1746065086.663766:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098666680 00000100:00100000:2.0:1746065086.663838:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1363 00000100:00100000:2.0:1746065086.663846:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261598592:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.664969:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261598592:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 1116us (1810us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.664978:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1363 00002000:00100000:2.0:1746065086.664986:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (118784->122879) req@ffff880098666680 x1830881261598592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.665000:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098666680 with x1830881261598592 ext(118784->122879) 00002000:00010000:2.0:1746065086.665005:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098666680 00000100:00100000:0.0:1746065086.671901:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.672063:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261598720 00000100:00100000:2.0:1746065086.672074:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261598720 00000100:00100000:2.0:1746065086.672138:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8947 00000100:00100000:2.0:1746065086.672145:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261598720:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.672349:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.672352:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.672354:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.672359:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.672361:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:2.0:1746065086.672405:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261598720:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 260us (515us total) trans 21474840009 rc 0/0 00000100:00100000:2.0:1746065086.672411:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8947 00000100:00100000:0.0:1746065086.676726:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.676913:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261598848 00000100:00100000:1.0:1746065086.676920:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261598848 00000100:00100000:1.0:1746065086.676963:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8948 00000100:00100000:1.0:1746065086.676970:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261598848:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.677992:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1746065086.677997:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.677999:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.678000:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.678002:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:1.0:1746065086.678057:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261598848:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 1085us (1337us total) trans 21474840010 rc 0/0 00000100:00100000:1.0:1746065086.678064:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8948 00000100:00100000:0.0:1746065086.680901:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.680988:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261599104 00000100:00100000:2.0:1746065086.680995:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261599104 00002000:00100000:2.0:1746065086.681028:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (86016->90111) req@ffff880098664000 x1830881261599104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.681036:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098664000 with x1830881261599104 ext(86016->90111) 00002000:00010000:2.0:1746065086.681040:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098664000 00000100:00100000:2.0:1746065086.681065:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1364 00000100:00100000:2.0:1746065086.681070:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261599104:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.681199:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261599104:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 128us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.681209:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1364 00002000:00100000:2.0:1746065086.681214:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (86016->90111) req@ffff880098664000 x1830881261599104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.681220:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098664000 with x1830881261599104 ext(86016->90111) 00002000:00010000:2.0:1746065086.681222:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098664000 00000100:00100000:0.0:1746065086.685194:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.685233:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261599360 00000100:00100000:3.0:1746065086.685241:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261599360 00002000:00100000:3.0:1746065086.685276:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (90112->94207) req@ffff880098665180 x1830881261599360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.685285:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665180 with x1830881261599360 ext(90112->94207) 00002000:00010000:3.0:1746065086.685289:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665180 00000100:00100000:3.0:1746065086.685315:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1365 00000100:00100000:3.0:1746065086.685321:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261599360:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.685445:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261599360:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 123us (257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.685450:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1365 00002000:00100000:3.0:1746065086.685455:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (90112->94207) req@ffff880098665180 x1830881261599360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.685461:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665180 with x1830881261599360 ext(90112->94207) 00002000:00010000:3.0:1746065086.685464:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665180 00000100:00100000:0.0:1746065086.689868:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.690605:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261599616 00000100:00100000:2.0:1746065086.690613:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261599616 00002000:00100000:2.0:1746065086.690650:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (94208->98303) req@ffff880098665500 x1830881261599616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.690658:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665500 with x1830881261599616 ext(94208->98303) 00002000:00010000:2.0:1746065086.690663:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665500 00000100:00100000:2.0:1746065086.690693:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1366 00000100:00100000:2.0:1746065086.690700:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261599616:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.691403:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261599616:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 702us (1541us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.691410:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1366 00002000:00100000:2.0:1746065086.691416:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (94208->98303) req@ffff880098665500 x1830881261599616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.691422:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665500 with x1830881261599616 ext(94208->98303) 00002000:00010000:2.0:1746065086.691425:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665500 00000100:00100000:0.0:1746065086.693893:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.694051:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261599872 00000100:00100000:2.0:1746065086.694058:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261599872 00002000:00100000:2.0:1746065086.694090:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (98304->102399) req@ffff880098665880 x1830881261599872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.694108:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665880 with x1830881261599872 ext(98304->102399) 00002000:00010000:2.0:1746065086.694112:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665880 00000100:00100000:2.0:1746065086.694256:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1367 00000100:00100000:2.0:1746065086.694264:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261599872:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.694561:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261599872:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 296us (671us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.694569:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1367 00002000:00100000:2.0:1746065086.694574:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (98304->102399) req@ffff880098665880 x1830881261599872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.694581:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098665880 with x1830881261599872 ext(98304->102399) 00002000:00010000:2.0:1746065086.694584:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098665880 00000100:00100000:0.0:1746065086.697849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.698166:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261600128 00000100:00100000:2.0:1746065086.698174:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261600128 00002000:00100000:2.0:1746065086.698208:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (102400->106495) req@ffff88012f09fb80 x1830881261600128/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.698216:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09fb80 with x1830881261600128 ext(102400->106495) 00002000:00010000:2.0:1746065086.698221:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09fb80 00000100:00100000:2.0:1746065086.698251:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1368 00000100:00100000:2.0:1746065086.698258:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261600128:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.698398:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261600128:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 140us (554us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.698404:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1368 00002000:00100000:2.0:1746065086.698410:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (102400->106495) req@ffff88012f09fb80 x1830881261600128/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.698417:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09fb80 with x1830881261600128 ext(102400->106495) 00002000:00010000:2.0:1746065086.698419:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09fb80 00000100:00100000:0.0:1746065086.701167:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.701243:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261600384 00000100:00100000:2.0:1746065086.701250:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261600384 00002000:00100000:2.0:1746065086.701280:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (106496->110591) req@ffff88012f09ed80 x1830881261600384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.701287:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881261600384 ext(106496->110591) 00002000:00010000:2.0:1746065086.701291:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:2.0:1746065086.701318:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1369 00000100:00100000:2.0:1746065086.701324:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261600384:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.701442:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261600384:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 118us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.701448:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1369 00002000:00100000:2.0:1746065086.701866:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (106496->110591) req@ffff88012f09ed80 x1830881261600384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.701875:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881261600384 ext(106496->110591) 00002000:00010000:2.0:1746065086.701878:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:0.0:1746065086.703272:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.703361:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261600640 00000100:00100000:2.0:1746065086.703366:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261600640 00002000:00100000:2.0:1746065086.703390:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (110592->114687) req@ffff88012f09dc00 x1830881261600640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.703396:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881261600640 ext(110592->114687) 00002000:00010000:2.0:1746065086.703399:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09dc00 00000100:00100000:2.0:1746065086.704012:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1370 00000100:00100000:2.0:1746065086.704019:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261600640:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.704125:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261600640:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 106us (856us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.704131:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1370 00002000:00100000:2.0:1746065086.704135:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (110592->114687) req@ffff88012f09dc00 x1830881261600640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.704142:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881261600640 ext(110592->114687) 00002000:00010000:2.0:1746065086.704144:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09dc00 00000100:00100000:0.0:1746065086.707147:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.707364:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261600896 00000100:00100000:3.0:1746065086.707371:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261600896 00002000:00100000:3.0:1746065086.707403:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (114688->118783) req@ffff88012f09d500 x1830881261600896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.707411:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881261600896 ext(114688->118783) 00002000:00010000:3.0:1746065086.707416:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:3.0:1746065086.709212:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1371 00000100:00100000:3.0:1746065086.709224:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261600896:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.709371:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261600896:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 151us (2230us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.709377:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1371 00002000:00100000:3.0:1746065086.709383:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (114688->118783) req@ffff88012f09d500 x1830881261600896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.709390:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881261600896 ext(114688->118783) 00002000:00010000:3.0:1746065086.709393:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:0.0:1746065086.715648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.715718:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261601152 00000100:00100000:2.0:1746065086.715726:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261601152 00002000:00100000:2.0:1746065086.715768:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (118784->122879) req@ffff88012f09c700 x1830881261601152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.715810:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c700 with x1830881261601152 ext(118784->122879) 00002000:00010000:2.0:1746065086.715909:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c700 00000100:00100000:2.0:1746065086.715944:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1372 00000100:00100000:2.0:1746065086.715952:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261601152:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.716097:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261601152:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 145us (454us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.716104:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1372 00002000:00100000:2.0:1746065086.716109:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (118784->122879) req@ffff88012f09c700 x1830881261601152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.716116:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c700 with x1830881261601152 ext(118784->122879) 00002000:00010000:2.0:1746065086.716119:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c700 00000100:00100000:0.0:1746065086.723258:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.723627:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261601280 00000100:00100000:3.0:1746065086.723634:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261601280 00002000:00100000:3.0:1746065086.723672:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (86016->122879) req@ffff88012f09e300 x1830881261601280/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.723681:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881261601280 ext(86016->122879) 00002000:00010000:3.0:1746065086.723686:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09e300 00000100:00100000:3.0:1746065086.723716:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1373 00000100:00100000:3.0:1746065086.723722:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261601280:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:3.0:1746065086.734151:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881261601280:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 10419us (10890us total) trans 21474840011 rc 0/0 00000100:00100000:3.0:1746065086.734162:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1373 00002000:00100000:3.0:1746065086.734173:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (86016->122879) req@ffff88012f09e300 x1830881261601280/t21474840011(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.734181:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881261601280 ext(86016->122879) 00002000:00010000:3.0:1746065086.734186:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09e300 00000100:00100000:0.0:1746065086.740855:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.740945:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261601408 00000100:00100000:1.0:1746065086.740954:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261601408 00000100:00100000:1.0:1746065086.741039:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8949 00000100:00100000:1.0:1746065086.741047:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261601408:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.746079:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840011 is committed 00000100:00100000:1.0:1746065086.746244:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261601408:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 5193us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.746255:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8949 00010000:00010000:2.0:1746065086.748226:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065086.752080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.753759:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261601536 00000100:00100000:1.0:1746065086.753770:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261601536 00000100:00100000:2.0:1746065086.753883:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8950 00000100:00100000:2.0:1746065086.753894:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261601536:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.754571:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.754575:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.754577:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.754579:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.754585:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:2.0:1746065086.756544:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261601536:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 2645us (4462us total) trans 21474840012 rc 0/0 00000100:00100000:2.0:1746065086.756554:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8950 00000100:00100000:0.0:1746065086.764333:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.764416:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261601792 00000100:00100000:3.0:1746065086.764423:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261601792 00002000:00100000:3.0:1746065086.764457:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (135168->139263) req@ffff88012f09d180 x1830881261601792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.764465:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881261601792 ext(135168->139263) 00002000:00010000:3.0:1746065086.764470:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d180 00000100:00100000:3.0:1746065086.772660:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1374 00000100:00100000:3.0:1746065086.772677:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261601792:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.772852:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881261601792:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 181us (8525us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.772859:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1374 00002000:00100000:3.0:1746065086.772866:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (135168->139263) req@ffff88012f09d180 x1830881261601792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.772874:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881261601792 ext(135168->139263) 00002000:00010000:3.0:1746065086.772880:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d180 00000100:00100000:0.0:1746065086.777514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.779525:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261602048 00000100:00100000:2.0:1746065086.779536:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261602048 00002000:00100000:2.0:1746065086.779581:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (139264->143359) req@ffff88012f09c380 x1830881261602048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.779591:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881261602048 ext(139264->143359) 00002000:00010000:2.0:1746065086.779596:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:2.0:1746065086.779631:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1375 00000100:00100000:2.0:1746065086.779638:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261602048:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.779807:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261602048:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 169us (2312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.779813:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1375 00002000:00100000:2.0:1746065086.779818:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (139264->143359) req@ffff88012f09c380 x1830881261602048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.779830:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881261602048 ext(139264->143359) 00002000:00010000:2.0:1746065086.779832:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:0.0:1746065086.782119:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.784361:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261602304 00000100:00100000:3.0:1746065086.784373:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261602304 00002000:00100000:3.0:1746065086.784420:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (143360->147455) req@ffff88012f09ea00 x1830881261602304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.784429:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ea00 with x1830881261602304 ext(143360->147455) 00002000:00010000:3.0:1746065086.784434:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ea00 00000100:00100000:2.0:1746065086.785547:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1376 00000100:00100000:2.0:1746065086.785561:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261602304:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.785730:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261602304:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 173us (3616us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.785736:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1376 00002000:00100000:2.0:1746065086.785741:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (143360->147455) req@ffff88012f09ea00 x1830881261602304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.785748:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ea00 with x1830881261602304 ext(143360->147455) 00002000:00010000:2.0:1746065086.785751:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ea00 00000100:00100000:1.0:1746065086.788577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.788656:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261602560 00000100:00100000:3.0:1746065086.788663:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261602560 00002000:00100000:3.0:1746065086.788696:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (147456->151551) req@ffff88009a5dd180 x1830881261602560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.788710:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5dd180 with x1830881261602560 ext(147456->151551) 00002000:00010000:3.0:1746065086.788714:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5dd180 00000100:00100000:3.0:1746065086.788795:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1377 00000100:00100000:3.0:1746065086.788803:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261602560:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.788975:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261602560:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 173us (405us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.788981:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1377 00002000:00100000:3.0:1746065086.788986:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (147456->151551) req@ffff88009a5dd180 x1830881261602560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.788992:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5dd180 with x1830881261602560 ext(147456->151551) 00002000:00010000:3.0:1746065086.788994:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5dd180 00000100:00100000:0.0:1746065086.792728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.793177:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261602688 00000100:00100000:3.0:1746065086.793185:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261602688 00002000:00100000:3.0:1746065086.793222:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (135168->167935) req@ffff880137345180 x1830881261602688/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.793231:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137345180 with x1830881261602688 ext(135168->167935) 00002000:00010000:3.0:1746065086.793235:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137345180 00000100:00100000:2.0:1746065086.794319:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1378 00000100:00100000:2.0:1746065086.794332:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261602688:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:2.0:1746065086.797654:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261602688:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 3318us (4925us total) trans 21474840013 rc 0/0 00000100:00100000:2.0:1746065086.797666:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1378 00002000:00100000:2.0:1746065086.797675:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (135168->167935) req@ffff880137345180 x1830881261602688/t21474840013(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.797684:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137345180 with x1830881261602688 ext(135168->167935) 00002000:00010000:2.0:1746065086.797690:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137345180 00000100:00100000:0.0:1746065086.799346:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.800817:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261602816 00000100:00100000:2.0:1746065086.800827:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261602816 00000100:00100000:2.0:1746065086.800878:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8951 00000100:00100000:2.0:1746065086.800885:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261602816:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:2.0:1746065086.802352:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840013 is committed 00000100:00100000:0.0:1746065086.802466:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881261602816:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 1580us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065086.802475:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8951 00000100:00100000:0.0:1746065086.805045:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.805207:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261603072 00000100:00100000:2.0:1746065086.805216:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261603072 00002000:00100000:2.0:1746065086.805256:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (118784->122879) req@ffff880137347100 x1830881261603072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.805266:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137347100 with x1830881261603072 ext(118784->122879) 00002000:00010000:2.0:1746065086.805270:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137347100 00000100:00100000:2.0:1746065086.805299:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1379 00000100:00100000:2.0:1746065086.805306:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261603072:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.805446:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261603072:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 140us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.805452:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1379 00002000:00100000:2.0:1746065086.805457:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (118784->122879) req@ffff880137347100 x1830881261603072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.805463:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137347100 with x1830881261603072 ext(118784->122879) 00002000:00010000:2.0:1746065086.805466:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137347100 00000100:00100000:0.0:1746065086.808158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.808328:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261603328 00000100:00100000:3.0:1746065086.808334:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261603328 00002000:00100000:3.0:1746065086.808362:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (122880->126975) req@ffff880137346a00 x1830881261603328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.808370:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137346a00 with x1830881261603328 ext(122880->126975) 00002000:00010000:3.0:1746065086.808374:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137346a00 00000100:00100000:3.0:1746065086.808399:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1380 00000100:00100000:3.0:1746065086.808405:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261603328:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.808524:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261603328:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 118us (372us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065086.808529:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1380 00002000:00100000:3.0:1746065086.808534:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (122880->126975) req@ffff880137346a00 x1830881261603328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.808540:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137346a00 with x1830881261603328 ext(122880->126975) 00002000:00010000:3.0:1746065086.808542:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137346a00 00000100:00100000:0.0:1746065086.811112:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.811189:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261603456 00000100:00100000:2.0:1746065086.811197:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261603456 00000100:00100000:2.0:1746065086.811240:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8952 00000100:00100000:2.0:1746065086.811246:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881261603456:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.811375:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.811378:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065087 00002000:00010000:2.0:1746065086.811380:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.811382:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.811384:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 448 -> 448 00000100:00100000:2.0:1746065086.811416:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261603456:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 170us (311us total) trans 21474840014 rc 0/0 00000100:00100000:2.0:1746065086.811422:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8952 00000100:00100000:0.0:1746065086.815402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.815596:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261603712 00000100:00100000:2.0:1746065086.815604:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261603712 00002000:00100000:2.0:1746065086.815642:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (61440->135167) req@ffff880137346d80 x1830881261603712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.815649:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137346d80 with x1830881261603712 ext(61440->135167) 00002000:00010000:2.0:1746065086.815653:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137346d80 00000100:00100000:2.0:1746065086.815767:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1381 00000100:00100000:2.0:1746065086.815804:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261603712:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.817573:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261603712:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 1796us (2174us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1746065086.817581:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1381 00002000:00100000:2.0:1746065086.817588:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (61440->135167) req@ffff880137346d80 x1830881261603712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.817596:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137346d80 with x1830881261603712 ext(61440->135167) 00002000:00010000:2.0:1746065086.817599:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137346d80 00000100:00100000:0.0:1746065086.820226:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.821148:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261603840 00000100:00100000:3.0:1746065086.821156:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261603840 00000100:00100000:3.0:1746065086.821199:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8953 00000100:00100000:3.0:1746065086.821205:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881261603840:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065086.821969:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1746065086.821973:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065086 00002000:00010000:3.0:1746065086.821975:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.821976:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.821978:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 448 -> 520 00000100:00100000:3.0:1746065086.822039:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261603840:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 833us (1817us total) trans 21474840015 rc 0/0 00000100:00100000:3.0:1746065086.822044:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8953 00000100:00100000:0.0:1746065086.825862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.826024:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261603968 00000100:00100000:3.0:1746065086.826032:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261603968 00000100:00100000:3.0:1746065086.826072:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8954 00000100:00100000:3.0:1746065086.826078:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881261603968:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065086.826321:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1746065086.826324:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.826326:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.826328:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.826329:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 520 -> 488 00000100:00100000:3.0:1746065086.826368:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261603968:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 290us (512us total) trans 21474840016 rc 0/0 00000100:00100000:3.0:1746065086.826373:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8954 00000100:00100000:0.0:1746065086.828509:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.828636:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261604096 00000100:00100000:2.0:1746065086.828642:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261604096 00000100:00100000:2.0:1746065086.828672:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8955 00000100:00100000:2.0:1746065086.828678:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881261604096:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.828796:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.828799:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.828801:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.828802:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.828804:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 488 -> 488 00000100:00100000:2.0:1746065086.829402:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881261604096:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 722us (905us total) trans 21474840017 rc 0/0 00000100:00100000:2.0:1746065086.829409:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8955 00000100:00100000:0.0:1746065086.834305:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.834381:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261604224 00000100:00100000:2.0:1746065086.834390:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261604224 00000100:00100000:2.0:1746065086.834430:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8956 00000100:00100000:2.0:1746065086.834437:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881261604224:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.834566:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.834569:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.834571:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.834573:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.834574:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 488 -> 488 00000100:00100000:2.0:1746065086.835270:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261604224:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 831us (971us total) trans 21474840018 rc 0/0 00000100:00100000:2.0:1746065086.835278:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8956 00000100:00100000:0.0:1746065086.837332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.837598:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261604352 00000100:00100000:2.0:1746065086.837605:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261604352 00000100:00100000:2.0:1746065086.837647:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8957 00000100:00100000:2.0:1746065086.837653:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261604352:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.837846:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1746065086.837849:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.837850:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.837853:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.837854:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 488 -> 488 00000100:00100000:2.0:1746065086.837887:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261604352:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 234us (561us total) trans 21474840019 rc 0/0 00000100:00100000:2.0:1746065086.837893:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8957 00000100:00100000:0.0:1746065086.843616:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.843714:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261604608 00000100:00100000:2.0:1746065086.843722:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261604608 00002000:00100000:2.0:1746065086.843758:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (200704->204799) req@ffff880099cfd880 x1830881261604608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.843767:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfd880 with x1830881261604608 ext(200704->204799) 00002000:00010000:2.0:1746065086.843797:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfd880 00000100:00100000:2.0:1746065086.843824:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1382 00000100:00100000:2.0:1746065086.843831:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261604608:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.843959:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261604608:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 128us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065086.843965:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1382 00002000:00100000:2.0:1746065086.843970:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38a:0x0] (200704->204799) req@ffff880099cfd880 x1830881261604608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/4536 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.843977:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfd880 with x1830881261604608 ext(200704->204799) 00002000:00010000:2.0:1746065086.843980:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfd880 00000100:00100000:0.0:1746065086.849375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.849477:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261604864 00000100:00100000:1.0:1746065086.849485:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261604864 00000100:00100000:1.0:1746065086.849548:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12621 00000100:00100000:1.0:1746065086.849555:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+306:28634:x1830881261604864:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:1.0:1746065086.849595:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065086.849617:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b33 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ce expref: 306 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.849645:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.849648:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065086.849766:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.849804:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.849813:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:1.0:1746065086.849845:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975924 00000004:00010000:1.0:1746065086.849861:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cfca80 reply state ffff8800997f6000 transno 4294975925 ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.849869:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.849874:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.849877:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065086.849879:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065086.849937:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+308:28634:x1830881261604864:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 381us (568us total) trans 4294975925 rc 0/0 00000100:00100000:1.0:1746065086.849942:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12621 00000020:00080000:1.0:1746065086.849946:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746065086.854036:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.854390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.854423:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.854555:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261604992 00000100:00100000:1.0:1746065086.854563:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261604992 00002000:00010000:1.0:1746065086.854593:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (67263->18446744073709551615) 00002000:00100000:1.0:1746065086.854596:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0000 with x1830881261604992 ext(67263->18446744073709551615) 00002000:00010000:1.0:1746065086.854605:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc0000. 00000100:00100000:1.0:1746065086.854618:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261605120 00000100:00100000:1.0:1746065086.854620:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261605120 00002000:00010000:1.0:1746065086.854626:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (67263->18446744073709551615) 00002000:00100000:1.0:1746065086.854628:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0e00 with x1830881261605120 ext(67263->18446744073709551615) 00002000:00010000:1.0:1746065086.854632:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc0e00. 00000100:00100000:1.0:1746065086.854640:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261605248 00000100:00100000:1.0:1746065086.854642:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261605248 00002000:00010000:1.0:1746065086.854650:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.854651:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1c00 with x1830881261605248 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.854656:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc1c00. 00000100:00100000:1.0:1746065086.854668:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1383 00000100:00100000:1.0:1746065086.854675:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261604992:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.855011:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 262144 -> 67263 00002000:00010000:1.0:1746065086.855014:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.855016:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:1.0:1746065086.855018:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.855019:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 488 -> 144 00000100:00100000:1.0:1746065086.855062:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261604992:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 387us (1032us total) trans 21474840020 rc 0/0 00000100:00100000:1.0:1746065086.855068:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1383 00002000:00010000:1.0:1746065086.855071:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (67263->18446744073709551615) 00002000:00100000:1.0:1746065086.855072:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0000 with x1830881261604992 ext(67263->18446744073709551615) 00002000:00010000:1.0:1746065086.855076:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc0000. 00000100:00100000:1.0:1746065086.855089:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1384 00000100:00100000:1.0:1746065086.855094:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261605120:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.855169:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 166516 -> 67263 00002000:00010000:1.0:1746065086.855172:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.855173:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.855175:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.855176:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.855192:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881261605120:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 98us (803us total) trans 21474840021 rc 0/0 00000100:00100000:1.0:1746065086.855197:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1384 00002000:00010000:1.0:1746065086.855199:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (67263->18446744073709551615) 00002000:00100000:1.0:1746065086.855201:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0e00 with x1830881261605120 ext(67263->18446744073709551615) 00002000:00010000:1.0:1746065086.855204:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc0e00. 00000100:00100000:1.0:1746065086.855214:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1385 00000100:00100000:1.0:1746065086.855219:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881261605248:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.855267:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.855269:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.855271:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.855273:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.855275:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.855289:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881261605248:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 70us (865us total) trans 17179872704 rc 0/0 00000100:00100000:1.0:1746065086.855294:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1385 00002000:00010000:1.0:1746065086.855296:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.855297:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1c00 with x1830881261605248 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.855300:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc1c00. 00000100:00100000:0.0:1746065086.857577:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.858236:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261605376 00000100:00100000:3.0:1746065086.858244:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261605376 00000100:00100000:3.0:1746065086.858411:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12622 00000100:00100000:3.0:1746065086.858418:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+308:28634:x1830881261605376:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065086.858437:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.858452:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbc00/0xad6b7ddc1464b41 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5d5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.858526:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc1464b48 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.858537:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc1464b48 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.858546:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc1464b48 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065086.858563:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 67263 00000004:00200000:3.0:1746065086.858565:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065086.858576:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc1464b48 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.858597:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdbc00/0xad6b7ddc1464b41 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5d5 expref: 310 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.858822:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc1464b48 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5d5 expref: 309 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.858829:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.858831:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065086.858833:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:3.0:1746065086.859244:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+309:28634:x1830881261605376:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 826us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.859249:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12622 00000100:00100000:0.0:1746065086.861758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.861995:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261605504 00000100:00100000:2.0:1746065086.862001:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261605504 00000100:00100000:2.0:1746065086.862045:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8958 00000100:00100000:2.0:1746065086.862052:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261605504:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.862335:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 67263 -> 67263 00002000:00010000:2.0:1746065086.862338:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.862339:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.862341:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.862343:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 144 -> 136 00000100:00100000:2.0:1746065086.863080:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261605504:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 1026us (1325us total) trans 21474840022 rc 0/0 00000100:00100000:2.0:1746065086.863087:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8958 00000100:00100000:2.0:1746065086.869184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.869426:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261605632 00000100:00100000:0.0:1746065086.869434:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261605632 00000100:00100000:0.0:1746065086.869476:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8959 00000100:00100000:0.0:1746065086.869482:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881261605632:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:0.0:1746065086.869753:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 67263 -> 67263 00002000:00010000:0.0:1746065086.869756:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:0.0:1746065086.869758:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:0.0:1746065086.869760:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:0.0:1746065086.869762:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:0.0:1746065086.869818:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261605632:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 335us (639us total) trans 21474840023 rc 0/0 00000100:00100000:0.0:1746065086.869824:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8959 00000100:00100000:0.0:1746065086.874056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.874729:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261605888 00000100:00100000:3.0:1746065086.874738:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261605888 00000100:00100000:3.0:1746065086.875217:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12623 00000100:00100000:3.0:1746065086.875224:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+309:28634:x1830881261605888:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:3.0:1746065086.875261:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065086.875281:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdae00/0xad6b7ddc1464b48 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5d5 expref: 309 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.875302:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.875305:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065086.875409:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.875419:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.875429:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:3.0:1746065086.875451:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975926 00000004:00010000:3.0:1746065086.875462:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cfc700 reply state ffff88009aa05000 transno 4294975927 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.875468:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.875473:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.875475:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065086.875477:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065086.876198:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+311:28634:x1830881261605888:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 972us (2146us total) trans 4294975927 rc 0/0 00000100:00100000:3.0:1746065086.876203:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12623 00000020:00080000:3.0:1746065086.876207:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.878447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.878483:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.878957:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606016 00000100:00100000:3.0:1746065086.878965:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606016 00002000:00010000:3.0:1746065086.878994:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (56037->18446744073709551615) 00002000:00100000:3.0:1746065086.878998:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfe680 with x1830881261606016 ext(56037->18446744073709551615) 00002000:00010000:3.0:1746065086.879008:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfe680. 00000100:00100000:0.0:1746065086.879163:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.879372:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606144 00000100:00100000:3.0:1746065086.879375:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606144 00002000:00010000:3.0:1746065086.879384:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (56037->18446744073709551615) 00002000:00100000:3.0:1746065086.879387:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cffb80 with x1830881261606144 ext(56037->18446744073709551615) 00002000:00010000:3.0:1746065086.879391:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cffb80. 00000100:00100000:3.0:1746065086.879399:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606272 00000100:00100000:3.0:1746065086.879401:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606272 00002000:00010000:3.0:1746065086.879409:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.879411:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfe300 with x1830881261606272 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.879415:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cfe300. 00000100:00100000:3.0:1746065086.879425:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1386 00000100:00100000:3.0:1746065086.879430:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261606016:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.879698:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 67263 -> 56037 00002000:00010000:3.0:1746065086.879701:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.879703:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:3.0:1746065086.879704:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.879705:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 136 -> 112 00000100:00100000:3.0:1746065086.879737:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261606016:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 307us (1296us total) trans 21474840024 rc 0/0 00000100:00100000:3.0:1746065086.879742:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1386 00002000:00010000:3.0:1746065086.879745:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (56037->18446744073709551615) 00002000:00100000:3.0:1746065086.879746:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfe680 with x1830881261606016 ext(56037->18446744073709551615) 00002000:00010000:3.0:1746065086.879749:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfe680. 00000100:00100000:3.0:1746065086.879762:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1387 00000100:00100000:3.0:1746065086.879767:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261606144:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.879857:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 67263 -> 56037 00002000:00010000:3.0:1746065086.879860:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.879861:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.879863:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.879865:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.879882:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261606144:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 114us (1398us total) trans 21474840025 rc 0/0 00000100:00100000:3.0:1746065086.879890:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1387 00002000:00010000:3.0:1746065086.879892:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (56037->18446744073709551615) 00002000:00100000:3.0:1746065086.879893:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cffb80 with x1830881261606144 ext(56037->18446744073709551615) 00002000:00010000:3.0:1746065086.879897:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cffb80. 00000100:00100000:3.0:1746065086.879905:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1388 00000100:00100000:3.0:1746065086.879909:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881261606272:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.879958:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065086.879959:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.879961:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065086.879963:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.879964:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.879977:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881261606272:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 68us (816us total) trans 17179872705 rc 0/0 00000100:00100000:3.0:1746065086.879981:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1388 00002000:00010000:3.0:1746065086.879983:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065086.879985:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfe300 with x1830881261606272 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065086.879988:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cfe300. 00000100:00100000:0.0:1746065086.882686:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.882764:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606400 00000100:00100000:3.0:1746065086.882789:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606400 00000100:00100000:3.0:1746065086.882833:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12624 00000100:00100000:3.0:1746065086.882840:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+311:28634:x1830881261606400:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065086.882857:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.882871:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b56 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5dc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.882947:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1464b5d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.882958:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1464b5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.882966:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1464b5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065086.882985:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 56037 00000004:00200000:3.0:1746065086.882988:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065086.883000:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1464b5d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.883018:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b56 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5dc expref: 313 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.883030:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1464b5d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5dc expref: 312 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.883037:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.883039:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065086.883041:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdac00, rc 0) 00000100:00100000:3.0:1746065086.884292:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+312:28634:x1830881261606400:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 1449us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.884299:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12624 00000100:00100000:3.0:1746065086.888483:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.888560:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606528 00000100:00100000:2.0:1746065086.888568:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606528 00000100:00100000:2.0:1746065086.888607:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8960 00000100:00100000:2.0:1746065086.888613:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261606528:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.888756:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 56037 -> 56037 00002000:00010000:2.0:1746065086.888759:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.888761:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065086 00002000:00010000:2.0:1746065086.888762:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065086 00002000:00010000:2.0:1746065086.888764:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 112 -> 136 00000100:00100000:2.0:1746065086.889605:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881261606528:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 990us (1126us total) trans 21474840026 rc 0/0 00000100:00100000:2.0:1746065086.889612:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8960 00000100:00100000:0.0:1746065086.896009:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.896121:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606784 00000100:00100000:2.0:1746065086.896129:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606784 00002000:00100000:2.0:1746065086.896166:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (4096->172031) req@ffff880099cff800 x1830881261606784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.896175:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cff800 with x1830881261606784 ext(4096->172031) 00002000:00010000:2.0:1746065086.896180:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cff800 00000100:00100000:2.0:1746065086.896197:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1389 00000100:00100000:2.0:1746065086.896204:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881261606784:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:2.0:1746065086.898694:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881261606784:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2483us (2685us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1746065086.898702:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1389 00002000:00100000:2.0:1746065086.898708:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (4096->172031) req@ffff880099cff800 x1830881261606784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.898715:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cff800 with x1830881261606784 ext(4096->172031) 00002000:00010000:2.0:1746065086.898719:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cff800 00000100:00100000:0.0:1746065086.900815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.900921:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261606912 00000100:00100000:2.0:1746065086.900928:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261606912 00002000:00100000:2.0:1746065086.900960:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (16384->175675) req@ffff880099cfdf80 x1830881261606912/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.900968:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfdf80 with x1830881261606912 ext(16384->175675) 00002000:00010000:2.0:1746065086.900972:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfdf80 00000100:00100000:2.0:1746065086.901314:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1390 00000100:00100000:2.0:1746065086.901320:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881261606912:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:2.0:1746065086.905288:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881261606912:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 3960us (4470us total) trans 21474840027 rc 0/0 00000100:00100000:2.0:1746065086.905297:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1390 00002000:00100000:2.0:1746065086.905307:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38a:0x0] (16384->175675) req@ffff880099cfdf80 x1830881261606912/t21474840027(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 504/448 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:2.0:1746065086.905316:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cfdf80 with x1830881261606912 ext(16384->175675) 00002000:00010000:2.0:1746065086.905321:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cfdf80 00000100:00100000:0.0:1746065086.906919:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.907005:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607040 00000100:00100000:3.0:1746065086.907012:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607040 00000100:00100000:3.0:1746065086.907654:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12625 00000100:00100000:3.0:1746065086.907662:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+312:28634:x1830881261607040:12345-192.168.202.27@tcp:44:fsx.0 00000100:00100000:3.0:1746065086.907760:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+312:28634:x1830881261607040:12345-192.168.202.27@tcp:44:fsx.0 Request processed in 99us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.907766:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12625 00000100:00100000:0.0:1746065086.913313:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.913418:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607168 00000100:00100000:2.0:1746065086.913426:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607168 00000100:00100000:2.0:1746065086.917586:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8961 00000100:00100000:2.0:1746065086.917602:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881261607168:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065086.918800:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840027 is committed 00000100:00100000:2.0:1746065086.918973:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881261607168:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 1375us (5664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065086.918981:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8961 00000100:00100000:0.0:1746065086.923725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.923793:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607424 00000100:00100000:1.0:1746065086.923802:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607424 00000100:00100000:1.0:1746065086.923881:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12626 00000100:00100000:1.0:1746065086.923887:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+312:28634:x1830881261607424:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:1.0:1746065086.923929:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065086.923952:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdac00/0xad6b7ddc1464b5d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5dc expref: 312 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.924218:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.924222:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065086.924329:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.924341:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.924348:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:1.0:1746065086.924370:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975928 00000004:00010000:1.0:1746065086.924382:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099d14e00 reply state ffff8800997f4000 transno 4294975929 ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.924392:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.924397:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.924399:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065086.924401:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065086.925953:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+314:28634:x1830881261607424:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 2060us (2229us total) trans 4294975929 rc 0/0 00000100:00100000:1.0:1746065086.925961:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12626 00000020:00080000:1.0:1746065086.925967:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.930149:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.930185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.930225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.930297:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607680 00000100:00100000:1.0:1746065086.930305:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607680 00002000:00010000:1.0:1746065086.930339:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (111076->18446744073709551615) 00002000:00100000:1.0:1746065086.930343:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d15880 with x1830881261607680 ext(111076->18446744073709551615) 00002000:00010000:1.0:1746065086.930353:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d15880. 00000100:00100000:1.0:1746065086.930381:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607552 00000100:00100000:1.0:1746065086.930384:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607552 00002000:00010000:1.0:1746065086.930391:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (111076->18446744073709551615) 00002000:00100000:1.0:1746065086.930394:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d16a00 with x1830881261607552 ext(111076->18446744073709551615) 00002000:00010000:1.0:1746065086.930398:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d16a00. 00000100:00100000:1.0:1746065086.930407:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607808 00000100:00100000:1.0:1746065086.930409:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607808 00002000:00010000:1.0:1746065086.930417:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.930419:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d14a80 with x1830881261607808 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.930424:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099d14a80. 00000100:00100000:1.0:1746065086.930436:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1391 00000100:00100000:1.0:1746065086.930443:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881261607680:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.930620:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 56037 -> 111076 00002000:00010000:1.0:1746065086.930624:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.930626:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.930627:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.930629:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.930669:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261607680:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 225us (525us total) trans 21474840028 rc 0/0 00000100:00100000:1.0:1746065086.930675:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1391 00002000:00010000:1.0:1746065086.930678:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (111076->18446744073709551615) 00002000:00100000:1.0:1746065086.930680:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d15880 with x1830881261607680 ext(111076->18446744073709551615) 00002000:00010000:1.0:1746065086.930683:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d15880. 00000100:00100000:1.0:1746065086.930697:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1392 00000100:00100000:1.0:1746065086.930702:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881261607552:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.930864:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 56037 -> 111076 00002000:00010000:1.0:1746065086.930866:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.930868:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.930869:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065086 -> 1746065087 00002000:00010000:1.0:1746065086.930871:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 136 -> 112 00000100:00100000:1.0:1746065086.930888:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881261607552:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 185us (702us total) trans 21474840029 rc 0/0 00000100:00100000:1.0:1746065086.930893:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1392 00002000:00010000:1.0:1746065086.930895:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (111076->18446744073709551615) 00002000:00100000:1.0:1746065086.930897:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d16a00 with x1830881261607552 ext(111076->18446744073709551615) 00002000:00010000:1.0:1746065086.930900:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d16a00. 00000100:00100000:1.0:1746065086.930910:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1393 00000100:00100000:1.0:1746065086.930915:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881261607808:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.930962:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.930964:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.930966:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.930967:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.930969:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.930983:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881261607808:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 68us (758us total) trans 17179872706 rc 0/0 00000100:00100000:1.0:1746065086.930988:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1393 00002000:00010000:1.0:1746065086.930990:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.930992:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d14a80 with x1830881261607808 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.930995:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099d14a80. 00000100:00100000:0.0:1746065086.933757:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.933853:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261607936 00000100:00100000:1.0:1746065086.933860:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261607936 00000100:00100000:1.0:1746065086.933946:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12627 00000100:00100000:1.0:1746065086.933953:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+314:28634:x1830881261607936:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:1.0:1746065086.933972:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065086.933988:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b6b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5e3 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.934055:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464b72 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.934067:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464b72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.934076:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464b72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:1.0:1746065086.934092:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 111076 00000004:00200000:1.0:1746065086.934095:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065086.934106:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464b72 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.934125:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b6b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5e3 expref: 316 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.934212:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464b72 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5e3 expref: 315 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.934219:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.934221:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065086.934223:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cccc00, rc 0) 00000100:00100000:1.0:1746065086.935644:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+315:28634:x1830881261607936:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 1688us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.935650:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12627 00000100:00100000:0.0:1746065086.939738:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.939900:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261608192 00000100:00100000:1.0:1746065086.939908:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261608192 00000100:00100000:1.0:1746065086.940075:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12628 00000100:00100000:1.0:1746065086.940083:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+315:28634:x1830881261608192:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:1.0:1746065086.940125:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065086.940146:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099cccc00/0xad6b7ddc1464b72 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5e3 expref: 315 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.940540:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.940545:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065086.940672:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.940686:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.940693:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:1.0:1746065086.940724:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975930 00000004:00010000:1.0:1746065086.940741:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099d15500 reply state ffff8800997f5000 transno 4294975931 ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.940749:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.940754:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.940756:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065086.940758:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065086.940848:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+317:28634:x1830881261608192:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 765us (1117us total) trans 4294975931 rc 0/0 00000100:00100000:1.0:1746065086.940854:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12628 00000020:00080000:1.0:1746065086.940858:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.943813:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.943847:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.944485:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261608448 00000100:00100000:2.0:1746065086.944492:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261608448 00000100:00100000:0.0:1746065086.944520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065086.944530:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (175316->18446744073709551615) 00002000:00100000:2.0:1746065086.944533:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d14380 with x1830881261608448 ext(175316->18446744073709551615) 00002000:00010000:2.0:1746065086.944542:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d14380. 00000100:00100000:2.0:1746065086.944637:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261608320 00000100:00100000:2.0:1746065086.944639:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261608320 00002000:00010000:2.0:1746065086.944646:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (175316->18446744073709551615) 00002000:00100000:2.0:1746065086.944648:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d16300 with x1830881261608320 ext(175316->18446744073709551615) 00002000:00010000:2.0:1746065086.944652:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d16300. 00000100:00100000:2.0:1746065086.944669:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261608576 00000100:00100000:2.0:1746065086.944671:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261608576 00002000:00010000:2.0:1746065086.944678:0:29490:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.944680:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d15180 with x1830881261608576 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.944684:0:29490:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099d15180. 00000100:00100000:3.0:1746065086.944702:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1394 00000100:00100000:3.0:1746065086.944715:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1395 00000100:00100000:3.0:1746065086.944721:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881261608320:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:1.0:1746065086.944941:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1396 00000100:00100000:1.0:1746065086.944948:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881261608576:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.945009:0:29488:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065086.945012:0:29488:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.945014:0:29488:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.945015:0:29488:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.945017:0:29488:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065086.945051:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881261608576:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 103us (531us total) trans 17179872707 rc 0/0 00000100:00100000:1.0:1746065086.945057:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1396 00002000:00010000:1.0:1746065086.945060:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.945062:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d15180 with x1830881261608576 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.945066:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099d15180. 00000100:00100000:2.0:1746065086.945756:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261608448:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.945869:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 111076 -> 175316 00002000:00010000:2.0:1746065086.945871:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.945873:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.945875:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.945877:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.945989:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881261608448:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 1278us (2182us total) trans 21474840031 rc 0/0 00000100:00100000:2.0:1746065086.945995:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1394 00002000:00010000:2.0:1746065086.945998:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (175316->18446744073709551615) 00002000:00100000:2.0:1746065086.946000:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d14380 with x1830881261608448 ext(175316->18446744073709551615) 00002000:00010000:2.0:1746065086.946005:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d14380. 00002000:00010000:3.0:1746065086.946113:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 111076 -> 175316 00002000:00010000:3.0:1746065086.946116:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.946117:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.946119:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.946121:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 112 -> 112 00000100:00100000:3.0:1746065086.946141:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881261608320:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 1421us (2292us total) trans 21474840030 rc 0/0 00000100:00100000:3.0:1746065086.946147:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1395 00002000:00010000:3.0:1746065086.946149:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (175316->18446744073709551615) 00002000:00100000:3.0:1746065086.946151:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099d16300 with x1830881261608320 ext(175316->18446744073709551615) 00002000:00010000:3.0:1746065086.946155:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099d16300. 00000100:00100000:0.0:1746065086.947887:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.947942:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261608704 00000100:00100000:1.0:1746065086.947948:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261608704 00000100:00100000:1.0:1746065086.947988:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12629 00000100:00100000:1.0:1746065086.947993:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+317:28634:x1830881261608704:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:1.0:1746065086.948010:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065086.948024:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccce00/0xad6b7ddc1464b80 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5ea expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.948085:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464b87 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.948095:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464b87 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.948104:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464b87 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:1.0:1746065086.948120:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 175316 00000004:00200000:1.0:1746065086.948123:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065086.948133:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464b87 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.948150:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccce00/0xad6b7ddc1464b80 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ea expref: 319 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.948177:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464b87 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ea expref: 318 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.948184:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.948186:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065086.948188:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1d1000, rc 0) 00000100:00100000:1.0:1746065086.948212:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+318:28634:x1830881261608704:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 219us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065086.948217:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12629 00000100:00100000:0.0:1746065086.950258:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.950354:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261608832 00000100:00100000:2.0:1746065086.950361:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261608832 00000100:00100000:2.0:1746065086.950395:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8962 00000100:00100000:2.0:1746065086.950401:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881261608832:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.951380:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 175316 -> 175316 00002000:00010000:2.0:1746065086.951385:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.951389:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.951391:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.951392:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 112 -> 192 00000100:00100000:2.0:1746065086.951728:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881261608832:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 1324us (1473us total) trans 21474840032 rc 0/0 00000100:00100000:2.0:1746065086.951735:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8962 00000100:00100000:0.0:1746065086.954554:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.955407:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261609088 00000100:00100000:3.0:1746065086.955416:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261609088 00002000:00100000:3.0:1746065086.955452:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (114688->176127) req@ffff88008c53e300 x1830881261609088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.955460:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53e300 with x1830881261609088 ext(114688->176127) 00002000:00010000:3.0:1746065086.955465:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53e300 00000100:00100000:3.0:1746065086.955528:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1397 00000100:00100000:3.0:1746065086.955535:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261609088:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.958162:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261609088:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2621us (3607us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1746065086.958171:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1397 00002000:00100000:3.0:1746065086.958180:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (114688->176127) req@ffff88008c53e300 x1830881261609088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.958188:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53e300 with x1830881261609088 ext(114688->176127) 00002000:00010000:3.0:1746065086.958192:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53e300 00000100:00100000:0.0:1746065086.961533:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.961657:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261609216 00000100:00100000:2.0:1746065086.961664:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261609216 00000100:00100000:2.0:1746065086.961706:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8963 00000100:00100000:2.0:1746065086.961713:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261609216:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.962315:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 175316 -> 175316 00002000:00010000:2.0:1746065086.962318:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.962320:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.962321:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.962323:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 192 -> 160 00000100:00100000:2.0:1746065086.962569:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261609216:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 855us (1042us total) trans 21474840033 rc 0/0 00000100:00100000:2.0:1746065086.962576:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8963 00000100:00100000:0.0:1746065086.965895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.966017:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261609344 00000100:00100000:2.0:1746065086.966024:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261609344 00000100:00100000:2.0:1746065086.966071:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8964 00000100:00100000:2.0:1746065086.966077:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261609344:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:2.0:1746065086.966331:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 175316 -> 175316 00002000:00010000:2.0:1746065086.966334:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.966336:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.966338:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.966339:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 160 -> 216 00000100:00100000:2.0:1746065086.966379:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261609344:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 302us (491us total) trans 21474840034 rc 0/0 00000100:00100000:2.0:1746065086.966385:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8964 00000100:00100000:0.0:1746065086.969089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.969575:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261609472 00000100:00100000:1.0:1746065086.969581:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261609472 00000100:00100000:1.0:1746065086.969621:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8965 00000100:00100000:1.0:1746065086.969627:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261609472:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065086.969833:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 175316 -> 175316 00002000:00010000:1.0:1746065086.969836:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.969838:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.969840:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.969841:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 216 -> 144 00000100:00100000:1.0:1746065086.969872:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881261609472:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 245us (791us total) trans 21474840035 rc 0/0 00000100:00100000:1.0:1746065086.969877:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8965 00000100:00100000:0.0:1746065086.973961:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.974055:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261609728 00000100:00100000:3.0:1746065086.974063:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261609728 00002000:00100000:3.0:1746065086.974103:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (110592->176127) req@ffff88008c53c000 x1830881261609728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/0 e 0 to 0 dl 1746065097 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.974112:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53c000 with x1830881261609728 ext(110592->176127) 00002000:00010000:3.0:1746065086.974117:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53c000 00000100:00100000:3.0:1746065086.974339:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1398 00000100:00100000:3.0:1746065086.974346:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261609728:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:3.0:1746065086.976433:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261609728:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2080us (2472us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1746065086.976442:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1398 00002000:00100000:3.0:1746065086.976452:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x38a:0x0] (110592->176127) req@ffff88008c53c000 x1830881261609728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:2/0 lens 488/440 e 0 to 0 dl 1746065097 ref 1 fl Complete:/200/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 00002000:00100000:3.0:1746065086.976460:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53c000 with x1830881261609728 ext(110592->176127) 00002000:00010000:3.0:1746065086.976464:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53c000 00000100:00100000:0.0:1746065086.979146:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.979261:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261609984 00000100:00100000:3.0:1746065086.979271:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261609984 00000100:00100000:3.0:1746065086.979355:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12630 00000100:00100000:3.0:1746065086.979362:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+318:28634:x1830881261609984:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:3.0:1746065086.979403:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065086.979427:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008f1d1000/0xad6b7ddc1464b87 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ea expref: 318 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.979578:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.979583:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065086.979718:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.979730:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.979738:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:3.0:1746065086.979767:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975932 00000004:00010000:3.0:1746065086.979814:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c53d880 reply state ffff88009aa02000 transno 4294975933 ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.979822:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.979827:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.979829:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065086.979831:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065086.980204:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+320:28634:x1830881261609984:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 841us (1063us total) trans 4294975933 rc 0/0 00000100:00100000:3.0:1746065086.980211:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12630 00000020:00080000:3.0:1746065086.980216:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.982336:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.982606:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261610112 00000100:00100000:3.0:1746065086.982615:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261610112 00002000:00010000:3.0:1746065086.982645:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (160801->18446744073709551615) 00002000:00100000:3.0:1746065086.982649:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53f800 with x1830881261610112 ext(160801->18446744073709551615) 00002000:00010000:3.0:1746065086.982657:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53f800. 00000100:00100000:0.0:1746065086.982977:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.983489:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.983512:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261610240 00000100:00100000:3.0:1746065086.983516:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261610240 00002000:00010000:3.0:1746065086.983530:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (160801->18446744073709551615) 00002000:00100000:3.0:1746065086.983533:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53d500 with x1830881261610240 ext(160801->18446744073709551615) 00002000:00010000:3.0:1746065086.983538:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53d500. 00000100:00100000:3.0:1746065086.983558:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1399 00000100:00100000:3.0:1746065086.983565:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261610112:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:3.0:1746065086.983745:0:29493:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 175316 -> 160801 00002000:00010000:3.0:1746065086.983748:0:29493:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.983750:0:29493:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.983752:0:29493:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065086.983754:0:29493:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 144 -> 136 00000100:00100000:1.0:1746065086.983891:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261610368 00000100:00100000:1.0:1746065086.983895:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261610368 00002000:00010000:1.0:1746065086.983907:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:1.0:1746065086.983909:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53f480 with x1830881261610368 ext(0->18446744073709551615) 00002000:00010000:1.0:1746065086.983914:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53f480. 00000100:00100000:1.0:1746065086.983930:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1400 00000100:00100000:1.0:1746065086.983934:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261610240:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065086.984012:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 175316 -> 160801 00002000:00010000:1.0:1746065086.984015:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.984017:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065086.984018:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065086.984020:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.984140:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1401 00000100:00100000:2.0:1746065086.984154:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881261610368:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.984207:0:20324:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.984209:0:20324:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.984211:0:20324:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.984213:0:20324:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.984214:0:20324:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065086.984875:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261610112:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 1308us (2543us total) trans 21474840036 rc 0/0 00000100:00100000:3.0:1746065086.984882:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1399 00002000:00010000:3.0:1746065086.984886:0:29493:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (160801->18446744073709551615) 00002000:00100000:3.0:1746065086.984888:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53f800 with x1830881261610112 ext(160801->18446744073709551615) 00002000:00010000:3.0:1746065086.984893:0:29493:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53f800. 00000100:00100000:1.0:1746065086.985084:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261610240:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 1149us (2108us total) trans 21474840037 rc 0/0 00000100:00100000:1.0:1746065086.985090:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1400 00002000:00010000:1.0:1746065086.985092:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (160801->18446744073709551615) 00002000:00100000:1.0:1746065086.985094:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53d500 with x1830881261610240 ext(160801->18446744073709551615) 00002000:00010000:1.0:1746065086.985099:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c53d500. 00000100:00100000:2.0:1746065086.985141:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261610368:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 995us (1652us total) trans 17179872708 rc 0/0 00000100:00100000:2.0:1746065086.985146:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1401 00002000:00010000:2.0:1746065086.985148:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.985150:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c53f480 with x1830881261610368 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.985153:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c53f480. 00000100:00100000:0.0:1746065086.987225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065086.987301:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261610496 00000100:00100000:3.0:1746065086.987308:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261610496 00000100:00100000:3.0:1746065086.987352:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12631 00000100:00100000:3.0:1746065086.987357:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+320:28634:x1830881261610496:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065086.987377:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065086.987391:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464b95 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5f1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.987461:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464b9c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065086.987474:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464b9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.987485:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464b9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065086.987513:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 160801 00000004:00200000:3.0:1746065086.987517:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065086.987529:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464b9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065086.987548:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464b95 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5f1 expref: 322 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.987574:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464b9c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5f1 expref: 321 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065086.987580:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065086.987583:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065086.987585:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b000, rc 0) 00000100:00100000:3.0:1746065086.987622:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+321:28634:x1830881261610496:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 264us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065086.987630:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12631 00000100:00100000:0.0:1746065086.993004:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065086.993112:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261610752 00000100:00100000:1.0:1746065086.993120:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261610752 00000100:00100000:1.0:1746065086.993170:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12632 00000100:00100000:1.0:1746065086.993177:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+321:28634:x1830881261610752:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:1.0:1746065086.993220:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065086.993243:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464b9c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5f1 expref: 321 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065086.993273:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.993277:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065086.993413:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065086.993427:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.993435:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000001:00080000:1.0:1746065086.993470:0:9571:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975934 00000004:00010000:1.0:1746065086.993485:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c53ce00 reply state ffff8800997f3000 transno 4294975935 ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.993507:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065086.993513:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065086.993515:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065086.993517:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065086.993580:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+323:28634:x1830881261610752:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 402us (584us total) trans 4294975935 rc 0/0 00000100:00100000:1.0:1746065086.993586:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12632 00000020:00080000:1.0:1746065086.993590:0:9571:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065086.996300:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.997014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065086.997521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065086.997847:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261610880 00000100:00100000:2.0:1746065086.997855:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261610880 00002000:00010000:2.0:1746065086.997885:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (228256->18446744073709551615) 00002000:00100000:2.0:1746065086.997889:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098672d80 with x1830881261610880 ext(228256->18446744073709551615) 00002000:00010000:2.0:1746065086.997898:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098672d80. 00000100:00100000:2.0:1746065086.997919:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611136 00000100:00100000:2.0:1746065086.997921:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611136 00002000:00010000:2.0:1746065086.997930:0:29488:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.997933:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098670380 with x1830881261611136 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.997938:0:29488:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098670380. 00000100:00100000:2.0:1746065086.997951:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611008 00000100:00100000:2.0:1746065086.997953:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611008 00002000:00010000:2.0:1746065086.997961:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (228256->18446744073709551615) 00002000:00100000:2.0:1746065086.997963:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098673480 with x1830881261611008 ext(228256->18446744073709551615) 00002000:00010000:2.0:1746065086.997967:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098673480. 00000100:00100000:2.0:1746065086.997978:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1402 00000100:00100000:2.0:1746065086.997984:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261610880:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.998136:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 160801 -> 228256 00002000:00010000:2.0:1746065086.998139:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998141:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998142:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998144:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:2.0:1746065086.998179:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261610880:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 194us (1890us total) trans 21474840038 rc 0/0 00000100:00100000:2.0:1746065086.998185:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1402 00002000:00010000:2.0:1746065086.998188:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (228256->18446744073709551615) 00002000:00100000:2.0:1746065086.998189:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098672d80 with x1830881261610880 ext(228256->18446744073709551615) 00002000:00010000:2.0:1746065086.998193:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098672d80. 00000100:00100000:2.0:1746065086.998205:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1403 00000100:00100000:2.0:1746065086.998209:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881261611136:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.998262:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065086.998264:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998266:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.998268:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998269:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.998285:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261611136:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 75us (1272us total) trans 17179872709 rc 0/0 00000100:00100000:2.0:1746065086.998289:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1403 00002000:00010000:2.0:1746065086.998291:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:2.0:1746065086.998293:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098670380 with x1830881261611136 ext(0->18446744073709551615) 00002000:00010000:2.0:1746065086.998296:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098670380. 00000100:00100000:2.0:1746065086.998305:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1404 00000100:00100000:2.0:1746065086.998309:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881261611008:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:2.0:1746065086.998368:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 160801 -> 228256 00002000:00010000:2.0:1746065086.998371:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998372:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065086.998374:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065086.998375:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065086.998391:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881261611008:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 81us (871us total) trans 21474840039 rc 0/0 00000100:00100000:2.0:1746065086.998396:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1404 00002000:00010000:2.0:1746065086.998398:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (228256->18446744073709551615) 00002000:00100000:2.0:1746065086.998400:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098673480 with x1830881261611008 ext(228256->18446744073709551615) 00002000:00010000:2.0:1746065086.998403:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098673480. 00000100:00100000:0.0:1746065087.001303:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.001739:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611392 00000100:00100000:1.0:1746065087.001748:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611392 00002000:00100000:1.0:1746065087.001968:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38a:0x0] (176128->229375) req@ffff880098671500 x1830881261611392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/0 e 0 to 0 dl 1746065098 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1746065087.001977:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098671500 with x1830881261611392 ext(176128->229375) 00002000:00010000:1.0:1746065087.001982:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098671500 00000100:00080000:2.0:1746065087.002408:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065087.002439:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1405 00000100:00100000:1.0:1746065087.002450:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261611392:12345-192.168.202.27@tcp:3:fsx.0 00000100:00100000:1.0:1746065087.004903:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261611392:12345-192.168.202.27@tcp:3:fsx.0 Request processed in 2448us (3600us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1746065087.004913:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1405 00002000:00100000:1.0:1746065087.004921:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38a:0x0] (176128->229375) req@ffff880098671500 x1830881261611392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/440 e 0 to 0 dl 1746065098 ref 1 fl Complete:/200/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1746065087.004937:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098671500 with x1830881261611392 ext(176128->229375) 00002000:00010000:1.0:1746065087.004942:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098671500 00000100:00100000:0.0:1746065087.007760:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.007851:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611520 00000100:00100000:1.0:1746065087.007858:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611520 00002000:00100000:1.0:1746065087.007891:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38a:0x0] (200704->228255) req@ffff880098671c00 x1830881261611520/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/0 e 0 to 0 dl 1746065098 ref 1 fl New:/200/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1746065087.007900:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098671c00 with x1830881261611520 ext(200704->228255) 00002000:00010000:1.0:1746065087.007904:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098671c00 00000100:00100000:1.0:1746065087.008158:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1406 00000100:00100000:1.0:1746065087.008164:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881261611520:12345-192.168.202.27@tcp:4:fsx.0 00000100:00100000:1.0:1746065087.010302:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881261611520:12345-192.168.202.27@tcp:4:fsx.0 Request processed in 2132us (2542us total) trans 21474840040 rc 0/0 00000100:00100000:1.0:1746065087.010310:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1406 00002000:00100000:1.0:1746065087.010317:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38a:0x0] (200704->228255) req@ffff880098671c00 x1830881261611520/t21474840040(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/448 e 0 to 0 dl 1746065098 ref 1 fl Complete:/200/0 rc 0/0 job:'fsx.0' uid:0 gid:0 00002000:00100000:1.0:1746065087.010325:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098671c00 with x1830881261611520 ext(200704->228255) 00002000:00010000:1.0:1746065087.010329:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098671c00 00000100:00100000:0.0:1746065087.012031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.012212:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611648 00000100:00100000:3.0:1746065087.012220:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611648 00000100:00100000:3.0:1746065087.012309:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12633 00000100:00100000:3.0:1746065087.012316:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+323:28634:x1830881261611648:12345-192.168.202.27@tcp:44:fsx.0 00000100:00100000:3.0:1746065087.012526:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+323:28634:x1830881261611648:12345-192.168.202.27@tcp:44:fsx.0 Request processed in 210us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.012532:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12633 00000100:00100000:0.0:1746065087.014596:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.014690:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611776 00000100:00100000:3.0:1746065087.014697:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611776 00000100:00100000:3.0:1746065087.014810:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8966 00000100:00100000:3.0:1746065087.014818:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881261611776:12345-192.168.202.27@tcp:16:fsx.0 00000001:00080000:0.0:1746065087.016129:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840040 is committed 00000100:00100000:3.0:1746065087.016462:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261611776:12345-192.168.202.27@tcp:16:fsx.0 Request processed in 1642us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.016470:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8966 00000100:00100000:0.0:1746065087.022902:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.022987:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261611904 00000100:00100000:3.0:1746065087.022994:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261611904 00000100:00100000:3.0:1746065087.023040:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12634 00000100:00100000:3.0:1746065087.023046:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+323:28634:x1830881261611904:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065087.023063:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.023079:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ba00/0xad6b7ddc1464baa lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5f8 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.023145:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1464bb1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.023161:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1464bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.023170:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1464bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065087.023187:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 228256 00000004:00200000:3.0:1746065087.023190:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065087.023201:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1464bb1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.023218:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71ba00/0xad6b7ddc1464baa lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5f8 expref: 325 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.023739:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1464bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5f8 expref: 324 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.023747:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.023750:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065087.023752:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71bc00, rc 0) 00000100:00100000:3.0:1746065087.023820:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+324:28634:x1830881261611904:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 773us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.023826:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12634 00000100:00100000:0.0:1746065087.027475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.027712:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612032 00000100:00100000:3.0:1746065087.027720:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612032 00000100:00100000:3.0:1746065087.027807:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8967 00000100:00100000:3.0:1746065087.027815:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881261612032:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065087.028018:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 228256 -> 228256 00002000:00010000:3.0:1746065087.028021:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.028024:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.028026:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.028028:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 136 -> 208 00000100:00100000:3.0:1746065087.028114:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881261612032:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 299us (644us total) trans 21474840041 rc 0/0 00000100:00100000:3.0:1746065087.028121:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8967 00000100:00100000:0.0:1746065087.030323:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.030399:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612160 00000100:00100000:3.0:1746065087.030405:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612160 00000100:00100000:3.0:1746065087.030482:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8968 00000100:00100000:3.0:1746065087.030489:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881261612160:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065087.030661:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 228256 -> 228256 00002000:00010000:3.0:1746065087.030663:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.030665:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.030667:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.030669:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 208 -> 208 00000100:00100000:3.0:1746065087.030981:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881261612160:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 491us (661us total) trans 21474840042 rc 0/0 00000100:00100000:3.0:1746065087.030986:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8968 00000100:00100000:0.0:1746065087.034409:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.034477:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612416 00000100:00100000:3.0:1746065087.034484:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612416 00000100:00100000:3.0:1746065087.034721:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12635 00000100:00100000:3.0:1746065087.034729:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+324:28634:x1830881261612416:12345-192.168.202.27@tcp:36:fsx.0 00010000:00010000:3.0:1746065087.034765:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065087.034815:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71bc00/0xad6b7ddc1464bb1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5f8 expref: 324 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.034835:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.034839:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065087.034957:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.034969:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.034977:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000001:00080000:3.0:1746065087.035001:0:7231:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975936 00000004:00010000:3.0:1746065087.035016:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098670000 reply state ffff88009aa01000 transno 4294975937 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.035028:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.035033:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.035035:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065087.035037:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065087.035459:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+326:28634:x1830881261612416:12345-192.168.202.27@tcp:36:fsx.0 Request processed in 729us (1051us total) trans 4294975937 rc 0/0 00000100:00100000:3.0:1746065087.035464:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12635 00000020:00080000:3.0:1746065087.035468:0:7231:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065087.037197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.037307:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.037428:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.037968:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612672 00000100:00100000:3.0:1746065087.037975:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612672 00002000:00010000:3.0:1746065087.038003:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (1086->18446744073709551615) 00002000:00100000:3.0:1746065087.038007:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098672300 with x1830881261612672 ext(1086->18446744073709551615) 00002000:00010000:3.0:1746065087.038015:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098672300. 00000100:00100000:1.0:1746065087.038016:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612544 00000100:00100000:1.0:1746065087.038019:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612544 00002000:00010000:1.0:1746065087.038029:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (1086->18446744073709551615) 00002000:00100000:1.0:1746065087.038031:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098672a00 with x1830881261612544 ext(1086->18446744073709551615) 00002000:00010000:1.0:1746065087.038035:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098672a00. 00000100:00100000:3.0:1746065087.038136:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612800 00000100:00100000:3.0:1746065087.038138:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612800 00000100:00080000:3.0:1746065087.038154:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1746065087.038163:0:20324:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065087.038165:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098670a80 with x1830881261612800 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065087.038169:0:20324:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098670a80. 00000100:00100000:1.0:1746065087.038200:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1407 00000100:00100000:1.0:1746065087.038206:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261612672:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065087.038361:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 228256 -> 1086 00002000:00010000:1.0:1746065087.038364:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.038366:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065087.038367:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.038369:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065087.038398:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261612672:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 193us (1207us total) trans 21474840043 rc 0/0 00000100:00100000:1.0:1746065087.038403:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1407 00002000:00010000:1.0:1746065087.038406:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/908 (1086->18446744073709551615) 00002000:00100000:1.0:1746065087.038408:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098672300 with x1830881261612672 ext(1086->18446744073709551615) 00002000:00010000:1.0:1746065087.038410:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098672300. 00000100:00100000:1.0:1746065087.038421:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1408 00000100:00100000:1.0:1746065087.038425:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881261612544:12345-192.168.202.27@tcp:10:fsx.0 00002000:00010000:1.0:1746065087.038703:0:9555:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 228256 -> 1086 00002000:00010000:1.0:1746065087.038705:0:9555:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.038707:0:9555:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.038708:0:9555:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.038710:0:9555:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 208 -> 16 00000100:00100000:3.0:1746065087.038715:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1409 00000100:00100000:3.0:1746065087.038720:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881261612800:12345-192.168.202.27@tcp:10:fsx.0 00000100:00100000:1.0:1746065087.038725:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881261612544:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 299us (1419us total) trans 21474840044 rc 0/0 00000100:00100000:1.0:1746065087.038729:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1408 00002000:00010000:1.0:1746065087.038731:0:9555:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/906 (1086->18446744073709551615) 00002000:00100000:1.0:1746065087.038733:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098672a00 with x1830881261612544 ext(1086->18446744073709551615) 00002000:00010000:1.0:1746065087.038736:0:9555:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098672a00. 00002000:00010000:3.0:1746065087.038888:0:9553:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065087.038891:0:9553:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.038892:0:9553:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065087.038893:0:9553:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.038895:0:9553:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065087.038918:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261612800:12345-192.168.202.27@tcp:10:fsx.0 Request processed in 198us (1489us total) trans 17179872710 rc 0/0 00000100:00100000:3.0:1746065087.038922:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1409 00002000:00010000:3.0:1746065087.038924:0:9553:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/908 (0->18446744073709551615) 00002000:00100000:3.0:1746065087.038926:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098670a80 with x1830881261612800 ext(0->18446744073709551615) 00002000:00010000:3.0:1746065087.038929:0:9553:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098670a80. 00000100:00100000:0.0:1746065087.042099:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.042180:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261612928 00000100:00100000:3.0:1746065087.042187:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261612928 00000100:00100000:3.0:1746065087.042273:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12636 00000100:00100000:3.0:1746065087.042279:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+326:28634:x1830881261612928:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065087.042298:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.042315:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bbf lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d5ff expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.042389:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464bc6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.042401:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.042409:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065087.042427:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00000004:00200000:3.0:1746065087.042431:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065087.042443:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464bc6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.042461:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bbf lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ff expref: 328 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.042474:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ff expref: 327 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.042480:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.042483:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065087.042485:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b800, rc 0) 00000100:00100000:3.0:1746065087.042994:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+327:28634:x1830881261612928:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 712us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.043000:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12636 00000100:00100000:0.0:1746065087.054037:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.054097:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261613056 00000100:00100000:3.0:1746065087.054106:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261613056 00000100:00100000:3.0:1746065087.054939:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8969 00000100:00100000:3.0:1746065087.054948:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881261613056:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:3.0:1746065087.055113:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 1086 -> 1086 00002000:00010000:3.0:1746065087.055116:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.055118:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.055120:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.055122:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1746065087.055174:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881261613056:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 227us (1143us total) trans 21474840045 rc 0/0 00000100:00100000:3.0:1746065087.055180:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8969 00000100:00100000:0.0:1746065087.059294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.059661:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261613184 00000100:00100000:1.0:1746065087.059673:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261613184 00000100:00100000:1.0:1746065087.059726:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8970 00000100:00100000:1.0:1746065087.059732:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881261613184:12345-192.168.202.27@tcp:22:fsx.0 00002000:00010000:1.0:1746065087.059890:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 1086 -> 1086 00002000:00010000:1.0:1746065087.059893:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.059895:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.059900:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:1.0:1746065087.059901:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:1.0:1746065087.059953:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881261613184:12345-192.168.202.27@tcp:22:fsx.0 Request processed in 220us (665us total) trans 21474840046 rc 0/0 00000100:00100000:1.0:1746065087.059960:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8970 00000100:00100000:0.0:1746065087.063615:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.064113:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261613440 00000100:00100000:3.0:1746065087.064122:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261613440 00000100:00100000:3.0:1746065087.064167:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4338 00000100:00100000:3.0:1746065087.064174:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+327:28634:x1830881261613440:12345-192.168.202.27@tcp:35:fsx.0 00000100:00100000:3.0:1746065087.064764:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+328:28634:x1830881261613440:12345-192.168.202.27@tcp:35:fsx.0 Request processed in 589us (1156us total) trans 4294975938 rc 0/0 00000100:00100000:3.0:1746065087.064770:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4338 00000100:00100000:0.0:1746065087.074981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.075124:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261613696 00000100:00100000:3.0:1746065087.075131:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261613696 00000100:00100000:3.0:1746065087.075175:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12637 00000100:00100000:3.0:1746065087.075181:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+328:28636:x1830881261613696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.075199:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.075216:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1464bcd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d606 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.075273:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.075283:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075292:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075303:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.075308:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075312:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075384:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1464be2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.075391:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1464be2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075397:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1464be2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065087.075403:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00010000:00010000:3.0:1746065087.075456:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075461:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075466:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075470:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075475:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065087.075478:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075483:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075500:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff880098c34f00) 00010000:00010000:3.0:1746065087.075503:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065087.075506:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075510:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bd4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075523:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075528:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075532:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075535:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065087.075537:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075541:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075546:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a0ae006 (ffff880098c34c00) 00010000:00010000:3.0:1746065087.075548:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065087.075549:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075556:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fda600/0xad6b7ddc1464bdb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.075979:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b600/0xad6b7ddc1464bcd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d606 expref: 331 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.075996:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1464be2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d606 expref: 330 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.076002:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.076003:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065087.076005:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:3.0:1746065087.076598:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+330:28636:x1830881261613696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1415us (1622us total) trans 4294975939 rc 0/0 00000100:00100000:3.0:1746065087.076605:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12637 00000100:00100000:1.0:1746065087.079045:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.079102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.079158:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261614080 00000100:00100000:2.0:1746065087.079165:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261614080 00000100:00100000:2.0:1746065087.079199:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 568 00000100:00100000:2.0:1746065087.079204:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+330:2005:x1830881261614080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.079213:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.079228:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1464be2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d606 expref: 330 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.079240:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065087.079244:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.079271:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+329:2005:x1830881261614080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.079279:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 568 00000100:00100000:3.0:1746065087.079692:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261613952 00000100:00100000:3.0:1746065087.079696:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261613952 00000100:00100000:3.0:1746065087.079716:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12638 00000100:00100000:3.0:1746065087.079720:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+329:28636:x1830881261613952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.079732:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.079742:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bf0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d60d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.080050:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.080060:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.080069:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:3.0:1746065087.080076:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x367:0x0]: returning size 0 00010000:00010000:3.0:1746065087.080105:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b000/0xad6b7ddc1464bf0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 332 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.080119:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 331 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.080124:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c34100) 00010000:00010000:3.0:1746065087.080126:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065087.080127:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d000, rc 0) 00000100:00100000:3.0:1746065087.080157:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+331:28636:x1830881261613952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 436us (1117us total) trans 4294975940 rc 0/0 00000100:00100000:3.0:1746065087.080162:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12638 00000100:00100000:0.0:1746065087.083511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.083758:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261614336 00000100:00100000:1.0:1746065087.083767:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261614336 00000100:00100000:1.0:1746065087.083838:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12639 00000100:00100000:1.0:1746065087.083845:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+331:28636:x1830881261614336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065087.083863:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065087.083877:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927200/0xad6b7ddc1464c05 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d614 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.083953:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.083964:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 332 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.083975:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.084000:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 332 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.084009:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 332 pid: 7231 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746065087.084019:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262689152:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065087.084093:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065087.086141:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9571:1830881262689152:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065087.086163:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000100:00100000:0.0:1746065087.086282:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.086350:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261614464 00000100:00100000:2.0:1746065087.086355:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261614464 00010000:00010000:2.0:1746065087.086378:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 333 pid: 7231 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.086408:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3742 00000100:00100000:2.0:1746065087.086413:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+333:2004:x1830881261614464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.086422:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.086426:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 333 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.086434:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 333 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.086448:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2d000/0xad6b7ddc1464bf7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d60d expref: 333 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.086470:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c34100) 00010000:00010000:2.0:1746065087.086474:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065087.086480:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065087.086484:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065087.086505:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.086539:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+332:2004:x1830881261614464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.086545:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3742 00010000:00010000:1.0:1746065087.086733:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.086739:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:1.0:1746065087.086753:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x367:0x0]: returning size 0 00000004:00080000:1.0:1746065087.086886:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x38d:0x0], index 1: 0 00000004:00080000:1.0:1746065087.086891:0:9571:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x38d:0x0], index 0: 0 00010000:00010000:1.0:1746065087.086961:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.086966:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.086974:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.086979:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065087.086982:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.086987:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.086994:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c34100) 00010000:00010000:1.0:1746065087.086996:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065087.086999:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 2/0,0 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.087003:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d926200/0xad6b7ddc1464c0c lrc: 0/0,0 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:1.0:1746065087.087032:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927200/0xad6b7ddc1464c05 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d614 expref: 332 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.087038:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88008d927200/0xad6b7ddc1464c05 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d614 expref: 332 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.087047:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927200, rc 0) 00000100:00100000:1.0:1746065087.087063:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+331:28636:x1830881261614336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3219us (3570us total) trans 4294975941 rc 301/301 00000100:00100000:1.0:1746065087.087068:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12639 00000100:00100000:0.0:1746065087.088656:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.088799:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261614720 00000100:00100000:3.0:1746065087.088805:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261614720 00000100:00100000:3.0:1746065087.088992:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4339 00000100:00100000:3.0:1746065087.088998:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+331:28636:x1830881261614720:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065087.089151:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+332:28636:x1830881261614720:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 152us (498us total) trans 4294975942 rc 0/0 00000100:00100000:3.0:1746065087.089157:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4339 00000100:00100000:0.0:1746065087.091212:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.091444:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261614848 00000100:00100000:1.0:1746065087.091449:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261614848 00000100:00100000:1.0:1746065087.091507:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12640 00000100:00100000:1.0:1746065087.091513:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+27:28636:x1830881261614848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065087.091527:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065087.091541:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719a00/0xad6b7ddc1464c1a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d61b expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.091580:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091590:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091599:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091608:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091612:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091617:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091645:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091649:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091654:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091658:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091663:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065087.091666:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091671:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091678:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff880090dc5600) 00010000:00010000:1.0:1746065087.091680:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065087.091683:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091687:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719e00/0xad6b7ddc1464c21 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091694:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091698:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091702:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091705:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065087.091706:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091710:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091714:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x4235088d (ffff880090dc5f00) 00010000:00010000:1.0:1746065087.091715:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065087.091717:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091721:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc1464c28 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x4235088d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065087.091738:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719a00/0xad6b7ddc1464c1a lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d61b expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.091744:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719a00/0xad6b7ddc1464c1a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d61b expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.091749:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719a00, rc 0) 00000100:00100000:1.0:1746065087.091793:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+27:28636:x1830881261614848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 280us (586us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065087.091798:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12640 00000100:00080000:3.0:1746065087.091950:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065087.094574:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.094704:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261614976 00000100:00100000:2.0:1746065087.094710:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261614976 00000100:00100000:2.0:1746065087.094742:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12641 00000100:00100000:2.0:1746065087.094748:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+332:28636:x1830881261614976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065087.094765:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065087.094798:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc1464c2f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d622 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.094851:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc1464c36 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065087.094860:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc1464c36 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.094869:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc1464c36 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065087.094900:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x367:0x0]: returning size 0 00000004:00200000:2.0:1746065087.094903:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065087.094913:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc1464c36 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.094929:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1400/0xad6b7ddc1464c2f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d622 expref: 334 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.095360:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc1464c36 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d622 expref: 333 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.095371:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.095374:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065087.095376:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0200, rc 0) 00000100:00100000:2.0:1746065087.095675:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+333:28636:x1830881261614976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 926us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.095680:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12641 00000100:00100000:0.0:1746065087.098678:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.098714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.098792:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261615104 00000100:00100000:3.0:1746065087.098798:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261615104 00000100:00100000:3.0:1746065087.098832:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261615232 00000100:00100000:3.0:1746065087.098834:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261615232 00000100:00100000:3.0:1746065087.098853:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8971 00000100:00100000:3.0:1746065087.098858:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881261615104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.098872:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.098887:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d629 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065087.098904:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x38d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065087.098920:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.098921:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.098928:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 51 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.098941:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 51 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.098949:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2da00, rc 0) 00000100:00100000:3.0:1746065087.098982:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261615104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.098987:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8971 00000100:00100000:3.0:1746065087.098999:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8972 00000100:00100000:3.0:1746065087.099004:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881261615232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.099009:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.099017:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d000/0xad6b7ddc1464c44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d630 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065087.099027:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065087.099034:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.099035:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.099038:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d000/0xad6b7ddc1464c44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d630 expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.099048:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d000/0xad6b7ddc1464c44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d630 expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.099054:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d000, rc 0) 00000100:00100000:3.0:1746065087.099065:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261615232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 61us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.099069:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8972 00000100:00100000:1.0:1746065087.101397:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.101483:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261615488 00000100:00100000:2.0:1746065087.101489:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261615488 00000100:00100000:2.0:1746065087.101530:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12642 00000100:00100000:2.0:1746065087.101536:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+333:28636:x1830881261615488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065087.101547:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065087.101559:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1464c4b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d637 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.101626:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464c52 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065087.101637:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464c52 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.101645:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464c52 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065087.101653:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00010000:00010000:2.0:1746065087.101716:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0800/0xad6b7ddc1464c4b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d637 expref: 336 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.101728:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464c52 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d637 expref: 335 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.101734:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065087.101736:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065087.101738:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1c00, rc 0) 00000100:00100000:2.0:1746065087.101793:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+335:28636:x1830881261615488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 257us (402us total) trans 4294975943 rc 0/0 00000100:00100000:2.0:1746065087.101798:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12642 00000100:00100000:0.0:1746065087.104186:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.104849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.105121:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.105746:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261615616 00000100:00100000:2.0:1746065087.105753:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261615616 00000100:00100000:2.0:1746065087.105798:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261615872 00000100:00100000:2.0:1746065087.105799:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261615872 00000100:00100000:2.0:1746065087.105808:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261615744 00000100:00100000:2.0:1746065087.105809:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261615744 00000100:00100000:2.0:1746065087.105819:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8973 00000100:00100000:2.0:1746065087.105824:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261615616:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065087.105853:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.105867:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.105873:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065087.105874:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065087.105877:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.105900:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.105913:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 28 pid: 12260 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.105925:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262689280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065087.106003:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.106020:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8974 00000100:00100000:2.0:1746065087.106026:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2006:x1830881261615872:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065087.106042:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106051:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 51 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106056:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065087.106057:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065087.106059:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106073:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 51 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106080:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 51 pid: 3067 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.106087:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262689408:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065087.106105:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.106126:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8975 00000100:00100000:2.0:1746065087.106131:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261615744:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065087.106146:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106155:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106159:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065087.106161:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065087.106162:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106175:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.106181:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 28 pid: 12260 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.106188:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262689536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065087.106202:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.108709:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881262689280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065087.108730:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065087.109881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.110044:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616128 00000100:00100000:1.0:1746065087.110051:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616128 00010000:00010000:1.0:1746065087.110077:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 52 pid: 3067 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746065087.110100:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3743 00000100:00100000:1.0:1746065087.110106:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261616128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065087.110117:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065087.110134:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 52 pid: 3067 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.110146:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 52 pid: 3067 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.110164:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065087.110166:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065087.110169:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.110176:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.110189:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065087.110221:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881261616128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065087.110227:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3743 00000100:00100000:0.0:1746065087.110325:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.110347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.110606:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881262689536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065087.110620:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110645:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8a00/0xad6b7ddc1464aa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d59d expref: 51 pid: 3067 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746065087.110657:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881262689408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065087.110665:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110671:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110676:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110689:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110695:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110701:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110706:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065087.110709:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110715:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110723:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.110728:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9200/0xad6b7ddc1464c67 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065087.110763:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881261615872:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 4737us (5915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.110770:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8974 00000100:00100000:2.0:1746065087.111026:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616000 00000100:00100000:2.0:1746065087.111030:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616000 00010000:00010000:2.0:1746065087.111043:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 29 pid: 12260 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.111058:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616256 00000100:00100000:2.0:1746065087.111059:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616256 00010000:00010000:2.0:1746065087.111066:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 30 pid: 12260 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.111076:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3744 00000100:00100000:2.0:1746065087.111081:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881261616000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.111087:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.111097:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 30 pid: 12260 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.111104:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 30 pid: 12260 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.111114:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc1464a06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d565 expref: 30 pid: 12260 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.111123:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.111124:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.111126:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111137:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111150:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.111167:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881261616000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.111173:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3744 00000100:00100000:2.0:1746065087.111182:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3745 00000100:00100000:2.0:1746065087.111186:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261616256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.111193:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.111200:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 28 pid: 12260 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.111208:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 28 pid: 12260 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.111218:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1464a8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d58f expref: 28 pid: 12260 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.111225:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.111226:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.111229:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111234:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111250:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.111263:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881261616256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.111267:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3745 00010000:00010000:2.0:1746065087.111281:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111287:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111311:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111318:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111323:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111328:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065087.111330:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111335:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111346:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.111351:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0000/0xad6b7ddc1464c60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.111377:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881261615616:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 5553us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.111382:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8973 00010000:00010000:3.0:1746065087.111638:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111644:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111655:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111660:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111666:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111672:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065087.111675:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111680:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111689:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.111693:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c200/0xad6b7ddc1464c6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065087.111721:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881261615744:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 5590us (6600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.111726:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8975 00000100:00100000:0.0:1746065087.113610:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.113642:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.113672:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.113732:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616384 00000100:00100000:3.0:1746065087.113737:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616384 00000100:00100000:3.0:1746065087.113794:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616640 00000100:00100000:3.0:1746065087.113797:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616640 00000100:00100000:3.0:1746065087.113810:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616512 00000100:00100000:3.0:1746065087.113811:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616512 00000100:00100000:3.0:1746065087.113824:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8976 00000100:00100000:3.0:1746065087.113829:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261616384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.113842:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.113854:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1464c75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d63e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065087.113869:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38a:0x0] initial LVB size: 1086, mtime: 0x6812d6bf, atime: 0x6812d6bf, ctime: 0x6812d6bf, blocks: 0x10 00010000:00010000:3.0:1746065087.113882:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.113884:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.113891:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1464c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d63e expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.113902:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1464c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d63e expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.113910:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:3.0:1746065087.113936:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261616384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 107us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.113941:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8976 00000100:00100000:3.0:1746065087.113952:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8977 00000100:00100000:3.0:1746065087.113957:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881261616640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.113963:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.113972:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1464c7c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d64c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065087.113983:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x38c:0x0] initial LVB size: 0, mtime: 0x6812d6bf, atime: 0x0, ctime: 0x6812d6bf, blocks: 0x0 00010000:00010000:3.0:1746065087.113990:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.113992:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.113995:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1464c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d64c expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.114003:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1464c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d64c expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.114009:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2ca00, rc 0) 00000100:00100000:3.0:1746065087.114021:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881261616640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 64us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.114025:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8977 00000100:00100000:3.0:1746065087.114032:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8978 00000100:00100000:3.0:1746065087.114036:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881261616512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.114040:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.114045:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1464c83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d645 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065087.114052:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38c:0x0] initial LVB size: 1086, mtime: 0x6812d6bf, atime: 0x0, ctime: 0x6812d6bf, blocks: 0x0 00010000:00010000:3.0:1746065087.114057:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.114058:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.114061:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1464c83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d645 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.114068:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1464c83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d645 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.114073:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c200, rc 0) 00000100:00100000:3.0:1746065087.114082:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261616512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 46us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.114086:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8978 00000100:00100000:3.0:1746065087.117619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.121848:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261616768 00000100:00100000:1.0:1746065087.121859:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261616768 00000100:00100000:1.0:1746065087.121899:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8979 00000100:00100000:1.0:1746065087.121906:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261616768:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065087.122002:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261616768:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 97us (4390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065087.122009:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8979 00000100:00100000:0.0:1746065087.126331:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.126395:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617024 00000100:00100000:3.0:1746065087.126403:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617024 00002000:00100000:3.0:1746065087.126437:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (0->4095) req@ffff88008c52aa00 x1830881261617024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/0 e 0 to 0 dl 1746065098 ref 1 fl New:/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 00002000:00100000:3.0:1746065087.126445:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52aa00 with x1830881261617024 ext(0->4095) 00002000:00010000:3.0:1746065087.126449:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52aa00 00000100:00100000:3.0:1746065087.126464:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1410 00000100:00100000:3.0:1746065087.126469:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261617024:12345-192.168.202.27@tcp:3:lfs.0 00000100:00100000:3.0:1746065087.126611:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881261617024:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 140us (287us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065087.126617:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1410 00002000:00100000:3.0:1746065087.126622:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (0->4095) req@ffff88008c52aa00 x1830881261617024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/4536 e 0 to 0 dl 1746065098 ref 1 fl Complete:/200/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 00002000:00100000:3.0:1746065087.126628:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52aa00 with x1830881261617024 ext(0->4095) 00002000:00010000:3.0:1746065087.126631:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52aa00 00000100:00100000:0.0:1746065087.130008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.130644:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617152 00000100:00100000:3.0:1746065087.130651:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617152 00000100:00100000:3.0:1746065087.130693:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8980 00000100:00100000:3.0:1746065087.130700:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+51:28636:x1830881261617152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.130715:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.130728:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1464c8a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d653 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.130752:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.130759:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.130760:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.130763:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1464c8a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d653 expref: 52 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.130821:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.130831:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746065087.130842:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262689664:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065087.130917:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065087.132704:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881262689664:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065087.132724:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1464c8a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d653 expref: 52 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.132737:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c000, rc 0) 00000100:00100000:3.0:1746065087.132767:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+52:28636:x1830881261617152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2067us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.132794:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8980 00000100:00100000:0.0:1746065087.133613:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.134925:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617280 00000100:00100000:2.0:1746065087.134933:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617280 00010000:00010000:2.0:1746065087.134965:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746065087.135883:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3746 00000100:00100000:2.0:1746065087.135891:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881261617280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.135905:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.135921:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746065087.135932:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746065087.135950:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2da00/0xad6b7ddc1464c3d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d629 expref: 52 pid: 11461 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746065087.136888:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.136891:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.136897:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1464c8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d653 expref: 51 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.136906:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1464c8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d653 expref: 51 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.136934:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c000/0xad6b7ddc1464c8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d653 expref: 51 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.136944:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881262689792:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065087.137570:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.140227:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881262689792:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065087.140243:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.140283:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881261617280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4392us (6671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.140291:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3746 00000100:00100000:0.0:1746065087.143683:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.144224:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617408 00000100:00100000:1.0:1746065087.144232:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617408 00000100:00100000:2.0:1746065087.145385:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12643 00000100:00100000:2.0:1746065087.145396:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+335:28636:x1830881261617408:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065087.145417:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065087.145436:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464c91 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d65a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.145462:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065087.145474:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.145483:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.145578:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464c91 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 337 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.145799:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 336 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.145806:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.145808:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065087.145811:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:2.0:1746065087.146685:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+336:28636:x1830881261617408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1289us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.146693:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12643 00000100:00100000:1.0:1746065087.152136:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.152215:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617536 00000100:00100000:2.0:1746065087.152222:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617536 00002000:00100000:2.0:1746065087.152261:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x38d:0x0] (0->1085) req@ffff880129f41c00 x1830881261617536/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 1576/0 e 0 to 0 dl 1746065098 ref 1 fl New:/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 00002000:00100000:2.0:1746065087.152270:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41c00 with x1830881261617536 ext(0->1085) 00002000:00010000:2.0:1746065087.152274:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41c00 00000100:00100000:2.0:1746065087.152608:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1411 00000100:00100000:2.0:1746065087.152615:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881261617536:12345-192.168.202.27@tcp:4:lfs.0 00000100:00100000:2.0:1746065087.153342:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881261617536:12345-192.168.202.27@tcp:4:lfs.0 Request processed in 726us (1212us total) trans 17179872711 rc 0/0 00000100:00100000:2.0:1746065087.153349:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1411 00002000:00100000:2.0:1746065087.153354:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x38d:0x0] (0->1085) req@ffff880129f41c00 x1830881261617536/t17179872711(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 1576/448 e 0 to 0 dl 1746065098 ref 1 fl Complete:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 00002000:00100000:2.0:1746065087.153362:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41c00 with x1830881261617536 ext(0->1085) 00002000:00010000:2.0:1746065087.153365:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41c00 00000100:00100000:0.0:1746065087.155666:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.155851:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617664 00000100:00100000:2.0:1746065087.155859:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617664 00000100:00100000:2.0:1746065087.156197:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12644 00000100:00100000:2.0:1746065087.156205:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+336:28636:x1830881261617664:12345-192.168.202.27@tcp:44:lfs.0 00000001:00080000:3.0:1746065087.158056:0:8342:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294975943 is committed 00010000:00010000:0.0:1746065087.158138:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158148:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158155:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158159:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580ee00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158163:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158168:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158181:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158184:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158187:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158191:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580ee00/0xad6b7ddc1464ae6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158334:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158339:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158343:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158348:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158350:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158355:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158361:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158363:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158365:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158369:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e200/0xad6b7ddc1464afb lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158377:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158381:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158385:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158389:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158390:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158395:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158400:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158402:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158404:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158409:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009580e000/0xad6b7ddc1464b10 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158415:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158419:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158423:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158426:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158428:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158432:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158438:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158440:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158441:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158445:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880091ae7600/0xad6b7ddc1464b25 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158452:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158457:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158464:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158468:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158469:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158473:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158478:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158479:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158481:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158484:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464b3a lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158502:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158506:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158510:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158513:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158515:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158520:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158529:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158531:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158533:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158537:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdb000/0xad6b7ddc1464b4f lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158546:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158551:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158555:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158559:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158561:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158564:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158569:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158571:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158572:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158576:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464b64 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158582:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158587:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158590:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158593:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccda00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158595:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158599:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158604:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158606:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158608:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158611:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880099ccda00/0xad6b7ddc1464b79 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158617:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158621:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158625:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158629:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158630:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158637:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158642:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158644:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158646:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158649:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095fdba00/0xad6b7ddc1464b8e lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158656:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158660:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158664:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158667:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158669:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158673:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158677:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158678:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158680:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158684:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009019c400/0xad6b7ddc1464ba3 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.158691:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158695:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158699:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158702:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065087.158704:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158708:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158712:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.158714:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065087.158715:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.158719:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71a000/0xad6b7ddc1464bb8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:2.0:1746065087.158911:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:28636:x1830881261617664:12345-192.168.202.27@tcp:44:lfs.0 Request processed in 2704us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.158919:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12644 00000100:00100000:0.0:1746065087.161632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.161798:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617792 00000100:00100000:3.0:1746065087.161806:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617792 00000100:00100000:3.0:1746065087.162212:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8981 00000100:00100000:3.0:1746065087.162220:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881261617792:12345-192.168.202.27@tcp:16:lfs.0 00000001:00080000:0.0:1746065087.163519:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872711 is committed 00000100:00100000:3.0:1746065087.163922:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881261617792:12345-192.168.202.27@tcp:16:lfs.0 Request processed in 1700us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.163932:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8981 00000100:00100000:0.0:1746065087.166722:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.166804:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.166888:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261617920 00000100:00100000:3.0:1746065087.166897:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261617920 00000100:00100000:3.0:1746065087.166939:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618048 00000100:00100000:3.0:1746065087.166941:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618048 00000100:00100000:3.0:1746065087.166956:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8982 00000100:00100000:3.0:1746065087.166962:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261617920:12345-192.168.202.27@tcp:16:lfs.0 00000100:00100000:3.0:1746065087.167031:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261617920:12345-192.168.202.27@tcp:16:lfs.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.167036:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8982 00000100:00100000:3.0:1746065087.167047:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8983 00000100:00100000:3.0:1746065087.167051:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261618048:12345-192.168.202.27@tcp:16:lfs.0 00000100:00100000:3.0:1746065087.167081:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261618048:12345-192.168.202.27@tcp:16:lfs.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.167086:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8983 00000100:00100000:0.0:1746065087.169320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.169349:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.170159:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.170473:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618304 00000100:00100000:2.0:1746065087.170480:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618304 00000100:00100000:2.0:1746065087.170514:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618176 00000100:00100000:2.0:1746065087.170516:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618176 00000100:00100000:2.0:1746065087.170525:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618432 00000100:00100000:2.0:1746065087.170526:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618432 00000100:00100000:2.0:1746065087.170536:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8984 00000100:00100000:2.0:1746065087.170542:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261618304:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065087.170571:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170582:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.170583:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.170587:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170597:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170613:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170618:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170624:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170629:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065087.170633:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170638:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170647:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170652:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1464c9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.170690:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261618304:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 148us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.170696:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8984 00000100:00100000:2.0:1746065087.170707:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8985 00000100:00100000:2.0:1746065087.170710:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261618176:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065087.170720:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170725:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.170726:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.170728:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170734:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170741:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170747:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170752:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170756:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065087.170759:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170768:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170790:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170795:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1464ca6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.170813:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881261618176:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 102us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.170817:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8985 00000100:00100000:2.0:1746065087.170825:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8986 00000100:00100000:2.0:1746065087.170829:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261618432:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065087.170841:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170847:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.170848:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.170850:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170856:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170866:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170871:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170876:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170880:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065087.170882:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170887:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170893:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.170897:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc1464cad lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.170914:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881261618432:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 85us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.170918:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8986 00000100:00100000:0.0:1746065087.172521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.172607:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618688 00000100:00100000:2.0:1746065087.172613:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618688 00000100:00100000:2.0:1746065087.172956:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12645 00000100:00100000:2.0:1746065087.172964:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+297:28636:x1830881261618688:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065087.172999:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.173016:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c0200/0xad6b7ddc1464c36 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d622 expref: 297 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.173028:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.173032:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065087.173056:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1464cb4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065087.173064:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1464cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.173070:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1464cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00010000:2.0:1746065087.173151:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c52b480 reply state ffff88012fc02000 transno 4294975944 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1464cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.173159:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d600/0xad6b7ddc1464cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x367:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.173163:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.173166:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065087.173168:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065087.173237:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:28636:x1830881261618688:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 274us (719us total) trans 4294975944 rc 0/0 00000100:00100000:2.0:1746065087.173243:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12645 00000100:00100000:0.0:1746065087.174590:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.174682:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618816 00000100:00100000:2.0:1746065087.174687:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618816 00000100:00100000:2.0:1746065087.175301:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12646 00000100:00100000:2.0:1746065087.175310:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+298:28636:x1830881261618816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065087.175326:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065087.175339:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d661 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.175377:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.175388:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.175403:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.175406:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065087.175408:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6da00, rc 0) 00000100:00100000:2.0:1746065087.175449:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+299:28636:x1830881261618816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 140us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.175454:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12646 00000100:00100000:0.0:1746065087.176964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.177002:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.177107:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261619072 00000100:00100000:3.0:1746065087.177112:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261619072 00000100:00100000:3.0:1746065087.177145:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261618944 00000100:00100000:3.0:1746065087.177147:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261618944 00000100:00100000:3.0:1746065087.177160:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8987 00000100:00100000:3.0:1746065087.177165:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881261619072:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065087.177280:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065087.177282:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38d:0x0] updating lvb mtime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.177284:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38d:0x0] updating lvb atime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.177285:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38d:0x0] updating lvb ctime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.177287:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065087.177312:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881261619072:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 146us (351us total) trans 21474840047 rc 0/0 00000100:00100000:3.0:1746065087.177317:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8987 00000100:00100000:3.0:1746065087.177327:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8988 00000100:00100000:3.0:1746065087.177331:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881261618944:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065087.177392:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38d:0x0] updating lvb size from disk: 0 -> 1086 00002000:00010000:3.0:1746065087.177393:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38d:0x0] updating lvb mtime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.177395:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38d:0x0] updating lvb atime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.177397:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38d:0x0] updating lvb ctime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.177398:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38d:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1746065087.177414:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881261618944:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 82us (412us total) trans 17179872712 rc 0/0 00000100:00100000:3.0:1746065087.177419:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8988 00000100:00100000:1.0:1746065087.178890:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.178962:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261619328 00000100:00100000:0.0:1746065087.178966:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261619328 00000100:00100000:0.0:1746065087.178995:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12647 00000100:00100000:0.0:1746065087.179000:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+299:28636:x1830881261619328:12345-192.168.202.27@tcp:55:lfs.0 00010000:00010000:0.0:1746065087.179031:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065087.179041:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065087.179047:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:0.0:1746065087.179067:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065087.179077:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 299 pid: 7231 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746065087.179086:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262689920:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065087.179150:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.181534:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7231:1830881262689920:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065087.181553:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000100:00100000:0.0:1746065087.182163:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.182356:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261619456 00000100:00100000:2.0:1746065087.182362:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261619456 00010000:00010000:2.0:1746065087.182386:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 300 pid: 7231 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.182417:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3747 00000100:00100000:2.0:1746065087.182424:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+300:2005:x1830881261619456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.182433:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.182438:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 300 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.182447:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 300 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.182464:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6dc00/0xad6b7ddc1464c98 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x367:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d65a expref: 300 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.182486:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.182498:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.182506:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.182511:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.182533:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.182564:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+299:2005:x1830881261619456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.182570:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3747 00010000:00010000:3.0:1746065087.182855:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182862:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182890:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182896:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182902:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182907:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065087.182910:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182915:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182923:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:3.0:1746065087.182925:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1746065087.182928:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 2/0,0 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.182932:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b400/0xad6b7ddc1464cc2 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT1 00000100:00100000:3.0:1746065087.182978:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:28636:x1830881261619328:12345-192.168.202.27@tcp:55:lfs.0 Request processed in 3977us (4091us total) trans 0 rc -22/-22 00000100:00100000:3.0:1746065087.182984:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12647 00000100:00100000:0.0:1746065087.184440:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.184592:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261619712 00000100:00100000:3.0:1746065087.184597:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261619712 00000100:00100000:3.0:1746065087.184630:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12648 00000100:00100000:3.0:1746065087.184635:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+298:28636:x1830881261619712:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065087.184667:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065087.184679:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c71b800/0xad6b7ddc1464bc6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5ff expref: 298 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.184688:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.184691:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065087.184719:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc1464cc9 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065087.184726:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc1464cc9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.184732:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc1464cc9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00010000:3.0:1746065087.184823:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cf3800 reply state ffff88009aa03000 transno 4294975945 ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc1464cc9 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.184830:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009ad2c400/0xad6b7ddc1464cc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x364:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:3.0:1746065087.184835:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.184837:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065087.184839:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065087.184884:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+299:28636:x1830881261619712:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 248us (446us total) trans 4294975945 rc 0/0 00000100:00100000:3.0:1746065087.184889:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12648 00000100:00100000:0.0:1746065087.186155:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.186180:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.186206:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.186261:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261619840 00000100:00100000:2.0:1746065087.186265:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261619840 00000100:00100000:2.0:1746065087.186288:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261620096 00000100:00100000:2.0:1746065087.186289:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261620096 00000100:00100000:3.0:1746065087.186364:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261619968 00000100:00100000:3.0:1746065087.186367:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261619968 00000100:00100000:2.0:1746065087.186397:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8989 00000100:00100000:2.0:1746065087.186403:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881261619840:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065087.186478:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 1086 -> 1086 00002000:00010000:2.0:1746065087.186481:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065087.186484:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065087.186485:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065087.186487:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:2.0:1746065087.186519:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881261619840:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 116us (366us total) trans 21474840048 rc 0/0 00000100:00100000:2.0:1746065087.186525:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8989 00000100:00100000:2.0:1746065087.186536:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8990 00000100:00100000:2.0:1746065087.186541:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881261620096:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065087.186591:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065087.186592:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065087.186594:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb atime from disk: 0 -> 1746065087 00002000:00010000:2.0:1746065087.186596:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:2.0:1746065087.186597:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065087.186611:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881261620096:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 70us (430us total) trans 17179872713 rc 0/0 00000100:00100000:2.0:1746065087.186616:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8990 00000100:00100000:3.0:1746065087.186937:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8991 00000100:00100000:3.0:1746065087.186943:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881261619968:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065087.186983:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb size from disk: 1086 -> 1086 00002000:00010000:3.0:1746065087.186986:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb mtime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.186987:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb atime from disk: 0 -> 1746065087 00002000:00010000:3.0:1746065087.186989:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb ctime from disk: 1746065087 -> 1746065087 00002000:00010000:3.0:1746065087.186991:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065087.187011:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881261619968:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 68us (804us total) trans 21474840049 rc 0/0 00000100:00100000:3.0:1746065087.187016:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8991 00000100:00100000:0.0:1746065087.188846:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.188913:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261620352 00000100:00100000:1.0:1746065087.188918:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261620352 00000100:00100000:1.0:1746065087.188954:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4340 00000100:00100000:1.0:1746065087.188959:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+299:28636:x1830881261620352:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065087.189011:0:7207:0:(mdt_open.c:2285:mdt_close_handle_layouts()) ### [0x240000403:0x364:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464c52 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d637 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.189037:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:1.0:1746065087.189047:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.189052:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.189057:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.189077:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.189086:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 299 pid: 7231 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746065087.189096:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262690048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065087.189162:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065087.189169:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 299 pid: 9571 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746065087.189176:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262690176:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065087.189191:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.190508:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262690176:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065087.191349:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.191665:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.191804:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262690048:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065087.191822:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:1.0:1746065087.192169:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261620480 00000100:00100000:1.0:1746065087.192174:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261620480 00010000:00010000:1.0:1746065087.192197:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 300 pid: 9571 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746065087.192223:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261620608 00000100:00100000:1.0:1746065087.192225:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261620608 00010000:00010000:1.0:1746065087.192233:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 301 pid: 7231 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746065087.192245:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3748 00000100:00100000:1.0:1746065087.192250:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+301:2004:x1830881261620480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065087.192259:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065087.192263:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 301 pid: 9571 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.192270:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 301 pid: 9571 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.192284:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800985b3400/0xad6b7ddc14649f1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d557 expref: 301 pid: 9571 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.192296:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065087.192300:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.192307:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.192311:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065087.192337:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+300:2004:x1830881261620480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065087.192342:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3748 00000100:00100000:1.0:1746065087.192354:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3749 00000100:00100000:1.0:1746065087.192358:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+299:2005:x1830881261620608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065087.192363:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065087.192366:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 299 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.192372:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 299 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.192380:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880129fe8600/0xad6b7ddc1464a99 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d596 expref: 299 pid: 7231 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746065087.192387:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065087.192389:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.192394:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.192399:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.192412:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065087.192425:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+298:2005:x1830881261620608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065087.192430:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3749 00010000:00010000:2.0:1746065087.192737:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065087.192744:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065087.192760:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:2.0:1746065087.192768:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 297 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.193158:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065087.193180:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 297 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.193190:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 297 pid: 9571 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.193199:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262690304:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065087.193257:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.195027:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:7207:1830881262690304:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065087.195044:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:0.0:1746065087.195213:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.195338:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261620736 00000100:00100000:2.0:1746065087.195343:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261620736 00010000:00010000:2.0:1746065087.195364:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 298 pid: 9571 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746065087.195396:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3750 00000100:00100000:2.0:1746065087.195403:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+298:2005:x1830881261620736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.195414:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.195418:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 298 pid: 9571 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.195427:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 298 pid: 9571 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.195443:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6da00/0xad6b7ddc1464cbb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x367:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d661 expref: 298 pid: 9571 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746065087.195508:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.195513:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065087.195519:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065087.195525:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT1 00010000:00010000:2.0:1746065087.195538:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065087.195544:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00010000:00010000:0.0:1746065087.195549:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT1 00000100:00100000:2.0:1746065087.195574:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+297:2005:x1830881261620736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 171us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.195579:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3750 00000100:00100000:0.0:1746065087.195851:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1746065087.195883:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065087.195912:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.196023:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262690432 00000100:00100000:2.0:1746065087.196027:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262690432 00000100:00100000:2.0:1746065087.196052:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1746065087.196057:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1746065087.196146:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065087.196201:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 143us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.196207:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1746065087.196209:0:7207:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839961 gen 2 00000004:00080000:1.0:1746065087.196213:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dd880, transno 21474839770 00000004:00080000:1.0:1746065087.196246:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982dc000, transno 21474839771 00000004:00080000:1.0:1746065087.196249:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a649880, transno 21474839773 00000004:00080000:1.0:1746065087.196251:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a64a300, transno 21474839774 00000004:00080000:1.0:1746065087.196253:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a64b100, transno 21474839775 00000004:00080000:1.0:1746065087.196254:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a649500, transno 21474839776 00000004:00080000:1.0:1746065087.196256:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222300, transno 21474839778 00000004:00080000:1.0:1746065087.196259:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223480, transno 21474839779 00000004:00080000:1.0:1746065087.196260:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223100, transno 21474839780 00000004:00080000:1.0:1746065087.196262:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222680, transno 21474839781 00000004:00080000:1.0:1746065087.196264:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223b80, transno 21474839782 00000004:00080000:1.0:1746065087.196266:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221880, transno 21474839783 00000004:00080000:1.0:1746065087.196267:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223800, transno 21474839784 00000004:00080000:1.0:1746065087.196269:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220380, transno 21474839785 00000004:00080000:1.0:1746065087.196271:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c700, transno 21474839787 00000004:00080000:1.0:1746065087.196273:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ea00, transno 21474839788 00000004:00080000:1.0:1746065087.196275:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85f800, transno 21474839789 00000004:00080000:1.0:1746065087.196276:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834fb80, transno 21474839790 00000004:00080000:1.0:1746065087.196278:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955ce680, transno 21474839792 00000004:00080000:1.0:1746065087.196280:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cca80, transno 21474839793 00000004:00080000:1.0:1746065087.196281:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955ce300, transno 21474839794 00000004:00080000:1.0:1746065087.196283:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800955cc380, transno 21474839795 00000004:00080000:1.0:1746065087.196284:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a648a80, transno 21474839797 00000004:00080000:1.0:1746065087.196287:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a64ad80, transno 21474839798 00000004:00080000:1.0:1746065087.196289:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a648e00, transno 21474839799 00000004:00080000:1.0:1746065087.196290:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a648700, transno 21474839800 00000004:00080000:1.0:1746065087.196293:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6300, transno 21474839803 00000004:00080000:1.0:1746065087.196366:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6680, transno 21474839804 00000004:00080000:1.0:1746065087.196368:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957daa00, transno 21474839806 00000004:00080000:1.0:1746065087.196370:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8a80, transno 21474839807 00000004:00080000:1.0:1746065087.196372:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cce00, transno 21474839808 00000004:00080000:1.0:1746065087.196374:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800982cf800, transno 21474839809 00000004:00080000:1.0:1746065087.196376:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458000, transno 21474839811 00000004:00080000:1.0:1746065087.196378:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459c00, transno 21474839812 00000004:00080000:1.0:1746065087.196379:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45a680, transno 21474839813 00000004:00080000:1.0:1746065087.196381:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45bb80, transno 21474839814 00000004:00080000:1.0:1746065087.196383:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459f80, transno 21474839815 00000004:00080000:1.0:1746065087.196384:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458700, transno 21474839816 00000004:00080000:1.0:1746065087.196386:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d1c00, transno 21474839819 00000004:00080000:1.0:1746065087.196387:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f0d3480, transno 21474839820 00000004:00080000:1.0:1746065087.196389:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad4a80, transno 21474839822 00000004:00080000:1.0:1746065087.196391:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5880, transno 21474839823 00000004:00080000:1.0:1746065087.196392:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad4000, transno 21474839824 00000004:00080000:1.0:1746065087.196394:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad7100, transno 21474839825 00000004:00080000:1.0:1746065087.196395:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6d80, transno 21474839826 00000004:00080000:1.0:1746065087.196397:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5500, transno 21474839827 00000004:00080000:1.0:1746065087.196399:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf4000, transno 21474839829 00000004:00080000:1.0:1746065087.196401:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf7800, transno 21474839830 00000004:00080000:1.0:1746065087.196403:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ed09880, transno 21474839831 00000004:00080000:1.0:1746065087.196404:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ed09c00, transno 21474839832 00000004:00080000:1.0:1746065087.196406:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cff480, transno 21474839833 00000004:00080000:1.0:1746065087.196408:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cfc000, transno 21474839834 00000004:00080000:1.0:1746065087.196410:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ea00, transno 21474839837 00000004:00080000:1.0:1746065087.196412:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570d500, transno 21474839838 00000004:00080000:1.0:1746065087.196414:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570f100, transno 21474839839 00000004:00080000:1.0:1746065087.196416:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009570ca80, transno 21474839840 00000004:00080000:1.0:1746065087.196418:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009835b100, transno 21474839842 00000004:00080000:1.0:1746065087.196420:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098358380, transno 21474839843 00000004:00080000:1.0:1746065087.196422:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecaa00, transno 21474839844 00000004:00080000:1.0:1746065087.196424:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec9c00, transno 21474839845 00000004:00080000:1.0:1746065087.196425:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c380, transno 21474839847 00000004:00080000:1.0:1746065087.196427:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834f480, transno 21474839848 00000004:00080000:1.0:1746065087.196429:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ca80, transno 21474839849 00000004:00080000:1.0:1746065087.196430:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d500, transno 21474839850 00000004:00080000:1.0:1746065087.196432:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834e680, transno 21474839851 00000004:00080000:1.0:1746065087.196434:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d880, transno 21474839852 00000004:00080000:1.0:1746065087.196475:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1180, transno 21474839854 00000004:00080000:1.0:1746065087.196478:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0000, transno 21474839855 00000004:00080000:1.0:1746065087.196480:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2d80, transno 21474839856 00000004:00080000:1.0:1746065087.196482:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0e00, transno 21474839857 00000004:00080000:1.0:1746065087.196483:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df800, transno 21474839859 00000004:00080000:1.0:1746065087.196485:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e37ed80, transno 21474839860 00000004:00080000:1.0:1746065087.196486:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0380, transno 21474839861 00000004:00080000:1.0:1746065087.196488:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2300, transno 21474839862 00000004:00080000:1.0:1746065087.196498:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dc000, transno 21474839863 00000004:00080000:1.0:1746065087.196501:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5dea00, transno 21474839864 00000004:00080000:1.0:1746065087.196503:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf3b80, transno 21474839866 00000004:00080000:1.0:1746065087.196504:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1880, transno 21474839867 00000004:00080000:1.0:1746065087.196506:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f57480, transno 21474839868 00000004:00080000:1.0:1746065087.196508:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf0380, transno 21474839869 00000004:00080000:1.0:1746065087.196509:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f56300, transno 21474839870 00000004:00080000:1.0:1746065087.196511:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095f54000, transno 21474839871 00000004:00080000:1.0:1746065087.196521:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345880, transno 21474839874 00000004:00080000:1.0:1746065087.196523:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137347800, transno 21474839875 00000004:00080000:1.0:1746065087.196525:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137344a80, transno 21474839876 00000004:00080000:1.0:1746065087.196527:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137345c00, transno 21474839877 00000004:00080000:1.0:1746065087.196529:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c529500, transno 21474839880 00000004:00080000:1.0:1746065087.196531:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528000, transno 21474839881 00000004:00080000:1.0:1746065087.196532:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528e00, transno 21474839883 00000004:00080000:1.0:1746065087.196534:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528a80, transno 21474839884 00000004:00080000:1.0:1746065087.196536:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098664a80, transno 21474839885 00000004:00080000:1.0:1746065087.196537:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098666a00, transno 21474839886 00000004:00080000:1.0:1746065087.196539:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09c000, transno 21474839888 00000004:00080000:1.0:1746065087.196540:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09f480, transno 21474839889 00000004:00080000:1.0:1746065087.196542:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09df80, transno 21474839890 00000004:00080000:1.0:1746065087.196544:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09ca80, transno 21474839891 00000004:00080000:1.0:1746065087.196545:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5500, transno 21474839892 00000004:00080000:1.0:1746065087.196547:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf7b80, transno 21474839893 00000004:00080000:1.0:1746065087.196548:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098583800, transno 21474839894 00000004:00080000:1.0:1746065087.196550:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098582a00, transno 21474839895 00000004:00080000:1.0:1746065087.196552:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098582680, transno 21474839897 00000004:00080000:1.0:1746065087.196554:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098580000, transno 21474839898 00000004:00080000:1.0:1746065087.196555:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098582300, transno 21474839899 00000004:00080000:1.0:1746065087.196557:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098580a80, transno 21474839900 00000004:00080000:1.0:1746065087.196558:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098583480, transno 21474839901 00000004:00080000:1.0:1746065087.196560:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098580700, transno 21474839902 00000004:00080000:1.0:1746065087.196562:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc0a80, transno 21474839904 00000004:00080000:1.0:1746065087.196563:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131899500, transno 21474839905 00000004:00080000:1.0:1746065087.196565:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013189aa00, transno 21474839906 00000004:00080000:1.0:1746065087.196567:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013189b800, transno 21474839907 00000004:00080000:1.0:1746065087.196568:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf7480, transno 21474839909 00000004:00080000:1.0:1746065087.196570:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6d80, transno 21474839910 00000004:00080000:1.0:1746065087.196571:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098581f80, transno 21474839911 00000004:00080000:1.0:1746065087.196573:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6680, transno 21474839912 00000004:00080000:1.0:1746065087.196575:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fdc00, transno 21474839914 00000004:00080000:1.0:1746065087.196577:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7ff800, transno 21474839915 00000004:00080000:1.0:1746065087.196579:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a3480, transno 21474839916 00000004:00080000:1.0:1746065087.196581:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a1f80, transno 21474839917 00000004:00080000:1.0:1746065087.196583:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a3100, transno 21474839918 00000004:00080000:1.0:1746065087.196584:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800727a0000, transno 21474839919 00000004:00080000:1.0:1746065087.196586:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8e00, transno 21474839922 00000004:00080000:1.0:1746065087.196588:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8380, transno 21474839923 00000004:00080000:1.0:1746065087.196589:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de300, transno 21474839924 00000004:00080000:1.0:1746065087.196591:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df480, transno 21474839925 00000004:00080000:1.0:1746065087.196593:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecb480, transno 21474839927 00000004:00080000:1.0:1746065087.196594:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecbb80, transno 21474839928 00000004:00080000:1.0:1746065087.196595:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8000, transno 21474839929 00000004:00080000:1.0:1746065087.196597:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecad80, transno 21474839930 00000004:00080000:1.0:1746065087.196599:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85ed80, transno 21474839932 00000004:00080000:1.0:1746065087.196601:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85dc00, transno 21474839933 00000004:00080000:1.0:1746065087.196602:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85d500, transno 21474839934 00000004:00080000:1.0:1746065087.196604:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008d85c000, transno 21474839935 00000004:00080000:1.0:1746065087.196606:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed5880, transno 21474839936 00000004:00080000:1.0:1746065087.196607:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed7800, transno 21474839937 00000004:00080000:1.0:1746065087.196609:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed7100, transno 21474839939 00000004:00080000:1.0:1746065087.196611:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aed5c00, transno 21474839940 00000004:00080000:1.0:1746065087.196613:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10000, transno 21474839941 00000004:00080000:1.0:1746065087.196614:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12680, transno 21474839942 00000004:00080000:1.0:1746065087.196616:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12300, transno 21474839943 00000004:00080000:1.0:1746065087.196618:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10a80, transno 21474839944 00000004:00080000:1.0:1746065087.196620:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e11c00, transno 21474839945 00000004:00080000:1.0:1746065087.196622:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e13100, transno 21474839946 00000004:00080000:1.0:1746065087.196624:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9f80, transno 21474839948 00000004:00080000:1.0:1746065087.196626:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da680, transno 21474839949 00000004:00080000:1.0:1746065087.196628:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957db100, transno 21474839950 00000004:00080000:1.0:1746065087.196630:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957dbb80, transno 21474839951 00000004:00080000:1.0:1746065087.196632:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1c00, transno 21474839953 00000004:00080000:1.0:1746065087.196634:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc1500, transno 21474839954 00000004:00080000:1.0:1746065087.196636:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc3480, transno 21474839955 00000004:00080000:1.0:1746065087.196638:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009abc0380, transno 21474839956 00000004:00080000:1.0:1746065087.196640:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ca80, transno 21474839958 00000004:00080000:1.0:1746065087.196642:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 21474839959 00000004:00080000:1.0:1746065087.196644:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c000, transno 21474839960 00000004:00080000:1.0:1746065087.196646:0:7207:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c380, transno 21474839961 00000100:00100000:1.0:1746065087.196650:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.196762:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690560:0@lo:1000:mdt_rdpg00_001.0 00000004:00080000:3.0:1746065087.196770:0:10211:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 2 changes, 151 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1746065087.196801:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.196821:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.196862:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262690560 00000100:00100000:2.0:1746065087.196865:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262690560 00000100:00100000:2.0:1746065087.196913:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1746065087.196917:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1746065087.196958:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.196962:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1746065087.197008:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.197034:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.197049:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.197068:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065087.197104:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065087.197168:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262690688 00000100:00100000:2.0:1746065087.197172:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262690688 00000004:00080000:3.0:1746065087.197219:0:10211:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 2 changes, 0 in progress, 0 in flight, 151 done 00000100:00100000:2.0:1746065087.197259:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1746065087.197264:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1746065087.197358:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.197363:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1746065087.197371:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.197394:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.197428:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.197439:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.197592:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262690816 00000100:00100000:2.0:1746065087.197595:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262690816 00000100:00100000:2.0:1746065087.197662:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1746065087.197668:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1746065087.197803:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.197809:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1746065087.197895:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.197916:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.197930:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.197938:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.197984:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262690944 00000100:00100000:2.0:1746065087.197986:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262690944 00000100:00100000:2.0:1746065087.197997:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1746065087.198000:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1746065087.198030:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262690944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.198034:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1746065087.198112:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262690944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.198130:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262691072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.198143:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.198150:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065087.198181:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262691072 00000100:00100000:0.0:1746065087.198184:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262691072 00000100:00100000:0.0:1746065087.198197:0:7208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1746065087.198201:0:7208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262691072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1746065087.198230:0:7208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262691072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065087.198233:0:7208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1746065087.198301:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262691072:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:1.0:1746065087.198393:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].18, 640 off48320 00000001:00080000:1.0:1746065087.198401:0:7207:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975946 00000100:00100000:1.0:1746065087.198433:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262691200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.198449:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.198458:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065087.198570:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262691200 00000100:00100000:2.0:1746065087.198573:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262691200 00000100:00100000:2.0:1746065087.198587:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1746065087.198591:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262691200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1746065087.198655:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7207:x1830881262691200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 64us (205us total) trans 17179872714 rc 0/0 00000100:00100000:2.0:1746065087.198659:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1746065087.198794:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262691200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.198810:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262691328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1746065087.198826:0:7207:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.199510:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065087.199754:0:7208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262691328 00000100:00100000:0.0:1746065087.199758:0:7208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262691328 00000100:00100000:2.0:1746065087.199836:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1746065087.199842:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7207:x1830881262691328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1746065087.199915:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7207:x1830881262691328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (1088us total) trans 21474840050 rc 0/0 00000100:00100000:2.0:1746065087.199921:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1746065087.199969:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:7207:1830881262691328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1746065087.200009:0:7207:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975947 00010000:00010000:1.0:1746065087.200031:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200039:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200045:0:7207:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200054:0:7207:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065087.200057:0:7207:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200063:0:7207:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200075:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:1.0:1746065087.200078:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1746065087.200080:0:7207:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200085:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464cd7 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x367:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200098:0:7207:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200102:0:7207:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200106:0:7207:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200110:0:7207:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065087.200111:0:7207:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200115:0:7207:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200120:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065087.200121:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1746065087.200123:0:7207:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200127:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009c718a00/0xad6b7ddc1464cd0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x364:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT1 00010000:00010000:1.0:1746065087.200135:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:1.0:1746065087.200136:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065087.200140:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1464c52 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d637 expref: 299 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065087.200192:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+298:28636:x1830881261620352:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 11233us (11349us total) trans 4294975948 rc 0/0 00000100:00100000:1.0:1746065087.200198:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4340 00000020:00080000:1.0:1746065087.200201:0:7207:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1746065087.201919:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.201958:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261620864 00000100:00100000:3.0:1746065087.201964:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261620864 00000100:00100000:3.0:1746065087.201994:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12649 00000100:00100000:3.0:1746065087.202000:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+298:28636:x1830881261620864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.202014:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.202026:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a175000/0xad6b7ddc1464cde lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d668 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.202061:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a175000/0xad6b7ddc1464cde lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d668 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.202076:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a175000/0xad6b7ddc1464cde lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d668 expref: 299 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.202093:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.202096:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065087.202098:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a175000, rc 0) 00000100:00100000:3.0:1746065087.202141:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+299:28636:x1830881261620864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 141us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.202146:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12649 00000100:00100000:0.0:1746065087.203598:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.203647:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261621120 00000100:00100000:1.0:1746065087.203652:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261621120 00000100:00100000:1.0:1746065087.204407:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4341 00000100:00100000:1.0:1746065087.204414:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+299:28636:x1830881261621120:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065087.204558:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+300:28636:x1830881261621120:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 145us (964us total) trans 4294975949 rc 0/0 00000100:00100000:1.0:1746065087.204564:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4341 00000100:00100000:0.0:1746065087.207586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.208083:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261621376 00000100:00100000:3.0:1746065087.208091:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261621376 00000100:00100000:3.0:1746065087.208123:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4342 00000100:00100000:3.0:1746065087.208130:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+300:28636:x1830881261621376:12345-192.168.202.27@tcp:35:lfs.0 00000004:00080000:3.0:1746065087.208247:0:16721:0:(mdd_object.c:3964:mdd_close()) Object [0x240000403:0x367:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1746065087.208300:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065087.208312:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065087.208321:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065087.208328:0:16721:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065087.208332:0:16721:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065087.208337:0:16721:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT1 00010000:00010000:3.0:1746065087.208346:0:16721:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746065087.208449:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+301:28636:x1830881261621376:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 319us (869us total) trans 4294975950 rc 0/0 00000100:00100000:3.0:1746065087.208455:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4342 00010000:00010000:2.0:1746065087.208604:0:7193:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746065087.208610:0:7193:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065087.208616:0:7193:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a174a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065087.208619:0:7193:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065087.208625:0:7193:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065087.208634:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x367:0x0].0x0 (ffff880098c65300) 00010000:00010000:2.0:1746065087.208636:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746065087.208640:0:7193:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 1/0,0 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065087.208644:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464ce5 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x367:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT1 00010000:00010000:2.0:1746065087.208663:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065087.208664:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065087.208665:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065087.226373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.227084:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261621504 00000100:00100000:3.0:1746065087.227093:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261621504 00000100:00100000:3.0:1746065087.227136:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12650 00000100:00100000:3.0:1746065087.227143:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+301:28637:x1830881261621504:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.227163:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.227180:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464cec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d66f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.227226:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065087.227235:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.227244:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.227254:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065087.227259:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.227264:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.227659:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464d01 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065087.227666:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.227672:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:3.0:1746065087.228329:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00000004:00200000:3.0:1746065087.228333:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065087.228347:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228356:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228363:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228368:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228373:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228379:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228383:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131019c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065087.228386:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228391:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228400:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x0 (ffff88009aa6a400) 00010000:00010000:3.0:1746065087.228402:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065087.228405:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228413:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880131019c00/0xad6b7ddc1464cf3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228440:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228445:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228449:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228453:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095668a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065087.228455:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228459:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228465:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x6:0x0].0x7a0ae006 (ffff88009aa6a300) 00010000:00010000:3.0:1746065087.228467:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065087.228469:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228473:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095668a00/0xad6b7ddc1464cfa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x6:0x0].0x7a0ae006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT1 00010000:00010000:3.0:1746065087.228512:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009a174a00/0xad6b7ddc1464cec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d66f expref: 303 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.228524:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095668600/0xad6b7ddc1464d01 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x364:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d66f expref: 302 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.228535:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.228536:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065087.228538:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668600, rc 0) 00000100:00100000:3.0:1746065087.228585:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+302:28637:x1830881261621504:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1442us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.228591:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12650 00000100:00100000:0.0:1746065087.233448:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.235352:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261621760 00000100:00100000:3.0:1746065087.235364:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261621760 00000100:00100000:3.0:1746065087.235409:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12651 00000100:00100000:3.0:1746065087.235416:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+302:28637:x1830881261621760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.235433:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.235448:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1464d08 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d676 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.235619:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464d0f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065087.235631:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464d0f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:2.0:1746065087.235639:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464d0f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:2.0:1746065087.235649:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00010000:00010000:2.0:1746065087.235755:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095669800/0xad6b7ddc1464d08 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d676 expref: 305 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.236037:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d800/0xad6b7ddc1464d0f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x364:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d676 expref: 304 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.236045:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065087.236047:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065087.236049:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d800, rc 0) 00000100:00100000:2.0:1746065087.236095:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+304:28637:x1830881261621760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 680us (2655us total) trans 4294975951 rc 0/0 00000100:00100000:2.0:1746065087.236101:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12651 00000100:00100000:2.0:1746065087.240656:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.240831:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261622016 00000100:00100000:0.0:1746065087.240839:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261622016 00000100:00100000:0.0:1746065087.240890:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12652 00000100:00100000:0.0:1746065087.240898:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+304:28637:x1830881261622016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065087.240919:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065087.240933:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1464d1d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d67d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065087.241010:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1464d24 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065087.241021:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1464d24 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT1 00010000:00010000:0.0:1746065087.241030:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1464d24 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT1 00000004:00200000:0.0:1746065087.241039:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00010000:00010000:0.0:1746065087.241114:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84b200/0xad6b7ddc1464d1d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d67d expref: 307 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065087.241142:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1464d24 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d67d expref: 306 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065087.241149:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:0.0:1746065087.241152:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065087.241154:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:0.0:1746065087.241204:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+306:28637:x1830881261622016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 307us (555us total) trans 4294975952 rc 0/0 00000100:00100000:0.0:1746065087.241209:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12652 00000100:00100000:0.0:1746065087.246420:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.246602:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261622272 00000100:00100000:2.0:1746065087.246612:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261622272 00000100:00100000:2.0:1746065087.247134:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1412 00000100:00100000:2.0:1746065087.247144:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261622272:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065087.247175:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247190:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.247192:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.247196:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247208:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247284:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247291:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247298:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247305:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6dc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065087.247308:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247315:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247331:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.247337:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc1464d32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.247389:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261622272:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 247us (976us total) trans 0 rc 1086/1086 00000100:00100000:2.0:1746065087.247395:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1412 00000100:00100000:1.0:1746065087.253188:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.255769:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261622528 00000100:00100000:3.0:1746065087.255792:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261622528 00002000:00100000:3.0:1746065087.255830:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (0->4095) req@ffff880129f43100 x1830881261622528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/0 e 0 to 0 dl 1746065098 ref 1 fl New:/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 00002000:00100000:3.0:1746065087.255840:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881261622528 ext(0->4095) 00002000:00010000:3.0:1746065087.255844:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:3.0:1746065087.255876:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1413 00000100:00100000:3.0:1746065087.255882:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261622528:12345-192.168.202.27@tcp:3:lfs.0 00000100:00100000:3.0:1746065087.256014:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261622528:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 132us (2834us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065087.256023:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1413 00002000:00100000:3.0:1746065087.256027:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38a:0x0] (0->4095) req@ffff880129f43100 x1830881261622528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:3/0 lens 488/4536 e 0 to 0 dl 1746065098 ref 1 fl Complete:/200/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 00002000:00100000:3.0:1746065087.256034:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881261622528 ext(0->4095) 00002000:00010000:3.0:1746065087.256036:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:0.0:1746065087.261008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.261344:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.261403:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261622784 00000100:00100000:3.0:1746065087.261414:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261622784 00000100:00100000:3.0:1746065087.261463:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261622656 00000100:00100000:3.0:1746065087.261466:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261622656 00000100:00100000:3.0:1746065087.261482:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8992 00000100:00100000:3.0:1746065087.261487:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261622784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.261512:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.261526:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095669e00/0xad6b7ddc1464d39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d68b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.261546:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.261548:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.261716:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095669e00/0xad6b7ddc1464d39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d68b expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.261730:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095669e00/0xad6b7ddc1464d39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d68b expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.261739:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669e00, rc 0) 00000100:00100000:3.0:1746065087.261808:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881261622784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 320us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.261817:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8992 00000100:00100000:3.0:1746065087.261830:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8993 00000100:00100000:3.0:1746065087.261835:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261622656:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.261841:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.261849:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095669a00/0xad6b7ddc1464d40 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d684 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065087.261882:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262691456:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065087.261933:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065087.263971:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881262691456:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065087.263995:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095669a00/0xad6b7ddc1464d40 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d684 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.264006:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095669a00/0xad6b7ddc1464d40 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d684 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.264053:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669a00, rc 0) 00000100:00100000:3.0:1746065087.264406:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261622656:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2569us (3060us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065087.264415:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8993 00000100:00100000:0.0:1746065087.268664:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.268804:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261622912 00000100:00100000:2.0:1746065087.268812:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261622912 00000100:00100000:2.0:1746065087.268868:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 569 00000100:00100000:2.0:1746065087.268875:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+306:28637:x1830881261622912:12345-192.168.202.27@tcp:103:lfs.0 00010000:00010000:2.0:1746065087.268888:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.268907:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f84a200/0xad6b7ddc1464d24 lrc: 0/0,0 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d67d expref: 306 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.268923:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065087.268926:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.268969:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+305:28637:x1830881261622912:12345-192.168.202.27@tcp:103:lfs.0 Request processed in 94us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.268975:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 569 00000100:00100000:0.0:1746065087.275348:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.275404:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261623168 00000100:00100000:1.0:1746065087.275411:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261623168 00000100:00100000:1.0:1746065087.275449:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4343 00000100:00100000:1.0:1746065087.275455:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+305:28637:x1830881261623168:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065087.275625:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+306:28637:x1830881261623168:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 169us (283us total) trans 4294975953 rc 0/0 00000100:00100000:1.0:1746065087.275634:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4343 00000100:00100000:0.0:1746065087.296246:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.296421:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261623424 00000100:00100000:2.0:1746065087.296429:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261623424 00000100:00100000:2.0:1746065087.296481:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12653 00000100:00100000:2.0:1746065087.296488:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+306:28638:x1830881261623424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065087.296518:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065087.296533:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c800/0xad6b7ddc1464d47 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d692 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.296609:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1464d4e lrc: 3/0,1 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065087.296621:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1464d4e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT1 00010000:00010000:2.0:1746065087.296630:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1464d4e lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT1 00000004:00200000:2.0:1746065087.296640:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x240000403:0x364:0x0]: returning size 1086 00010000:00010000:2.0:1746065087.296719:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6c800/0xad6b7ddc1464d47 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x364:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d692 expref: 309 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.296747:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1464d4e lrc: 3/0,0 mode: PW/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d692 expref: 308 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.296753:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:2.0:1746065087.296756:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065087.296758:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d000, rc 0) 00000100:00100000:2.0:1746065087.296829:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+308:28638:x1830881261623424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 341us (590us total) trans 4294975954 rc 0/0 00000100:00100000:2.0:1746065087.296835:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12653 00000100:00100000:0.0:1746065087.299723:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065087.300465:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.300560:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261623552 00000100:00100000:3.0:1746065087.300568:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261623552 00000100:00100000:3.0:1746065087.300607:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261623680 00000100:00100000:3.0:1746065087.300609:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261623680 00000100:00100000:3.0:1746065087.300629:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8994 00000100:00100000:3.0:1746065087.300636:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261623552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.300650:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.300663:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095669800/0xad6b7ddc1464d5c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d699 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065087.300707:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262691584:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065087.300794:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065087.300807:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8995 00000100:00100000:3.0:1746065087.300812:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881261623680:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065087.300819:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.300827:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095669a00/0xad6b7ddc1464d63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d6a0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.300839:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.300840:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.300846:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095669a00/0xad6b7ddc1464d63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a0 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.300857:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095669a00/0xad6b7ddc1464d63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a0 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.300866:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669a00, rc 0) 00000100:00100000:3.0:1746065087.300884:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881261623680:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.300890:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8995 00000100:00100000:3.0:1746065087.305628:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262691584:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065087.305659:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095669800/0xad6b7ddc1464d5c lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d699 expref: 31 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.305671:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095669800/0xad6b7ddc1464d5c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d699 expref: 31 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.306094:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669800, rc 0) 00000100:00100000:3.0:1746065087.306140:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881261623552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5504us (6424us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065087.306149:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8994 00000100:00100000:2.0:1746065087.314905:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.314988:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261623808 00000100:00100000:3.0:1746065087.314996:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261623808 00000100:00100000:3.0:1746065087.315047:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 570 00000100:00100000:3.0:1746065087.315054:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+308:28638:x1830881261623808:12345-192.168.202.27@tcp:103:lfs.0 00010000:00010000:3.0:1746065087.315067:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065087.315087:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880095f6d000/0xad6b7ddc1464d4e lrc: 0/0,0 mode: --/PW res: [0x240000403:0x364:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d692 expref: 308 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.315116:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x364:0x0].0x0 (ffff880098c65800) 00010000:00010000:3.0:1746065087.315120:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065087.315167:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+307:28638:x1830881261623808:12345-192.168.202.27@tcp:103:lfs.0 Request processed in 112us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.315172:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 570 00000100:00100000:0.0:1746065087.317329:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.317476:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261624064 00000100:00100000:3.0:1746065087.317483:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261624064 00000100:00100000:3.0:1746065087.317541:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4344 00000100:00100000:3.0:1746065087.317547:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+307:28638:x1830881261624064:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065087.317723:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+308:28638:x1830881261624064:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 175us (399us total) trans 4294975955 rc 0/0 00000100:00100000:3.0:1746065087.317729:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4344 00000100:00100000:2.0:1746065087.321385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.321618:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261624192 00000100:00100000:3.0:1746065087.321625:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261624192 00000100:00100000:3.0:1746065087.321738:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8996 00000100:00100000:3.0:1746065087.321745:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:28634:x1830881261624192:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065087.322095:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.322111:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095668a00/0xad6b7ddc1464d6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d6a7 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.322136:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.322143:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.322145:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.322147:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095668a00/0xad6b7ddc1464d6a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a7 expref: 31 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.322173:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065087.322183:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 31 pid: 12260 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746065087.322269:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262691712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065087.322377:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065087.324761:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065087.324859:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261624320 00000100:00100000:2.0:1746065087.324869:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261624320 00010000:00010000:2.0:1746065087.324899:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 32 pid: 12260 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746065087.324922:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3751 00000100:00100000:2.0:1746065087.324928:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881261624320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065087.324937:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065087.324952:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 32 pid: 12260 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746065087.324961:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 32 pid: 12260 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746065087.324980:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.324982:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065087.324988:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095668a00/0xad6b7ddc1464d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a7 expref: 32 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.324994:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095668a00/0xad6b7ddc1464d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a7 expref: 32 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065087.325016:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095668a00/0xad6b7ddc1464d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a7 expref: 32 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065087.325024:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881262691840:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065087.325075:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065087.325185:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090790600/0xad6b7ddc1464abc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d5a4 expref: 32 pid: 12260 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746065087.325199:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881262691712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065087.325215:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095668a00/0xad6b7ddc1464d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6a7 expref: 31 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.325223:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095668a00, rc 0) 00000100:00100000:3.0:1746065087.325247:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+31:28634:x1830881261624192:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 3502us (3868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.325252:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8996 00000100:00100000:2.0:1746065087.326966:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881262691840:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065087.326980:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065087.327008:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881261624320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2079us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065087.327015:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3751 00000100:00100000:0.0:1746065087.328557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.328751:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261624448 00000100:00100000:3.0:1746065087.328757:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261624448 00000100:00100000:3.0:1746065087.328825:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8997 00000100:00100000:3.0:1746065087.328831:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:28634:x1830881261624448:12345-192.168.202.27@tcp:101:fsx.0 00010000:00010000:3.0:1746065087.328847:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065087.328860:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095669800/0xad6b7ddc1464d71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd92d6ae expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065087.328877:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1746065087.328892:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.328894:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065087.328900:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095669800/0xad6b7ddc1464d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6ae expref: 33 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.328911:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095669800/0xad6b7ddc1464d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d6ae expref: 33 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065087.328919:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095669800, rc 0) 00000100:00100000:3.0:1746065087.328952:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:28634:x1830881261624448:12345-192.168.202.27@tcp:101:fsx.0 Request processed in 121us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065087.328957:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8997 00000100:00100000:0.0:1746065087.330837:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065087.331037:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261624704 00000100:00100000:3.0:1746065087.331043:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261624704 00000100:00100000:3.0:1746065087.331070:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4345 00000100:00100000:3.0:1746065087.331075:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+308:28634:x1830881261624704:12345-192.168.202.27@tcp:35:fsx.0 00000001:00080000:3.0:1746065087.331225:0:16721:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294975956 00000100:00100000:3.0:1746065087.331285:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+310:28634:x1830881261624704:12345-192.168.202.27@tcp:35:fsx.0 Request processed in 210us (453us total) trans 4294975957 rc 0/0 00000100:00100000:3.0:1746065087.331291:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4345 00000020:00080000:3.0:1746065087.331294:0:16721:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065087.335032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065087.335663:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881261624960 00000100:00100000:1.0:1746065087.335672:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881261624960 00000100:00100000:1.0:1746065087.335720:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4346 00000100:00100000:1.0:1746065087.335728:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+27:28634:x1830881261624960:12345-192.168.202.27@tcp:35:fsx.0 00000001:00080000:1.0:1746065087.335924:0:7207:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934819 00000100:00100000:1.0:1746065087.336005:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+29:28634:x1830881261624960:12345-192.168.202.27@tcp:35:fsx.0 Request processed in 277us (977us total) trans 8589934820 rc 0/0 00000100:00100000:1.0:1746065087.336011:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4346 00000020:00080000:1.0:1746065087.336015:0:7207:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00080000:0.0:1746065087.549033:0:11456:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 683567257155ns, next at 684567255625ns, rc = 0 00000100:00100000:2.0:1746065087.549109:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262691968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065087.549164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065087.550330:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262691968 00000100:00100000:1.0:1746065087.550338:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262691968 00000100:00100000:1.0:1746065087.550368:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1746065087.550374:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3759:x1830881262691968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065087.550733:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490134720 pending 0 free 3920252928 avail 3688701952 00000100:00100000:1.0:1746065087.550836:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3759:x1830881262691968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 461us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065087.550842:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1746065087.551096:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262691968:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1746065087.709180:0:10212:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 683727404084ns, next at 684727402118ns, rc = 0 00000100:00100000:2.0:1746065087.709198:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065087.709214:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262692096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065087.709272:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065087.709304:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262692096 00000100:00100000:0.0:1746065087.709310:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262692096 00000100:00100000:0.0:1746065087.709343:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1746065087.709351:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3759:x1830881262692096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746065087.709372:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490088768 pending 0 free 3915042816 avail 3682811904 00000100:00100000:0.0:1746065087.709417:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3759:x1830881262692096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065087.709423:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1746065087.709539:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881262692096:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1746065087.751883:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746065088.077627:0:12612:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed Debug log: 69782 lines, 69782 kept, 0 dropped, 0 bad.